Ministers should leave the press 'well alone', former Supreme Court judge says