Axed deportation center is 'little used' and costs taxpayer £6.4m a year to run