Why did the Vitali Klitschko vs David Haye fight never happen?

It was clear after the Wladimir fight, that Haye did not want a rematch, because he could not land his shots on Wladimir. I realised he could still beat a Klitschko, if he fought the brother that...

Why did the Vitali Klitschko vs David Haye fight never happen?