Housing Minister Sean Fraser to leave federal cabinet as PMO pushes to add Mark Carney