Just how bad is it to retire with a mortgage?

There’s a fierce debate about how much money you really need to retire comfortably, but less is said about how the status of your home affects this.