City-dwellers are being forced to either ditch their cities for affordable hot spots in the South and Midwest or downsize to cheaper apartments.