The sharpest pullback in people getting into the housing markets has been in southern Ontario and British Columbia, RBC economist Robert Hogue said.