While Canadian traffic has slowed heading to the U.S., there has also been a decline in the number of Americans heading in the opposite direction as well.