It’s still not clear how much higher the tariffs will push consumer prices and translate into reduced demand, but industry insiders say the risks are building.