"We understand that this is a lifeline for the port and the greater economy at large. But there has to be a balance," said one neighbour.