An investigation is underway by police after swastikas were spray-painted on a Jewish synagogue in Winnipeg as the Sabbath was about to begin.