Attention stone old town hall proverbs route
If something went without a struggle, you can take it literally: no blows or punches were dealt to achieve something. You say it when something succeeded without any problems and thus went very easily. So "stroke and punch" stands for "trouble.
What certainly did not go without a struggle was the move of the town hall from Loon op Zand to Kaatsheuvel. In fact, 150 soldiers were called in! Despite the opposition surrounding the move, the first town hall of Kaatsheuvel was built at the intersection across from where you are now standing. You can read more about it on the attention stone.