So in a world where giant rock and metal golems 'spawn' naturally. These golems are the kind with a power core hidden inside their bodies, their body and limbs are held together by invisible mana threads naturally with the core's help. The golem consumes mana to move which is why they are a bit on the slow side, but can absorb the mana from the surroundings to replenish their supply.[mana exists naturally on the planet and in everything, it's invisible and highly abundant in places with much nature, humans can't manipulate nor sense the power at all]
This golems aren't exactly the brightest, they won't go like 'oh look a giant city is in my way, might be a good idea to move out of the way.' and just plow through the city, they do try not to crush too much stuff but that's like a low level priority. However they have enough intelligence to identify hostiles and non-hostiles, they will crush any that try to harm them. They are have a strictly non-aggressive[they don't really mean to destroy anything] attitude until some fool tries to do something to them.
They do have a form of mana eye that allows vision and a natural regeneration ability in the presence of mana[which is everywhere] for when they drop off cliffs and mountains in their wander. These golems have something like wanderlust but are not against settling down for a few thousand years at places with high mana density, they also don't mind walking across the Pacific Ocean.
These golems are around 5 meters tall and wide when first 'birthed' and get reach heights around 80-100 meters tall and 110-120 meters wide when full grown at around 500 years old[they grow by absorbing mana], they also have about a lifespan of about 100,000 years which means that there are around 5000-maximum 10000 golems at any given time provided 100,000 years have past since their first birth as they spawn about once or twice every 20 years or so.
They are assumed to have been made by nature to combat corrupting monsters[these are much more hostile to life and they spread corruption that is something like a deadly plaque which can be cured eventually by mana, the monsters are only on the level of fearsome wolves and saber kitties that a squad of knights can handle]
Now what methods and strategies can medieval people carry out to cope with this wandering golems to prevent them from 'accidentally' making a road through their towns and cities? What kind of adaptations does humanity need to cope with these golems? They are considered to be something akin to natural calamities.
They look something akin to this without that strange thing on its back.