The other answers have addressed the tensile limitations of concrete, and proposed that buildings might keep a low profile, etc. etc., and I totally agree.
If your society is still using natural materials for construction (timber, stone) I'd say they would be making very squat buildings with very thick stone walls. Thick enough, even a 'pile of stones' (a wall without mortar) will withstand strong winds.
There are three things I've not yet seen mentioned: doors, windows and roofs.
Depending on how primitive (or modern) your society is, they might not even use windows. Slit windows might be common - they let in (some) light and fresh air, but keep out flying debris picked up by storms. If wider windows are used (esp. if glazed) then really-substantial shutters on the outside will be the norm.
Regarding doors - people might build a through-corridor, from one side of a house to the other, and open at both ends, with the main entrance to the building half-way down the corridor. And, the corridor would be aligned across the prevailing winds. This arrangement prevents direct pressure against the door, and (depending on the exact wind direction) minimizes strong air currents in the corridor (because the pressure at the ends of the corridor will be roughly equal).
Regarding roofs - I have seen news reports of thin metal roofs being lifted by the suction of strong windows (that is, after all, how airplanes fly!). Roofs, therefore, will be heavy, and nearly horizontal. Pitched roofs will have one side facing (more or less) into the wind ... and the other side will face the suction of being in the wind shadow. You might find that dwellings will be single-story buildings, with substantial turf roofs, built into the landscape (i.e. few walls exposed to the wind, that would deflect it up and over roofs).
Think, hobbit houses!