You can absolutely do it.
osteoderms have evolved many times, there is however a trade off the more armor you have the less flexible you can be.
Osteoderms have evolved many times. knonw examples exist in crocodiles, xenarthrans including, ground sloths, armadillo, several lines of dinosaurs, several reptiles, multiple amphibians, ect. It is a reoccurring theme.
Many small sperate osteoderms is the most common but not the only option.
Armadillo is probably closest to what you want out of living animals.
Xenarthrans are the only group to evolve large plates that can give you the segmentation look you want. below is a glyptodon tail segment with vertebra.
This will be a very helpful paper for you, https://link.springer.com/article/10.1007/s11837-012-0301-9/figures/3
Note they all have either skin or keratin over the bone, you don't want naked bone exposed to the air for long.