the only real problem is the angle or the overhang, you can't have both on a large scale. your second picture is actually fine, real formations like that exist. Although the placement of the river makes no sense, a river is not going to stay on top of the hardest rock around, which it has to be to erode into that shape, it will be on one side or the other.
Entire forests of ridiculously sharp vertical stone spikes already exist, it is called Grand Tsingy, another is the common hoodoo type formation, both shown. The only problem that stone is not terribly stable at an unsupported angle. Basically if the stone is soft enough to erode in to a spike it is not strong enough to hold itself up under tension. Rocks are much stronger under compression than tension and overhangs are under tension. But really the nature of erosion means overhanging rock protects the softer rock belows so even when hard rock forms an angled spike, it really forms a cone with softer rock forming the rest of the shape.
The exception is when wind erodes the lower portion faster than a higher portion, but because of how wind works this happens in all directions, leading to top heavy outcrops or balancing rocks. The weakness of the rock limits this in size and to roughly balanced shapes.
You can get overhangs like you want BUT they only occur in very strong rocks with angled bedding planes, usually with a huge mass of rock to counterbalance the overhang, meaning they are are very rare and limited in size. the closest you will get is in the below image, the Troll's Tongue. Which is impressive but still rather small on the scale of your images. basic rule is the bigger the piece of rock the closer to vertical the angle has to be.