so why not use sunlight, mirrors, and Al2O3 heat pipes and do heat
You will probably be unsurprised to hear that solar thermal rockets are things that people have thought about before. Most designs generally use hydrogen as the reaction mass because of all the lovely exhaust velocity (Isp as high as 900 seconds or more in some cases!) but a high-thrust, low-Isp oxygen-fuelled rocket could be useful in some circumstances.
The basic design is potentially quite versatile. Here's a splendid illustration I found on Project Rho, who got it from Nick Stevens who seems to do a load of nice spacecraft illustration work:

Remember that rockets that use highly oxidising reaction mass won't be able to run on reducing reaction mass (eg. hydrogen) when required (because they'll corrode horribly), so you're limited in the ultimate performance of your rockets. At least you can use something like carbon monoxide to get a tiny performance boost, when it is available.
Performance will of course be disappointing... if you look at the characteristic rocket velocity equation:
$$c_* \propto \sqrt{\frac{T_t}{M_w}}$$
you'll see that because of the square root in there, O2 is only 4 times worse than H2, all else being equal, so you might get >200 seconds Isp, which isn't great given all the inconvenience of storing and handling cryogenic oxidisers.
Honestly, you'd be better off using water. Non-cryogenic, >300 seconds, readily available. Given how much water ice there's going to be out there, I feel like there's no particularly good reason for using O2 as reaction mass, but if you really felt the need I guess the option is available.