A magic search term that might be of interest to you is statite. A statite balances the force of gravitational attraction to a body (such as a planet or star) with light pressure on a solar sail (though other mechanisms could be used instead, such as a magnetic sail or some other suitably science-fictional gadgetry). Such a spacecraft would not be orbiting and could remain "fixed" relative to that body, though it would probably have to trim its sails a bit from time to time if there were changes in light pressure or local gravity.
From recollection, the jump-ships in the Battletech universe assumed this position, using an energy-collecting solar sail to charge their FTL transport system.
The major issue you have is that transitioning from a solar equatorial-ish orbit (like the one that the Earth is in) to a solar-polar orbit is extremely expensive in terms of delta-V, and then once you reach your pole-sitting statite you need much more delta-V again to stop. If you have a super-efficient torch drive you might not have to worry about such a thing, of course.
If it helps, the setting assumes that the spacecraft rarely accelerates/decelerates greater than 1 gee for long periods for the comfort of its crew. The technology is vaguely like ours
Accelerating at 1G for extended periods of time requires rockets of astonishing power and capability, and would be far beyond what humans are capable of for a considerable time. Be careful about going down the hard scifi route, for real world physics is tough to beat!
addendum
Now you've given a few more hints about what you're thinking about, I can add the following observations:
- Solar flux is negligible outside of the inner solar system. Even at Marslike distances from the sun it is too low, and by the time you get out to Saturnlike distances you'll barely notice it... a perfectly absorbing sail would experience ~50 nanonewtons of thrust per square metre. Solar collectors and solar sails are both largely pointless out here
- Gravity apparently obeys the same inverse-square laws as light, so at Saturnlike distances a Sunlike star only exerts about 6.5 microgees. You can acheive station-keeping thrusts against this using something an ion drive... the Dawn space probe acheived a greater acceleration than this when fully loaded, and had enough fuel to run its rocket for years. Unlike a solar statite, your rocket-based things would need periodic refuelling.
- A brachistochrone transit crossing 8 AU (eg. from an Earthlike distance to a Saturnlike distance from a star) at 1G continuous acceleration takes about 8 days and requires a Delta-V of ~7000 km/s. Even to fly a single AU at that acceleration is ~2400 km/s. That's a lot. Dawn had 11 km/s. You can't do this without serious nuclear rocketry, but if you can do it then you can consider the laws of orbital mechanics more as polite requests. For example, injecting yourself into a polar heliocentric orbit from an earthlike heliocentric orbit requires ~42 km/s delta-V... an outrageous amount for a modern-day or near-future spacecraft, but a rounding error for your monstrous things. They can just point where they want to do and blast and not worry too much. "Parking" by the non-orbital target and station-keeping to oppose the local gravity gradient would be trivial.
addendum 2
Because I thought it was an interesting discovery, even if it is obvious in retrospect, there's an equation you can derive from the force imparted by sunlight on a perfectly absorbing surface, and the force caused by the gravity of the sun an equation that tells you how large a sail would have to be in order to make a statite: $$C_{ad} = { L_\odot \over {4\pi c G M_\odot} }$$
The critical areal density of a solar sail, $C_{ad}$, in kilograms per square metre, is the ratio of the total mass of your statite (including the sail) to the surface area of the sail pointing directly at the Sun. $L_\odot$ is the luminosity of the Sun, in watts, $M_\odot$ is the mass of the Sun, $c$ is the speed of light, and $G$ is the gravitational constant.
This ratio is independant of the distance of the sail from the Sun, because both light pressure and gravitational attraction obey the inverse square law, and so cancel each other out nicely. If the areal density of your statite exceeds this critical ratio, it will fall back towards the Sun and a firey demise. If it is lower than the critical ratio, it will be blown out into deep space, though possibly very slowly. In the latter case at least you can do station keeping by pointing your sail ever so slightly away from the sun to reduce sunlight pressure.
For the Sun, the critical ratio is ~0.765g/m2. Clearly, statites of any significant mass will need colossal sails of some exceedingly light, low density material. Using a solar-powered ion drive is probably a much more sensible way to hold yourself up, even if you do need periodic refuelling.