Solar Radiation
Easy
The easiest option would probably be a Shkadov thruster built using a light-sail gravity tractor approach. You build a half-sphere of mirrors around the sun at a distance where light pressure exactly counteracts the gravitational attraction of the sun. Since the photons escaping that system all move in the same general direction (they still cover half a sphere, but their movement along the 'x-axis' (depending on where you put it) always has the same sign), it consistently accelerates sun/light-sail system. This design has a significantly lower efficiency than if one reflected/bent all the light to go into one coherent direction, but wouldn't need any significant active stabilization (if your mirrors are not in the way of a planet).
Efficient
You could get way more efficiency out of a similar design if you aligned the mirrors in a way so that all photons would be deflected in a single preferred direction (think of a faceted or parabolic mirror, and perhaps flat deflector arrays to even align the other half of the total stellar radiation), but since the mirror would now be accelerated away from a direction halfway between the orbital radius and the direction of the beam, combined with gravitation it would experience a net force trying to crush your mirror together (towards the axis of the emitted light). Compensating for that doesn't seem trivial.
Mass Ejection Propulsion
To get the most out of a stars energy production, you'd do well not to rely on photonic propulsion. Since photons have no rest mass, they are incredibly energy inefficient per unit of momentum transferred. And since you are moving a whole star, you probably have more mass than you actually need. Ideally, you would gather heavy elements from the core of the star and accelerate them magnetically using energy gathered by a "common" dyson sphere (or dyson swarm), but it would be way easier to gather the material to be expelled from the surface of the star. You'd get mostly hydrogen and helium this way, which you should fuse into something heavier (ideally iron) to prevent wasting potentially usable energy. The Caplan Thruster design (bussard ramjet fusor engine fed by induced solar wind) might be a quite efficient example of this kind of propulsion (in terms of complexity compared to fuel efficiency), though achieving fusion (and capturing/directing the energy released by it) to something closer to iron (the most stable element) would get you more momentum per used mass.
Black Hole Propulsion
Depending on how exactly black hole evaporation works, the most efficient possible thruster might use a Kugelblitz black hole being fed siphoned off stellar matter. If its emitted radiation could be deflected roughly equally towards the star and away from it, it would remain stationary while photonically pushing on the star. Capturing the released energy and accelerating massive particles would not be any more efficient in this case, since you'd already be emitting half of the total mass energy of the matter into space (the other half being required to push on the star).
Using the black hole installation as a gravity tractor might be even more efficient, possibly emitting 100% of the mass energy of the material consumed in one coherent direction. It would have to be aimed around the star, requiring additional mirrors or incurring a slight (<1%) performance penalty, but this approach would get you as close to perfectly energy efficient propulsion as possible under our current understanding of physics.
I should probably not that while according to our knowledge black hole propulsion might very well be possible, current physics also predicts some specific challanges (which are far less relevant when moving massive stars, but should still be considered), including the emission of extremely highly energetic photons (or even massive particles) by smaller, higher-output black holes and possible problems feeding a black hole that is radiating many TW of power while having a Schwarzschild radius in the attometers.