TL;DR - MATH INCOMING: Approximately 99.9996% the speed of light.
Let's take a trip in a spaceship, just to get away from all that silly air friction and other inconvenient matter. Assuming a frequency of light from our sun out of atmosphere preferably, only caring about the visible spectrum, assuming 500nm wavelength for simplicity:
By the Doppler effect, the frequency of light/sound observed is a ratio of speeds multiplied by the actual frequency. Note that the equations differ when considering the high speed of light. We use the Relativistic Doppler effect for this.
$f_o$ = Frequency observed
$\lambda_o$ = Wavelength observed
$f_s$ = Source frequency
$\lambda_s$ = Source wavelength
$c$ = Speed of light, ~$3.0 \cdot 10^8 m/s$ in vacuum or air.
$v_r$ = The velocity of the receiver (our imaginary spaceship) with respect to the source. It can also be the source with respect to the receiver.
Note that the frequency of an electromagnetic wave is $f = \frac{c}{\lambda}$. Thus we have $f_o = 6 \cdot 10^{14} Hz$
We have the following equation for the Doppler effect
$$f_s = f_o \cdot \sqrt{\frac{1+\beta}{1-\beta}}$$
Where $\beta = \cfrac{v_r}{c}$
Let's assume X-Rays (which range from 0.01 nm to 10 nm) are going to be 1 nm in wavelength for us, a frequency of $3 \cdot 10^{17} Hz$.
After some rearranging we find the following:
$$-v_r =
\frac{({f_s}/{f_o})^2 - 1}{({f_s}/{f_o})^2 + 1} \cdot c ~ =
\frac{({\lambda_o}/{\lambda_s})^2 - 1}{({\lambda_o}/{\lambda_s})^2 + 1} \cdot c$$
A negative speed (as we have here) indicates that the source and observer are approaching one another. In our hypothetical scenario, we have $\frac{f_s}{f_o} = 500$ The answer to this gives $0.999996 \cdot c$, quite fast for our imaginary spaceship. If we can move that fast, I would hope to have reasonable radiation shielding.
However...
A star can emit more than just ordinary light, and space is full of more potent parts of the EM spectrum. What if you were flying near a star emitting high-intensity X-Rays? Or a source gamma rays? Stars can also eject high energy particles, which could cause some problems if they hit you.
You also mentioned that light eventually "pushes back." I'm not 100% sure if this will be the correct interpretation of that, but I'll try my best. What happens when we approach the speed of light? Why can't we reach it? According to the theory of relativity, as we approach the speed of light, our mass increases more and more, until eventually we hit a point (at $v = c$) where our mass becomes infinite. The problem with this is that our speed is maintained (and increased) with energy, and energy requirements increase with both mass and speed ($E = \frac{1}{2}mv^2$). For more info see this answer on Physics.SE.
Alternatively (and probably an explanation for the effect in the question), as Kaine mentioned in the comments, light does indeed have momentum that will exert a force as you move against it! What's really interesting is that we don't necessarily need to move at high speeds to observe the effects. Solar sailing works this way, and there is the "Light Mill."