It will be terribly easily detected IMMEDIATELY.
There could be 3 or four possible types/stages of a neutron star. A pulsar or magnetar would be immediately detected far, far before it reaches 10 AU to the sun in any direction. The magnetic field would be so powerful, it will probably affect all the magnetically sensitive devices on Earth, considering their magnetic fields are hundreds of billions of times stronger than the magnetic field of any planet in our entire solar system.
If it is an active neutron star, with powerful gamma bursts, we might never detect it at all: we would all be dead already. This would happen if Earth is unlucky enough to be in line with the poles of the neutron star.
Even if it is a dead neutron star, no longer having the unimaginably powerful magnetic field or surface temperature of billions of degrees, it would still be immediately detected due to its extremely strong and devastating effect on the planets in our solar system. Considering that the mass of a neutron is 1.4 to 4 times the mass of our sun, it will absolutely wreak havoc at 10 AU from the sun. The orbits of the planets will initially be elongated irreparably, and then some of them might go swirling into the neutron star, or get slingshot out of the entire solar system.
At the very least, the orbits of the middle planets (Jupiter, Saturn) would be irreparably elongated. Before getting to 10 AU, the neutron star will wreak disaster on the objects in the Kuiper Belt and far, far before that, it would pick up a whole gang of Oort Cloud comets and planetesimals, bringing them inwards with it. Long before the neutron star reached 10 AU, the comets and planetesimals of Oort Cloud and Kuiper Belt will be raining down on the planets (including Earth).
We would probably all be extinct several years before the neutron star reached 10 AU from the sun. So in a sense it would be impossible to detect the neutron star entering our solar system.
In response to Morning Star's comments
I am not sure that the magnetic field would be so strong. Yes, it is extremely strong on the surface. But it decreases cubically with the distance. I think it may be a similar misunderstanding as it goes with the black holes: yes they have a very strong gravitational field, but an 1 Solar mass black hole from 1 AU would have the same gravity as the Sun.
You might not be sure that the magnetic field would be so strong, but a quick internet search tells me otherwise. Try this:
These magnetic fields are hundreds of millions of times stronger than any man-made magnet, and quadrillions of times more powerful than the field surrounding Earth. - Reference
In order to stay on the safe side, I refrained from quadrillions of times and stayed with hundreds of billions of times. About the gravity of black holes, where did I claim that a black hole of mass $x$ will ever have a gravitational field more massive than that?
The change on the orbits of the outer planets would be easily visible and permanent, but it wouldn't have a major effect to us.
In fact the inner planets would be affected more severely by the gravity of the neutron star. It is simple pythagorean theorem scenario calculating the distance of the intruder to the planets. Here, let me help you:
Try and work out the relative distance of the planets from the neutron star and figure out which ones would be affected more.
Furthermore, the neutron star's gravity and the sun's gravity will partially assist each other, not only pulling the planets out of the solar system's plane, but also bringing them closer toward the sun. It is a matter of trignometric ratios and angles. Work it out.
About the gamma bursts: Not all neutron star produces gamma bursts and even they don't do it always.
Where did I state that all neutron stars produce gamma bursts? And when did I state that a GRB source remains active for a long time? Here, I am quoting myself to help you better understand what I meant: If it is an active neutron star, with powerful gamma bursts, we might never detect it at all: we would all be dead already. This would happen if Earth is unlucky enough to be in line with the poles of the neutron star.
The meaning of my statement(s) becomes clear now. Yes?
The surface temperature of the neutron stars is some hundreds of thousands, at most some million K, and not billions. Which is still high, but their whole radiation is not catastrophic. It wouldn't be surely visible with free eye.
Let me help you about the surface temperature of neutron stars. Here: "The temperature inside a newly formed neutron star is from around 10$^{11}$ to 10$^{12}$ kelvin. However, the huge number of neutrinos it emits carry away so much energy that the temperature of an isolated neutron star falls within a few years to around 10$^6$ kelvin." - Reference
OP never mentioned that the neutron star entering the solar system is an old, cold one. Once again I refrained from stating trillions of degrees and stayed on the safe billions figure. Furthermore, notice that even after losing most of their heat, neutron stars still get to a temperature of about a million, an order of magnitude greater than "hundreds of thousands".
Also, where did I state that all of the radiation of the neutron star would be disastrous for us/living beings? And where did I ever mention that all the electromagnetic radiation spectrum of a neutron star lays in the visible range? Quote me.
A 4 solar mass neutron star from 10 AU has the gravitational force of 1/25 of the Sun. Of course it perturbs the orbits, but not significantly, in the case of the Earth it may be even survivable. Considering that the OP says the NS will go above the elliptic, the majority of the orbit perturbation will change the plane in which the Earth orbits. This part won't affect the weather on the Earth. The remainder, yes.
As I mentioned earlier, considering that the intruder star and sun are not perpendicular from the reference point of Earth, they will have a combined gravitational effect on all the planets, pulling them up (as in, away from the solar system's plane) AND toward the sun.