They aliens' arrival emit gravitational waves when leaving FTL. LIGO detected it.
The alien fleet's FTL technology emits a burst of gravitational waves when they leave supra-luminal speeds. The fleet needs to be big, massive, but not that much.
IRL, gravitational waves are only detected when cosmic events in the scale of black holes fusing or supernova explosions, but these are thousands of light-years away.
Since they decay at 1/r and not 1/r2, the fleet needs to be a sizeable one to create detectable waves.
Compare the required energy/mass in proportion to the square of the distance to "beyond pluto's orbit" (e-4 LY^2) to the square of the furthest black (e+9 LY^2).
The magnitude of the gravity waves produced by the aliens need to be around e-13 times the waves produced by the black hole merger.
A typical stellar-class of black hole has a mass between about 3 and 10 solar masses. ref
So your alien fleet doesn't even have to be massive. A solar mass is about 1.989e+30 kilograms. Multiplying all that, the fleet needs to cause gravitational waves as the collision of a mass in the order of e+17 kilograms, or a million times the massin the ballpark of a hundred million times the mass of an oil supertanker ships. That's way smaller than the Star Wars' Death Star ref.
An oil tanker's weight is in the 10e+9 kg order of magnitude. ref
Your fictional alien motherships will need to be be bigger than that.
The only thing your FTL technology really needs is to emit gravitational waves. The rest is covered.
LIGO can pinpoint direction, so scientists will know exactly where to look for, and maybe spot your aliens within your timeframe.