Let's take the title as the real question. Instead of being simply told FTL is possible, this answer shall assume that the aliens demonstrate FTL is possible. Their spaceship(s) arrive and depart at FTL velocities. This is observed and records are taken.
There is one obvious example. Nuclear weapons. There was a lot of bouhaha about spies passing on nuclear weapons secrets to the Russians. In fact, it is considered the only piece of information the Soviet Union's scientists only needed to know the bombs worked. The big problems that Tubular Alloys and the Manhattan Project had in developing the first nuclear bomb was they didn't know whether it would work. After the Trinity test, and the leveling of Hiroshima and Nagasaki, there was no doubt nuclear weapons worked.
Of course, the scientists who worked on nuclear bombs had an idea that nuclear fission was involved. Our ability to develop FTL travel after seeing aliens use it depends on whether we have any scientific concept that is the basis for the aliens' technology.
For example, the concepts our science has, currently, that is linked to FTL phenomena include wormholes, Krashnikov tubes, the Alcubierre drive, quantum entanglement, and tachyons. Now if the aliens' FTL has no connection with any of these scientific hypotheses, then our capacity to achieve FTL will be severely limited -- in the short term.
Once we have the inspiration that FTL technology exists then will be an ongoing program of research to discover any scientific basis for FTL travel.
If this leads to humans developing FTL travel several centuries earlier than otherwise might have happened. In that case, it could be said that knowing a technology existing, it can be developed faster.
However, if the technological gap between us and the aliens was equivalent to that between the 21st century and the Ancient Greeks. If we could demonstrate jet aircraft to ancient Athens, the likelihood they would develop jet aircraft earlier than the twentieth century is almost certainly zero.
We might learn something from observations and records of the alien technology. This might lead to the early development of FTL technology, but there are no guarantees. Ultimately, it may depend on the nature of the FTL technology itself. If the technology is millennia ahead of us, then it will be no go. If the technology is mere decades more advanced, then this is feasible.
The answer is it may be possible and it may be impossible. There are too many imponderables.