while air is similar to water, as in it behaves like a fluid, it is a lot less dense, this has benefits and costs. a benefit of the low density mean that the drag is far lower than in water, and the drag is dependant on density, this means that most body shapes would be able to "swim" well, assuming that they can push on the air well.
Which leads to the problem of low density, things move through water by pushing the water behind them, then from newtons third law pushing the water back pushes you forward. but the lower density means that for the same amount of fluid (either air or water)air gives less of a push forward, which is why astronauts cant "swim" in zero G, they can't push enough air behind them to start moving, at a good speed.
But if your creatures have over sized fins (approximately ~$25-30$ times longer and wider) then it should be able to work, keeping in mind that once it starts moving it won't slow down from drag, as much as it would in water.
why ~$25-30$ times bigger: As the density of water is $1000Kg/m^3$ and the density of air is ~$1Kg/m^3$, and for the thing to push approximately the same mass of air back, it need have a $1000$ times bigger area, which means that each side needs to be ~$\sqrt{1000}=31.6$
So the fins need to be approximately $31$ times longer, you would be able to go slightly lower if you want you creatures to accelerate slower, as the drag is minimal they will just keep going.
hopefully that helps