Most of these answers are ignoring the science-fiction tag and are comparing your system against "reality" and finding fault. Well... yes... we could do that... but that doesn't help you develop a suspension-of-disbelief system for your world.
I personally like the basic premise of your concept, but we need to introduce a better concept than "1 hr / 1 hr" because nowhere on earth do we analyze Newtonian action in the context of "1 km / 1 km." We analyze it as 1 Km/s.
And that's the basic problem. We're already using the time axis and no believable system can be developed based on unitless numbers. However, it appears the purpose of your system is to express time travel in terms of energy. Let's play with that for a second.
Arbitrarily, when walking down the street we can think of ourselves as using some number of joules to move our mass a kilometer down the road. What you want to do is use some number of "joules" (the temporal equivalent, let's call it the Chasly) to move our mass down the axis of time.
Temporal Rest Energy
If we sit in front of a TV and stare at it dumbly, we're moving forward along the time axis. It appears no energy is being spent — but in reality energy is being spent in your system just as energy is being spent by the Earth to move us around its rotation, around its orbit around the sun, around the sun's orbit around the galaxy, etc. There's all kinds of energy washing around. We'll call this "temporal rest energy" or ETR.
What units does this have? Time has two conditions here, so it's inappropriate to use "seconds" twice. What we have are seconds and traveled seconds. The former is the time during which energy is applied. The latter is the time traveled. E.G., it's a "distance" from the perspective of time travel. And since it's pretty much always true that increasing mass causes problems (and whenever "life" is involved, the inverse-cube-law is involved), I declare our fictional Chasly to have units of (sT * Kg3 / s2) because it's a form of acceleration (temporal acceleration dontchaknow) and it takes a lot of Chaslys to move a couch potato through time (prove me wrong OP!).
ETR = sT * Kg3 / s2
Now, what's important about ETR is that light, which is kinda massless1, experiences no forward time as it travels through the universe. Thus, the limit Kg as TST➝0 = 0. Photons have no temporal rest energy, which makes sense as they aren't experiencing time.
On the other hand, Couch Potatoes have substantial mass and definitely experience (if not notice) the passage of time. Thus, as TST➝1 (meaning a 1:1 correlation between time traveled and the time needed to travel it) the Temporal Rest Energy is equal to the mass of the Couch Potato cubed.
ETR = Kg3
Or, your average 150 Kg couch potato requires 3.375 mega-Chaslys just to experience the pleasure of watching TV.
Now, what does it take to stop the flow of time for that Couch Potato?
It takes a lot less for the couch potato to perceive time has stopped than it actually takes to stop time. So, "if it's truth you're interested in, Dr. Tyree's philosophy class is right down the hall." We're not interested in perception. We're interested in reality! (*cough*)
Newtonian Temporality demands that an equal and opposite force be applied. but what does that mean when we're dealing with time? We know our couch potato's temporal rest energy. Now we need to push against it. By applying -3.375 mega-Chaslys against the couch potato we are able to freeze said C.P. in place such that he/she/it isn't experiencing the passage of time. ET = 0, which is what we would expect since photons experience the same number of Chaslys and also experience no time. So far so good.
But what happens if we really try to move the mail?
Let's push our couch potato forward in time 60 seconds and take 4 seconds to do it!
ET = 60 * 1503 / 42 = 12.66 mega-Chaslys!
As we can see, the temporal energy needed to move through time increases the faster we want to do it! This simple reality can be proven by placing your head against a wall and trying to push through it. The faster you try to accomplish the goal, the more it hurts, thereby proving more Chaslys are required to move quickly through time.
OK, but did you answer the question?
I have no idea. I've been having too much fun. Give me a moment to check.... YUP! I think so! Except for calling the unit of energy the Chasly rather than Newton — which makes sense as it's a completely different type of energy, otherwise we'd call Coulombs, Newtons, and really confuse things.
1 No it isn't. But, we're into science fiction and compared to me, the couch potato, it's so small that we'll call it zero.