Probably it's some kind of rhythm/get in the groove thing. In the WTF final he didn't win a point until half of the set was gone. Ok, Fed was really awesome, but not winning a single point is somewhat unusual. However, as the match and rallies were getting longer, he was better and better.
It's a nightmare for a fan though, often I'd turn off the video and just check live scores time to time.