Tell that to the rafatards who keep pointing out those RG finals Fed lost to Rafa. Surely, if Fed was sent packing by a random in R2 his legacy would be shinier.
You misrepresent the feelings of many Rafa fans, who never said the above in derision of Fed, but as an honour for Rafa, since beating prime Fed (2005-06-07) in slam finals was obviously far more prestigious than beating another player. Likewise, Nole fans can legitimately argue that Djoko's last 3 slams are more prestigious because he won them against Nadal, instead of against smaller players like Tsonga (AO 08) and Murray (AO 11).
Anybody trying to argue that those results are a dishonour for Fed or Nadal is, I agree, a tard.