But while having that Epstein virus will it affect one physical even if it`s not coming back
No, as long as it's in its 'sleeping' mode, it won't be affecting one. Problem is that it might reappear in full force as soon as one is fatigued, having less natural resistance and the like.
So it's pretty hard to tell when it's in fact 'over'. It may last two months, it may last six months, it may last a couple of years without any signs of it being active - and then suddenly it can pop out of the basket again.
Not unlike the herpes virus which, as far as I know, is related to EBV.
Nasty buggers those viruses are.