that would be the wise thing to do...
I knew if the racket left your hand, the point no longer counts even if it somehow hit the ball back over.
But your explanation make sense, we can separate the racket from other items you bring to court since it's absolutely necessary.