You can look at this KB on how to set up autoconnect upon powerup of a VM.
https://kb.vmware.com/s/article/1648
Assuming the USB device is always plugged in to the host machine, USB autoconnect would likely be all that is needed.
But if you are plugging in the USB device while a VM that is not suppose to be receiving that USB device is in focus, I am not aware how to prevent that happening.