I’ve never found the cruise ships to be an issue while we are sailing. But if I’m going to spend any time at all in Road Town, I avoid them. (Trying to eat or shop in Road Town with thousands of cruise ship passengers is an experience not to be repeated.)
Traveltalkonline has a calendar that will show you when the cruise ships are in Tortola and Virgin Gorda. A great tool for making sure you miss them!