All drones are required to register with the FAA and have some pretty specific rules governing the use of them, one of the reasons I don't fly radio control aircraft any more (flew more than 30 years) is because of these drone idiots, they think nothing of invading your space for "fun" and in most cases d their best to avoid responsibility for their actions. As for me I'd take it out with the 4 iron then stomp on it when it hit the ground....From my experience with some that fly them they really don't know where it is as they only have the screen for reference, like a video game.
All drones are not required to be registered by the FAA. The only drones that have to be registered are ones you use it for commercial purposes. A drone capable of doing fpv like this probably cost close to a grand or more and tossing a stick or something at it, assuming it’s that close, would probably back them off.
True, there is a 250g weight limit for FAA registration that exempts many "toy" drones. That said, you can absolutely fly FPV with a relatively inexpensive toy drone. For under $200 you can get 1000 meter (2/3 mile) range under GPS control, 150m range under FPV control, and up to 250 meter altitude with a from something like a Hubsan 502S.
If it's something like a DJI Phantom or Mavic, then yeah they're in the $1000 range but you can get a rig capable of covering an entire golf course from the clubhouse for a fraction of that cost.
True, the fpv range is gonna give out before the actual range on the cheaper drones. For those I believe the person would still have to be relatively close. I have a couple (MJX Bugs 3 and Force1 F100) that aren’t exactly toys but aren’t equipped with any bells and whistles just for fun flying. A mavic has like a 7 mile range and built in safeguards that would be more likely used for something like this.
MJX Bugs 3 would be at the top of my list if I was still flying. I built my camera/vtx system to be able to move easily from my quad to my 1:10 truck, so that's what I've been using to scratch my FPV itch lately.
Enjoy the skies!