A handfull of surviving members doesn't invalidate my point that all the rest of them would be dead. That would be just a little unacceptable to the heir of those people ergo his people were being held hostage against his behaviour.
Pretty sure the point was that at any point Prince!Vegeta was ready to strike out, it was
post-Planet!Vegeta's destruction, when he, Nappa, and Radditz were the only known (to them) surviving Saiyans. After all, he was a little kid when his parents, planet, and people were wiped out by a passing
despot asteroid. By the way,
how was that story ever supposed to hold water? The Saiyans were
trivially space-capable, 99% of their population were powerful enough to destroy any reasonable-sized asteroid you care to name, and if it was a
big one, like rogue-planet big, Prince!Vegeta destroyed a planet
prior to landing on Earth the first time! I'm sure at least
some of the Saiyans on Planet!Vegeta were capable of similar feats, the Royal Guard if no-one else, King!Vegeta if even
they weren't capable (since the Royal Family held power mostly by consistently having the highest strength in their society,
as well as tradition holding they were the direct descendants of the first Super Saiyan, since the former was held to be proof of the latter).
Not only that, the Saiyans were supposedly
relatively high up in the Cold Empire's military hierarchy (which I can only attribute to the Saiyans so
consistently putting out capable warriors, since so many of Freeza's troops on Namek were so far above even pre-Earth-Zenkai Prince!Vegeta, let alone Radditz or Nappa - I assume those on Namek were considered
exceptional warriors for their species, whereas the Saiyans consistently put out warriors capable of doing Freeza's dirty work - especially since the survivors of a planetary purge on that stealthed ship thought their blasters could hurt Krillin and Gohan, when they weren't that far above Freeza's low-level goons on Namek at that point) and thus capable of calling in emergency support from people like Qui at least, if not calling upon Lord Freeza for some
truly elite warriors to detonate the asteroid - and on top of all of that, the System!Vegeta was at least
relatively well-travelled, so the chances of not spotting an asteroid large enough and/or coming in fast enough to mass-scatter Planet!Vegeta would be
low.
(
Thank god for Bang Paths, is all I can say regarding how many 'Vegeta's I had to differentiate between in the last two paragraphs. At least it would be clearer in Japanese, with Vegeta-sei for the planet, and I guess something along the lines of either Vegeta-Denka, Vegeta-sama, or Vegeta no kimi for our favourite ill-tempered Prince and Vegeta-Heika for his dad, when giving them their proper titles (which you
know Bulma only ever does when she wants something))