Well, the other point is... we're making very focused Starfleet colonies. It's conceivable that the Starfleet portion of each of our colonies remains fixed while people doing non-Starfleet activity move in and grow around our little mining and research outposts. Not every one of them, but a fair number. This doesn't have to have anything to do with us, because there's no real reason for growth to increase Starfleet resources, it just provides Oneiros a guide as to what worlds he can make more important in the future.