Flying from Taree, I have never had problems flying into Port Macquarie as it is not controlled airspace.
Operations into controlled airspace require more training, higher onboard equipment levels and limited scope for flight variation, you are controlled.
This all goes to add more cost to flying which is not always in the interest of recreational flying.
These controlled airports are actually being well utilised when you think about it, someone can go and learn 'how to fly' recreationally at a place possibly closer to home, they just need to go elsewhere once they're on their own.
It is always possible to utilise controlled airports/airspace, but you do need to work up to a GA license.
GA PPL pilots that come over to recreational flying can still use their privileges in a recreational aircraft providing it is equipped with the right gear.
Since the inception of Ultralight flying, there has always been the desire to increase weights, performance, range and accessibility, and there has been a gradual change in this direction, but with it has come increased cost and complexity.
The feeling now (as I perceive it) is that we have gone far enough, and that to go any further will have us becoming a copy of GA with all the same costs and regulations that go with it.
Lets keep flying fun...