Large vessels constrained by draft, vessels under pilotage and Naval Vessels still have right of way over yachts, super yachts fluffing about and Ferries. Sail boats have to give way to just about everything .............. good thing given the way some of these things are handled (as you note).If I recall Manly Ferry's have right of way in Sydney Harbour over powered ships.
I remember doing a 3 ship entry into Sydney Harbour, one of those up at 5am cause we want the inside of the ship to look clean as we pass people 2km on the harbour who cannot see into the ship sort of deals.
As we approached Bradleys Head, some North shore yuppie in his kayak decided 7am was the perfect time to cross to Watson as 3 RAN ships plowed down the channel. No amount of horns or flashing light couls break his stride.
I often wonder if he's still alive of the Manly Ferry called him out on his morning routine and sunk the damn 1 man coffin.
Rules for boating on Sydney Harbour | NSW Government
Operating guidelines for superyachts on Sydney Harbour | NSW Government