Ground rent is
enough to replace tax.
Taxation is the money we pay in order to live under a particular government.
So taxation is rent. What we currently call rent is just "rent on top of the other rent".
So we already pay that much rent, we just pay it in an inefficient way.
If you think land is not worth it you just use less land. If any land is unused, government loses money and has to lower prices.
If governments still charge too much, people will just leave for another ground rent nation, as ground rent provides plenty of jobs. So the over charging nation loses income and cannot survive.