the world
will pay less

If all tax is replaced by ground rent, and the government takes exactly the same money, most homeowners will pay less. How do we know? Because your share of land is probably a lot less than your current share of tax. Measure your proportion of national land, and your proportion of national income: they won't match.

This is why. Think about the game "Monopoly".
It was originally invented to show how rent works:
When people can own land without paying rent
themselves, most people end up with nothing,
even if they are just as talented as the winner.
So relax. It's only the elites who end up paying
 more. And if that's you, or maybe you are retired
    with a big house but no income, don't worry.
        You can get a big lump sum payment
              so you still end up better off.