What would be the long-term impact on the internet and society if Google were to completely fail?

Minimal. You might see a few arms races to fill the vacuum but the end result of that competition would probably be better than what we have now.