The first time I used VI I typed a few characters, then hit backspace to delete some characters. Backspace doesn't delete characters. I closed VI and never opened it again.
I'm very happy. I had the same early experience as you, but I kept with it. I've been using it several years now. When I'm forced back to vim, my fingers remember just enough, but I have to undo pretty often.
It's a text editor. It all began with the ed editor, which is very simple and does one thing, it edits files. Then someone extended it into the ex editor. Then someone added a new feature: being able to visually see the file you're editing, which became vi, the visual editor. Then someone improved that, into vim. What began as an editor where you needed to be fluent in regular expressions but otherwise was simple, is now a very complex editor, moving the functionality of the old UNIX tools into the editor itself.
The same arguments about learning vi/vim/neovim holds for ed. It's not intuitive, you need to get used to it, you need to learn, etc. People choose not to learn vim for the same reason vim users don't want to learn ed.