Then at some point you will run into another problem - later in the game, all casters besides maybe sorcerer feel the same. Yeah, you have class features, but when you have a choice between casting high level spell or using class feature you will choose high level spell in 9 times out of 10. Also, most of the casters subclass features are enabling certain playstyles instead of giving new OP ability.