It does depend on the device though. A desktop PC can easily be upgraded with a new drive, but a laptop it may not be as easy, or in some cases, not possible at all. Could always use an external drive, but those are usually more expensive and quite inconvenient if you move the laptop around.
For less than 100 USD ($90 - I just checked) there are several well-reviewed 2230 form factor 1 TB NVME drives on Amazon - specifically, the Corsair MP600 Mini, the Teamgroup MP44S, and the Inland TN446. And though I don’t have one of those drives (I have the 2 TB version of the Sabrent Rocket instead) I speak from experience when I say that the install process is straightforward.
If you're paying $20/TB, you're probably getting ripped off with some counterfeit garbage from a no-name Chinese Amazon seller that's not even close to the advertised capacity. I wouldn't put anything on one of those drives that I have any intention of keeping for longer than a week at that price.