People Developers who download add PyPi packages to their python projects deepseek, packages that are intentionally mislabeled, are getting malware get malware frequently because PyPi, NPM, crates.io, and any other software library are high-value targets for malware authors.
This happens when any technology picks up in the news. Developers, do the bare minimum research before blindly adding someone else's code to your computer. I searched for Deepseek on pypi and there's tons of these things. Here are some signs: random user uploaded it and not either the official account or the account of someone working in the project; simple misspellings in the package description, or basic stuff like description is missing; repository link doesn't work or is absent; links to repository that is a fork of official repo or is hosted on a small non-standard site (like some person's random forge.io or gitlab site) On the repo site, check the issues. Do people actually use this library? If they do, they report issues and complain about it.
These aren't foolproof but they'll save you from so so much of this. The most successful instances of this attack are always either: unsophisticated but banking on hype to override your security practices (this deepseek stuff) or else take-overs or infiltration of already popular libraries (the infamous left-pad incident, for example).
you don’t actually need to fit the whole model in RAM at once: the 70b for example “requires” something like 120gb of VRAM, but i’m running it on my 64gb m1 mbp - it just starts to run a bit slower (still very usable; i reckon about a word per 300ms)
True, but who cares about the base models? Usefulness is what matters - the 8gb model is pretty useful, better than the free tier of anything I've tried
Maybe the paid models are better... Just like adaptive cruise control, I refuse to rely on it until I can rely on it. I'm driving, I know the top models still need me to drive them, so I'm happy with what I have... Why rely on something that could be taken away?