Thank you so much for the suggestion! I tried Q8 of the model you mentioned, and I am very impressed with the results! The output itself was exactly what I wanted, the speed was a little on the slower side. Loading my previous conversation with a context of over 15k tokens took about 10 minutes to get the first response, but the later messages were much faster. The web ui loses connection almost every time though, and I just manually copy the response from the terminal window in to the web ui to save it for future context. I am currently downloading the Q6 model, and might experiment with going even lower for faster speeds and more stability, if the quality of the output doesn't degrade too much.
Hi, I don't have much experience with running local AIs, but have tried to use ChatGPT for psychoanalysis purposes and the smarter, but limited for free users model is amazing. I don't like giving such personal information to OpenAI though, so I'd like to set something similar up locally, if possible. I am running Fedora Linux, and have had the best results with KoboldCpp, as it was by far the easiest to set up. I have a Ryzen 7600, 32 GB of ram, and a 7800 xt (16 GB vram). The two things I mostly want from this setup is the smartest model possible, as I've tried some and the responses just don't feel as insightful or though provoking as ChatGPT's, and I also really like the way it handles memory. I don't need "real time" conversation speed, if it means I can get the smarter responses that I am looking for. What models/setups would you recommend? Generally, I've been going for newer + takes up more space = better, but I'm kind of disappointed with the results, although the largest models I've tried have only been around 16 GB, is my setup capable of running bigger models? I've been hesitant to try, as I don't have fast internet and downloading a model usually means keeping my pc running overnight.
PS, I am planning to use this mostly as a way to grow/reflect, not dealing with trauma or loneliness. If you are struggling and are considering AI for help, never forget that it can not replace connections with real human beings.
How about you stop assuming everyone on the internet lives in the USA?
thinks queer people are the ones who are confused
Not a native English speaker, so I might be completely wrong, but doesn't the word 'queer' litteraly mean 'confused' / 'weird'? Not that it makes a difference in this context, I'm just wondering
I imagine a kid who's smart enough to use a vpn, downloading a bunch of videos, and then selling usb drives to their friends at school, or sharing them via gdrive
Yes, it's really good! I do think that it can become a bit repetitive towards the end, but it's worth it for the beginning moments of exploration and discovery. If you haven't played a similar game like Morrowind before, I'd recommend looking for a guide that would explain character creation and skills. I never played the original, so I am no purist and would encourage you to check out some QoL mods and definitely turn on smaller dungeons in the settings, even for a first playtrough. Have fun, if you decide to try it!
I bought The Farmer Was Replaced yestarday, so I'll probably be finishing it over the weekend. It's a cute programming incremental game, but if you have 0 experience with writing code the later challenges might get too difficult
I was going to say Factorio as well! :D Hollow Knight has a native port and is a fantastic game, but my favorite games are ones like OpenMW or DevilutionX where the entire engine is remade from the ground up and open-source
Yes, but will it change my mind about crossbows? I always assumed that these games which were specifically designed with the wiimote in mind are not really worth playing with a mouse. I never tried any, so I could be wrong
Never played it, but my biggest problem is with medieval fantasy type games, as I said in the post, I was fine using a crossbow in Half-Life. That said, I will not care if a crossbow is more powerful, I'll use a regular bow instead if available
In all the games I've played (one exception being Half-Life, but that's different) I really don't like using crossbows and avoid doing so at all costs. I don't really know why that is, but to me they don't seem to fit the setting of games like Elder Scrolls or Gothic. I love using regular bows, however. Maybe crossbows feel too modern for me? I don't really know anything about medieval weapons or when they were invented.
What about you? How do you feel about crossbows in these types of games or do you have a similar weird thing you just don't like and refuse to do in video games?
Yeah, we have this unwritten rule in my friend group to never send links to any videos no matter where they're from. You download the video and send the file
Hello, I've installed Fedora 38 (KDE spin), about the time it came out and need a little help updating it.
I got a system update through Discover when 39 came out, I updated it restarted, and I didn't think much of it. Now that Fedora 40 came out, I did the same thing, but this time, after the update, I checked the system information in the settings, and it says that I am still running Fedora 38!
I have a dual boot system with Windows 10 (ugh, but I need it for work) and I noticed that in grub the option to boot Fedora also says 38. There are also some recovery boot options.
I'm confused and don't know what to do to update to 40? Would really like to avoid doing a fresh install.
I'd say I'm a novice Linux user, but this is the first time in dealing with something like this, so sorry if I missed some crucial information, will provide anything needed to help fix this issue.
Thanks in advance!
I have a laptop with a Ryzen 7 5700U, 16 GB ram, running Fedora 38 linux. I'm looking to run a local uncensored LLM, I'd like to know what would be the best model and software to run it. I'm currently running KoboldAI and Erebus 2.7b. It's okay in terms of speed, but I'm wondering if there's anything better out there. I guess, I would prefer something that is not web-ui based to lower the overhead, if possible. I'm not very well versed in all the lingo yet, so please keep it simple. Thanks!
I think we all draw a line between privacy and convenience and I think I found mine and settled into a comfort zone of sorts. I use Fedora 38. My browser is Mozilla Firefox with it's "strict" setting. uBlock origin and uMatrix. When I need/want to use a site that doesn't work due to blocked connections I relax the restrictions in uMatrix or temporarily disable it entirely if I get frustrated or I'm in a hurry. I watch videos on YouTube. Don't use social media, but I do use Facebook messenger (although I prefer to use Signal with the handful of people I can). I use a Xiaomi phone with custom ad blocking DNS (I'd like to get a Pixel with GrapheneOS someday). I look for an app on F-Droid first, but install it through Google Play if I can't find what I need there. I use Qwant and DuckDuckGo. I use ReVanced. I do not use a VPN. I think that's all the relevant information. My question is: how easy do you think it still is for big tech to track me? Are there any suggestions you would have for a person like me that wouldn't sacrifice too much convenience?
