LocalLLaMA !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learn

---

Read more

Members

3,576

Posts

328

Active Today

4

Created

2 yr. ago

Moderators

---

Continuous Thought Machines

What model to grade practice test?

32B olmo-2 03/25

Specialize LLM

I'm using open web ui, does anybody else have a better interface?

Qwen3-32b: Windows95 starfield screensaver web app with warp drive on click

Qwen3 officially released

Qwen3 "Leaked"

DeepSeek R2 AI Model Rumors Begin to Swirl Online; Reported to Feature 97% Lower Costs Compared to GPT-4 & Fully Trained on Huawei's Ascend Chips

Niche Model of the Day: Nemotron 49B 3bpw exl3

How do I get started with RAG (ideally with llama.cpp)?

Less positive model

Niche Model of the Day: Openbuddy 25.2q, QwQ 32B with Quantization Aware Training

Can it play Doom? - New VLM Benchmark

Microsoft researchers build 1-bit AI LLM with 2B parameters — model small enough to run on some CPUs

Should be able to load the full version of DeepSeek R1 on this no prob 😎😎

Microsoft just released BitNet!

What do you use AI for?

The Llama 4 herd: The beginning of a new era of natively multimodal AI innovation

Tips for getting Ollama to be useful with home assistant?