LocalLLaMA !localllama@sh.itjust.works

Welcome to LocalLLaMA! Here we discuss running and developing machine learn

---

Read more

Members

3,576

Posts

328

Active Today

7

Created

2 yr. ago

Moderators

---

Running Local LLMs with Ollama on openSUSE Tumbleweed

need help understanding if this setup is even feasible.

New, promising MoE model "Hunyuan" by Tencent

Are you using any MCP servers? If so, what?

Do you quantize models yourself?

Any recomendations for a text editor with good AI integration (not code editor)

Local Voiceover/Audiobook generation

Current best local models for tool use?

I'm excited for dots.llm (142BA14B)!

What to Integrate With My AI

Despite record gaming revenues, Nvidia reportedly plans to cut RTX 50 series production to allocate it to new AI hardware

Noob experience using local LLM as a D&D style DM.

Don't overlook llama.cpp's rpc-server feature.

LLMs and their efficiency, can they really replace humans?

A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally on your phone. APK

I don't want them to, but Snapchat would have a great dataset to make an actually funny LLM.

Arch (btw), ROCm (AMD), docker (podman), llama.cpp (server) setup

Three Agent Protocols to Complete the Stack

Intel launches $299 Arc Pro B50 with 16GB of memory, 'Project Battlematrix' workstations with 24GB Arc Pro B60 GPUs

8B Byte Latent Transformer model released by meta