5mo ago

Some local LLMs tested on an average gaming PC

Local LLM tests · donatas-xyz AI · Discussion #1

10 comments

Average gaming PC.
128GB ram and a 4070 12GB. Doesn't sound average.
- Yeah, not even a 5090? Pf, nice Dwarf Fortress machine I guess.
  
  A dwarf Fortress machine would have an i9-14900KS, 192GB DDR5 RAM and no graphics card.
- No kidding. Steam survey definitely does not agree with this definition of average lmao
- I thought I had a lot of RAM with 64
  
  Well, you do.
  
  64 gigs of ram costs less than $200 these days
I didn't see tokens/s anywhere?
- Performance/vision based tests have tokens/s at the end of tables.

10 comments