ExUI - a lightweight web UI for ExLlamaV2 by turboderp
ExUI - a lightweight web UI for ExLlamaV2 by turboderp
github.com GitHub - turboderp/exui: Web UI for ExLlamaV2
Web UI for ExLlamaV2. Contribute to turboderp/exui development by creating an account on GitHub.
The creator of ExLlamaV2 (turboderp) has released a lightweight web UI for running exllamav2, it's quite nice! Missing some stuff from text-generation-webui, but makes up for it by being very streamlined and clean
I've made a docker image for it for anyone who may want to try it out, GitHub repo here:
https://github.com/noneabove1182/exui-docker
And for finding models to run with exllamav2 I've been uploading several here:
https://huggingface.co/bartowski
Enjoy!
0
comments