- cross-posted to:
- technology@lemmy.ml
- cross-posted to:
- technology@lemmy.ml
Context: Falcon is a popular free LLM, this is their biggest model yet and they claim it’s now the best open model in the market right now.
Context: Falcon is a popular free LLM, this is their biggest model yet and they claim it’s now the best open model in the market right now.
The model is the brain, you use something like Kobold.cpp to load the model. You’ll have to work with the settings and try different models to get the right load on your GPU.