Tag

#llama.cpp

2 articles

Nous Research Adds One-Click Local Model Setup to Hermes Desktop

Learn how to use Hermes Desktop for one-click local AI model setup, automatically configuring optimized models for your hardware with just a few simple steps.

Sep 563

Deploying a 1-Bit Bonsai-27B Model with PrismML llama.cpp and OpenAI-Compatible Local Inference Workflows

Developers have successfully deployed the 1-bit Bonsai-27B language model using PrismML’s fork of llama.cpp, enabling efficient local inference with OpenAI-compatible workflows.

Jul 2772