Search Results for "Quantization"

Found 3 tools matching your query.

Select tools to compare. Login to select more.

Private AI chatbot that runs open-source LLMs entirely on your iPhone, iPad, or Mac. One-time App Store purchase, no ...

Personal Assistants

The de facto standard open-source engine for high-throughput LLM inference and serving on GPUs. Originally developed ...

Local Models & Self-Hosting

The foundational C/C++ inference engine for running LLMs and VLMs locally, created by Georgi Gerganov in March 2023. ...

Local Models & Self-Hosting
0 tools selected ✕