quantization 1

Recently Updated

One Small Model, Many Skills: Switching LoRA Adapters On-Device to Get the Most Out of a Mobile SLM
How to Run a 1-Bit LLM On-Device with llama.cpp: Deploying Bonsai on iOS
How to Run an LLM On-Device with LiteRT-LM: A Complete iOS Integration Tutorial
The Future of On-Device AI: 7 Trends That Will Shape the Field Over the Next 5 Years
GPU Isn't Always the Answer: Benchmarking CPU vs GPU for Small Language Models on Mobile

New content available