bitnet.cpp: Bringing 1-bit LLM Inference to CPUs and GPUs
Microsoft bitnet.cpp brings BitNet b1.58 and other low-bit models to CPU and GPU inference through optimized kernels, model formats, and benchmark tools, opening practical paths for local LLMs, RAG embeddings, and edge AI.