🍥

记录并分享日常

Tags

12 pages

Llama.cpp

llama.cpp b9196 Update: Windows Prebuilt Binaries Support CUDA 13.1, Vulkan, HIP, and SYCL

A Practical llama.cpp Multi-GPU Benchmarking Approach: Is 2x V100 16GB Faster Than One 32GB Card?

Local LLM Models Recommended for an RTX 3060 GPU

Hermes + Qwen3.6: A Low-Cost Local Agent Deployment

How to Tune llama.cpp on 8GB VRAM: Why 32K Is Safer and 64K Needs KV Cache Quantization

llama.cpp GPU Performance Ranking: Full CUDA, ROCm, and Vulkan Scoreboards Explained with pp512 / tg128 / FA

What the Common GPU Inference Benchmark Metrics Actually Mean: FA, pp512, tg128, and Q4_0

Where Does llama-cli -hf Save Hugging Face Models by Default

How to Fix SSL Certificate Verification Failed When llama-cli Downloads from Hugging Face on Windows

How to Use llama-quantize for GGUF Models

How to Get GGUF Models from Hugging Face with llama.cpp

Gemma 4 Local Runtime Guide: From One-Command Start to Dev Integration