QuantLLM/TinyLlama-1.1B-Chat-GGUF
1B • Updated • 141
QuantLLM
non-profit
AI & ML interests
QuantLLM is an open-source community exploring AI and ML through practical models and real-world applications.
Recent Activity
View all activity
Organization Card
QuantLLM | The Ultra-Fast LLM Quantization
Welcome to QuantLLM — an open-source community focused on building efficient and accessible AI models. This space hosts our quantized and fine-tuned transformer models, designed for real-world applications and ease of deployment.
models 16
QuantLLM/SmolLM2-135M-QuantLLM
Text Generation • 0.1B • Updated • 356
QuantLLM/SmolLM2-135M-GGUF
0.1B • Updated • 392
QuantLLM/Qwen3-0.6B-2bit-gguf
0.6B • Updated • 198
QuantLLM/Qwen3-0.6B-8bit-gguf
0.6B • Updated • 20
QuantLLM/Qwen3-0.6B-4bit-gguf
0.6B • Updated • 179
QuantLLM/Meta-Llama-3-70B-Instruct-4bit-gguf
Text Generation • 71B • Updated • 80 • 1
QuantLLM/functiongemma-270m-it-4bit-mlx
Text Generation • 0.3B • Updated • 7
QuantLLM/functiongemma-270m-it-4bit-gguf
0.3B • Updated • 18
QuantLLM/functiongemma-270m-it-8bit-gguf
0.3B • Updated • 10 • 1
datasets 0
None public yet