-
inference-optimization/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 19 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-BlockSize16
5B • Updated • 7 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ
5B • Updated • 20 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-SmoothQuant
5B • Updated • 19
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
-
inference-optimization/Llama-3.1-8B-Instruct-NVFP4
5B • Updated • 19 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-BlockSize16
5B • Updated • 7 • 1 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ
5B • Updated • 20 -
inference-optimization/Llama-3.1-8B-Instruct-NVFP4-GPTQ-SmoothQuant
5B • Updated • 19
Tiny models used for testing
models 204
inference-optimization/Qwen3-30B-A3B-speculator.dflash
0.7B • Updated • 254
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-muon1e3-ckpt5
2B • Updated • 16
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-muon1e3-ckpt4
2B • Updated • 10
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-muon1e3-ckpt0
2B • Updated • 43
inference-optimization/Qwen3.5-397B-A17B-FP8-dynamic-speculator.dflash
2B • Updated • 127
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-muon1e3-ckpt3
2B • Updated • 18
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-muon1e3-ckpt2
2B • Updated • 22
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-muon1e3-ckpt1
2B • Updated • 23
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-muon-ckpt2
2B • Updated • 39
inference-optimization/Qwen3-8B-DFlash-b16-fullattn-muon-ckpt1
2B • Updated • 32
datasets 27
inference-optimization/dflash-qwen3-8b-qwen235b-instruct-bs16-prepared-data
Preview • Updated • 46
inference-optimization/every-eval-ever-demo
Viewer • Updated • 1 • 53
inference-optimization/DeepSeek-V4-Flash-responses
Viewer • Updated • 508k • 74
inference-optimization/Qwen3.5-4B-responses
Viewer • Updated • 7.47k • 80
inference-optimization/Qwen3.5-0.8B-responses
Viewer • Updated • 7.47k • 156
inference-optimization/Qwen3.5-9B-responses
Viewer • Updated • 7.67k • 70
inference-optimization/Qwen3-8B-Regenerated-Collection
Preview • Updated • 130
inference-optimization/Qwen3-30B-A3B-responses
Preview • Updated • 56
inference-optimization/gpt-oss-120b-responses
Preview • Updated • 73
inference-optimization/Qwen3-32B-responses
Preview • Updated • 43