nm-testing/tinyllama-oneshot-w4a16-group128-v2
Text Generation • 1B • Updated • 6.14k
NM Testing
company
AI & ML interests
None defined yet.
Recent Activity
View all activity
nm-testing/tinyllama-oneshot-w4a16-channel-v2
Text Generation • 1B • Updated • 6.34k • 1
nm-testing/tinyllama-one-shot-w4a16-group-packed
Text Generation • 1B • Updated • 195
nm-testing/tinyllama-marlin24-w4a16-group128
Text Generation • 0.3B • Updated • 189
nm-testing/nonuniform
Text Generation • 8B • Updated • 189
nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t-alt
Text Generation • 0.9B • Updated • 185
nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t
Text Generation • 1B • Updated • 344 • 1
nm-testing/llama3-8b-w8_channel-a8_tensor-compressed
Text Generation • 8B • Updated • 205
nm-testing/llama-3-instruct-w8a8-dyn-per-token-test
Text Generation • 8B • Updated • 183
nm-testing/granite-8b-code-instruct-128k2of4-W8A8-FP8-Dynamic-Per-Token
8B • Updated • 15
nm-testing/granite-3.1-8b-instruct2of4-W8A8-FP8-Dynamic-Per-Token
8B • Updated • 14
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-tensor
1B • Updated • 1.57k
nm-testing/TinyLlama-1.1B-Chat-v1.0-kvcache-fp8-attn_head
1B • Updated • 1.45k
nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_tinyllama-e2e
1B • Updated • 14
nm-testing/SmolLM-360M-Instruct-quantized.w4a16
0.4B • Updated • 15
nm-testing/SmolLM-135M-Instruct-quantized.w4a16
Text Generation • 0.2B • Updated • 223
nm-testing/Qwen2-1.5B-Instruct-FP8W8
Text Generation • 2B • Updated • 1.38k
nm-testing/Qwen2-0.5B-Instruct
Text Generation • 0.6B • Updated • 183
nm-testing/Phi-3-mini-4k-instruct-kv_cache_default_phi3-e2e
4B • Updated • 19
nm-testing/Phi-3-mini-128k-instruct-FP8
4B • Updated • 852
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized
47B • Updated • 39
nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized
47B • Updated • 21
nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-quantized
47B • Updated • 16
nm-testing/Mistral-7B-Instruct-v0.32of4-W8A8-FP8-Dynamic-Per-Token
7B • Updated • 15
nm-testing/Meta-llama3-8b-Instruct-quant-FP8
Text Generation • 8B • Updated • 22
nm-testing/Meta-llama3-8b-Instruct-SmoothQuant-Fp8
Text Generation • 8B • Updated • 176
nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf
Text Generation • 8B • Updated • 103
nm-testing/Meta-Llama-3-8B-Instruct-spinquantR3-FP8_asym-attn
8B • Updated • 17
nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test
Text Generation • 8B • Updated • 4.96k
nm-testing/Meta-Llama-3-8B-Instruct-attention-fp8
8B • Updated • 16