Inference Optimization

community

Activity Feed

AI & ML interests

None defined yet.

Recent Activity

nm-research updated a dataset 3 days ago

inference-optimization/speculators-qwen3-30b-a3b-instruct-2507

nm-research published a dataset 3 days ago

inference-optimization/speculators-qwen3-30b-a3b-instruct-2507

krishnateja95 updated a collection 4 days ago

HIGGS

View all activity

Collections 6

View 6 collections

models 228

datasets 7

inference-optimization/speculators-qwen3-30b-a3b-instruct-2507

Preview • Updated 3 days ago • 27

inference-optimization/speculators-qwen3-30b-a3b-instruct

Preview • Updated 15 days ago • 49

inference-optimization/speculators-qwen3-32b-instruct

Preview • Updated 15 days ago • 57

inference-optimization/gpt-oss-20b-nan-hidden-states-repro

Updated 22 days ago • 48

inference-optimization/SWE-bench_Multilingual

Viewer • Updated about 1 month ago • 300 • 16

inference-optimization/SWE-bench_Verified

Viewer • Updated about 1 month ago • 500 • 106

inference-optimization/SWE-bench_Lite

Viewer • Updated about 1 month ago • 323 • 38

Inference Optimization

AI & ML interests

Recent Activity

Collections 6

meta-llama/Llama-3.1-8B-Instruct

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

RedHatAI/Llama-3.1-8B-Instruct-NVFP4

inference-optimization/Llama-3.1-8B-Instruct_5_bits_mode_hybrid

inference-optimization/test_tencentbac_fastmtp

inference-optimization/test_qwen3_next_mtp

inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator

inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch3

meta-llama/Llama-3.1-8B-Instruct

RedHatAI/Meta-Llama-3.1-8B-Instruct-FP8-dynamic

RedHatAI/Llama-3.1-8B-Instruct-NVFP4

inference-optimization/Llama-3.1-8B-Instruct_5_bits_mode_hybrid

inference-optimization/test_tencentbac_fastmtp

inference-optimization/test_qwen3_next_mtp

inference-optimization/Qwen3-Next-80B-A3B-Instruct_mtp_speculator

inference-optimization/Qwen3-Next-80B-A3B-Instruct-MTP-ultrachat-epoch3

models 228

inference-optimization/Llama-3.2-3B-Instruct-NVFP4

inference-optimization/Llama-3.2-3B-Instruct-FP8-Dynamic

inference-optimization/Llama-3.2-3B-Instruct-FP8-Block

inference-optimization/Llama-3.2-1B-Instruct-NVFP4

inference-optimization/Llama-3.2-1B-Instruct-FP8-Dynamic

inference-optimization/Llama-3.2-1B-Instruct-FP8-Block

inference-optimization/Qwen3-30B-A3B_5.5_bits_mode_heuristic

inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_heuristic

inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_noise

inference-optimization/Qwen3-30B-A3B_7.0_bits_mode_hybrid

datasets 7

inference-optimization/speculators-qwen3-30b-a3b-instruct-2507

inference-optimization/speculators-qwen3-30b-a3b-instruct

inference-optimization/speculators-qwen3-32b-instruct

inference-optimization/gpt-oss-20b-nan-hidden-states-repro

inference-optimization/SWE-bench_Multilingual

inference-optimization/SWE-bench_Verified

inference-optimization/SWE-bench_Lite

AI & ML interests

Recent Activity

Team members 15

Collections 6

models 228 Sort: Recently updated

datasets 7 Sort: Recently updated

models 228

datasets 7