LocalLLaMA

community

https://www.reddit.com/r/LocalLLaMA/

Activity Feed Request to join this org

AI & ML interests

Local LLMs

Recent Activity

Elixpo submitted a paper 4 days ago

A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware

Elixpo authored a paper 4 days ago

A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware

NihalGazi authored a paper 5 days ago

A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware

View all activity

prithivMLmods

posted an update 2 days ago

Post

385

Scribble-Board-Fast is a sketch-to-image workspace powered by Klein-9B, transforming doodles, brush strokes, stickers, and uploaded images into high-fidelity visuals with 4-step distilled sampling.

> Space: prithivMLmods/Scribble-Board-Fast
> GitHub: https://github.com/PRITHIVSAKTHIUR/Scribble-Board-Fast

> To learn more, visit the app page or the respective model pages.

mahwizzzz

posted an update 4 days ago

Post

I implemented the attention-free bidirectional encoder architecture Avey-B for Urdu a compact 24.87M-parameter language encoder built for efficient Urdu NLP research.

Original Avey-B paper: Avey-B (2602.15814)
Urdu model: mahwizzzz/avey-b-ur

Elixpo

submitted a paper to Daily Papers 4 days ago

A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware

Paper • 2609.05463 • Published Aug 12 • 11

Elixpo

authored a paper 4 days ago

A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware

Paper • 2609.05463 • Published Aug 12 • 11

NihalGazi

authored a paper 5 days ago

A Three-Layer Caching Architecture for Low-Latency LLM Web Search on Commodity CPU Hardware

Paper • 2609.05463 • Published Aug 12 • 11

Aurelien-Morgan

posted an update 8 days ago

Post

2416

@retrain-pipelines execution engine is in perpetual evolution, with the aim to establish itself as SOTA, and for the long run.

However, we neglect no aspect of ML-Eng centricity.

If notebooks is where you like to do dev most,
we support you there 100% too.

Build crazy combos of inline tasks, deep parallel sub-DAG branches, nested asynchronous groups...

... the DAG renderer is undergoing an incremental upgrade

until the next one.

* starring toy tasks here. No ML has been hurt in this video 🙂

prithivMLmods

posted an update 10 days ago

Post

3785

VisionGuardrail, a multimodal content-safety classifier based on Qwen3.5, is now available on Hugging Face in 4B and 9B variants. It is a direct upgrade to ImageShield-MMCF, providing improved parental controls through conservative visual content-safety filtering.

More About:
➠ hf.co/blog — https://huggingface.co/blog/prithivMLmods/vision-guardrail-mini-blog

➠ Models:
✦ VisionGuardrail-4B: prithivMLmods/VisionGuardrail-4B
✦ VisionGuardrail-9B: prithivMLmods/VisionGuardrail-9B

➠ Dataset:
✦ ImageShield-Guardrail-Pro: prithivMLmods/ImageShield-Guardrail-Pro

⤷ To learn more, visit the app page or the respective model pages.

prithivMLmods

posted an update 18 days ago

Post

3082

ImageShield-MMCF — Multimodal Content Filter is a multimodal content-safety classifier built on top of Qwen3.5 and is now available on Hugging Face!

This is the preview initial version (v1.0) of the model, designed to classify visual content as Safe or Unsafe, with a particular focus on detecting Not Safe for Work (NSFW) and other potentially sensitive visual content.

The demo is implemented in the prithivMLmods/opencaption-4b-vl-sft Space, which serves as an active content-safety layer for computer vision tasks. It helps block Not Safe for Work (NSFW) content generation and paves the way for more meaningful and responsible creativity.

⊹ ImageShield-MMCF-0.8B: prithivMLmods/ImageShield-MMCF-0.8B
⊹ ImageShield-MMCF-2B: prithivMLmods/ImageShield-MMCF-2B

2 replies

leonardlin

posted an update 24 days ago

Post

177

I've trained an uploaded a proper MTP head for Ornith 1.5:
- head only: shisa-ai/Ornith-1.5-35B-A3B-MTP-ONLY
- full BF16: shisa-ai/Ornith-1.5-35B-A3B-MTP
- FP8: shisa-ai/Ornith-1.5-35B-A3B-MTP-FP8

prithivMLmods

posted an update 27 days ago

Post

5272

The Qwen3.8 27B demo for object grounding is now available on Hugging Face Spaces.

It features three tasks: Object Detection (Bounding Boxes), Point Localization (Keypoints), and Spatial Guidance (Path Mapping).

Try it now: prithivMLmods/Qwen3.8-27B-Object-Detection

mahwizzzz

posted an update about 1 month ago

Post

205

If you're into running models locally, this might be worth checking out.
https://local.ai/mahwiz/invite

Nymbo

posted an update about 1 month ago

Post

2208

Anthropic gave me six months of Claude Max 20x through the Claude for Open Source program, granted based on my Hugging Face work. Thank you

Anthropic for supporting open source.

So far I've been pointing it at Markdown Minimap, an Obsidian plugin that adds a scrollable IDE-style minimap to your notes. This week I've been clearing a backlog of user-reported issues on it, with Claude often handling them end to end.

https://github.com/Nymbo/Markdown-Minimap — issues and PRs welcome.

prithivMLmods

posted an update about 2 months ago

Post

5552

Made a demo for Text/Image-to-3D Video and Image-to-3D Video asset generation using TRELLIS.2. It is paired with Z-Image-Turbo to accelerate the input image preprocessing pipeline, streamlining the Image-to-3D workflow. The generated GLB (GL Transmission Format) files are converted into MP4 (MPEG-4) videos, making them easy to preview and share. Try it now on Hugging Face Spaces.🤗

➠ Image-to-3D-Video-Asset-Generator: prithivMLmods/Image-to-3D-Video-Asset-Generator
➠ collection: https://huggingface.co/collections/prithivMLmods/multimodal-implementations
➠ github: https://github.com/PRITHIVSAKTHIUR/Image-to-3D-Video-Asset-Generator

⤷ To learn more, visit the app page or the respective model pages.

Nymbo

posted an update about 2 months ago

Post

5934

Introducing Inflect-v2, two exceptionally small, open-weight English TTS models at just 3.9M and 9.3M parameters. Both generate speech multiple times faster than real-time on CPU. Despite their size, Inflect-v2 delivers quality that is competitive with much larger lightweight TTS systems, including KittenTTS, Piper, and Supertonic-3.

CPU, CUDA, PyTorch, and ONNX are supported. Apache 2.0.

See it for yourselves:
owensong/Inflect-Micro-v2
owensong/Inflect-Nano-v2

Try the Demos:
Nymbo/Inflect-TTS (unlimited CPU usage)
owensong/Inflect-v2 (ultra-fast ZeroGPU usage)

6 replies

codelion

authored 4 papers about 2 months ago

posted an update 2 months ago

Post

4148

🇮🇳 Qwen3.5-9B Hindi Instruct — it stops thinking in English
Ask base Qwen3.5-9B a question in Hindi and it burns hundreds of tokens thinking in English inside its think block before a single Devanagari word appears — then code-switches in the answer. I fine-tuned it to close the think block instantly and reply in pure, native Hindi.
✅ Model (16-bit): pankajpandey-dev/qwen3.5-9b-hindi-instruct
✅ GGUF (Q4/Q5/Q8): pankajpandey-dev/qwen3.5-9b-hindi-instruct-GGUF
✅ Try it in the browser: pankajpandey-dev/qwen3.5-9b-hindi-demo
Recipe: Unsloth + LoRA (r=16, response-only loss) on 12.9k Hindi pairs — AI4Bharat anudesh + dolly-hi + wikiHow-hi + Aya Hindi (human-written). The Q4_K_M is 5.4 GB and runs on a plain laptop CPU.
New in this run vs my earlier models: mixed in long-form native sources (wikiHow) after my last eval showed the fine-tune traded detail for conciseness — this one keeps answers detailed and native.
Part of my weekly 🇮🇳 Hindi LLM Series. Feedback welcome 🙏
#Hindi #IndicNLP #Qwen #GGUF #LocalLLM #Unsloth

4 replies

Shrijanagain

posted an update 3 months ago

Post

283

Welcome Researcher and Developers!

SKT AI Labs, we are pushing the boundaries of AI architecture and research—and today, we are thrilled to open our doors to the global research community!

We warmly welcome researchers, developers, and AI enthusiasts to join us and contribute to our R&D efforts.

🧪 What You Can Explore:

We invite you to experiment with our WMF (Weight Manifold Fusion) technology. You can test this high-dimensional fusion technique on smaller models to gain a deeper understanding of its behavior and token convergence.

---------- CHECK OUT:

SPACE : SKT-NRS/RD
EXPERIMENT : https://huggingface.co/sKT-Ai-Labs/SKT-SURYA-H
DIRECT TO MAIN DISCUSSION : SKT-NRS/RD#1

🤝 Your Feedback Shapes the Future :

If it works: Fantastic! Share your results with us and contribute directly to the core vision of SKT AI Labs.

If it doesn't work: No problem at all! Your critical feedback is just as valuable to us. Every experiment and anomaly helps us refine this architecture to make it more stable and robust.

We firmly believe that true innovation stems from community collaboration and transparent testing. Let's build the future of advanced AI together. Your ideas, test results, and feedback are always welcome!

You Can Still Research and Development On WMF Only SKT-SURYA-H Model is Dismissed.

Let's innovate and build together! 💡

AI & ML interests

Recent Activity

Team members 113

LocalLLaMA's activity