π’ Embedding Models
Collection
Vector embedding models for on-device RAG, semantic search, and retrieval-augmented generation. Compact enough to run locally on mobile hardware. β’ 4 items β’ Updated
How to use dispatchAI/Qwen3-Embedding-0.6B-mobile with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("dispatchAI/Qwen3-Embedding-0.6B-mobile", device_map="auto")How to use dispatchAI/Qwen3-Embedding-0.6B-mobile with llama.cpp:
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf dispatchAI/Qwen3-Embedding-0.6B-mobile --embeddings
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf dispatchAI/Qwen3-Embedding-0.6B-mobile --embeddings
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible embeddings server: ./llama-server -hf dispatchAI/Qwen3-Embedding-0.6B-mobile --embeddings
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible embeddings server: ./build/bin/llama-server -hf dispatchAI/Qwen3-Embedding-0.6B-mobile --embeddings
How to use dispatchAI/Qwen3-Embedding-0.6B-mobile with Ollama:
ollama run hf.co/dispatchAI/Qwen3-Embedding-0.6B-mobile
How to use dispatchAI/Qwen3-Embedding-0.6B-mobile with Docker Model Runner:
docker model run hf.co/dispatchAI/Qwen3-Embedding-0.6B-mobile
How to use dispatchAI/Qwen3-Embedding-0.6B-mobile with Lemonade:
# Download Lemonade from https://lemonade-server.ai/ lemonade pull dispatchAI/Qwen3-Embedding-0.6B-mobile
lemonade run user.Qwen3-Embedding-0.6B-mobile-{{QUANT_TAG}}lemonade list
π Not Chat β This is not a chat model.
| Attribute | Value |
|---|---|
| Base Model | Qwen/Qwen3-Embedding-0.6B |
| Type | NOT_CHAT |
| License | apache-2.0 |
This model is designed for embeddings, not chat.
π dispatchAI
We're not able to determine the quantization variants.