Instructions to use bencodez/Cipheron with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use bencodez/Cipheron with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf bencodez/Cipheron:Q4_K_M # Run inference directly in the terminal: llama cli -hf bencodez/Cipheron:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf bencodez/Cipheron:Q4_K_M # Run inference directly in the terminal: llama cli -hf bencodez/Cipheron:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf bencodez/Cipheron:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf bencodez/Cipheron:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf bencodez/Cipheron:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf bencodez/Cipheron:Q4_K_M
Use Docker
docker model run hf.co/bencodez/Cipheron:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use bencodez/Cipheron with Ollama:
ollama run hf.co/bencodez/Cipheron:Q4_K_M
- Unsloth Desktop
- Pi
How to use bencodez/Cipheron with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf bencodez/Cipheron:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "bencodez/Cipheron:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use bencodez/Cipheron with Docker Model Runner:
docker model run hf.co/bencodez/Cipheron:Q4_K_M
- Lemonade
How to use bencodez/Cipheron with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull bencodez/Cipheron:Q4_K_M
Run and chat with the model
lemonade run user.Cipheron-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use bencodez/Cipheron with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf bencodez/Cipheron:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default bencodez/Cipheron:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use bencodez/Cipheron with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf bencodez/Cipheron:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "bencodez/Cipheron:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
File size: 3,658 Bytes
df9799e 28c784c 6236247 28c784c 6236247 28c784c 6236247 28c784c df9799e 28c784c 6236247 28c784c 6236247 28c784c df9799e 6236247 28c784c 6236247 28c784c 6236247 28c784c df9799e 6236247 df9799e 6236247 28c784c 6236247 df9799e 28c784c 6236247 df9799e 6236247 df9799e 6236247 df9799e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 | \---
## license: apache-2.0
# Cipheron
**Cipheron** is a lightweight coding model designed for **secure code review**.
It analyzes source code for common security vulnerabilities and attempts to explain the issue and provide a safer implementation.
## What Cipheron Is Good At
Cipheron performs particularly well on:
* **SQL injection** — identifies unsafe query construction and recommends parameterized queries.
* **Command injection** — identifies unsafe shell command construction and recommends safer subprocess-based approaches.
These vulnerability classes are strongly represented in its evaluation data.
## Known Limitations
Cipheron has limited reliability across many security vulnerability categories.
In testing, it struggled with:
* Path traversal
* Hardcoded secrets and API keys
* Weak password hashing
* Insecure deserialization
* Reflected XSS
* Complex multi-step security vulnerabilities
For these cases, the model may produce changes that appear security-related but do not actually eliminate the underlying vulnerability.
**Do not rely on Cipheron as a replacement for professional security review, static analysis, penetration testing, or a larger security-focused model.**
Cipheron is best considered a lightweight, experimental tool for first-pass security analysis and secure-coding experimentation.
## Usage
```python
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch
model_id = "bencodez/Cipheron"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
model_id,
torch_dtype=torch.bfloat16
)
messages = [
{
"role": "system",
"content": (
"You are a secure coding assistant. "
"Review code for security vulnerabilities "
"and provide fixed, secure versions."
)
},
{
"role": "user",
"content": """Review this code for security issues and fix it:
def get_user(username):
query = "SELECT * FROM users WHERE username = '" + username + "'"
return db.execute(query)"""
}
]
input_ids = tokenizer.apply_chat_template(
messages,
add_generation_prompt=True,
return_tensors="pt"
)
with torch.no_grad():
output = model.generate(
input_ids,
max_new_tokens=250
)
response = tokenizer.decode(
output[0][input_ids.shape[1]:],
skip_special_tokens=True
)
print(response)
```
## Local Inference
A quantized `Cipheron-Q8_0.gguf` version is available for lightweight local inference.
Cipheron can be used with compatible local inference runtimes for CPU and other supported devices.
## Intended Use
Cipheron is intended for:
* Secure-coding education
* Security experimentation
* Offline code analysis
* Vulnerability-detection research
* Lightweight local development workflows
## Model Information
| Property | Value |
| -------------- | ---------------------------------- |
| Model | Cipheron |
| Parameters | 0.5B |
| Architecture | Causal language model |
| Primary domain | Secure coding |
| Input | Source code and security questions |
| Output | Security analysis and safer code |
| License | Apache 2.0 |
## Disclaimer
Cipheron is an experimental security-oriented coding model.
Security output should always be independently verified before being used in production systems. A model-generated fix does not guarantee that a vulnerability has been completely eliminated.
## License
Apache 2.0
|