Text Generation
MLX
Safetensors
PyTorch
English
llama4_text
facebook
meta
mobilellm
conversational
4-bit precision
Instructions to use samairtimer/MobileLLM-R1-360M-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use samairtimer/MobileLLM-R1-360M-4bit with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("samairtimer/MobileLLM-R1-360M-4bit") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use samairtimer/MobileLLM-R1-360M-4bit with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "samairtimer/MobileLLM-R1-360M-4bit"
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "samairtimer/MobileLLM-R1-360M-4bit" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Hermes Agent new
How to use samairtimer/MobileLLM-R1-360M-4bit with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "samairtimer/MobileLLM-R1-360M-4bit"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default samairtimer/MobileLLM-R1-360M-4bit
Run Hermes
hermes
- OpenClaw new
How to use samairtimer/MobileLLM-R1-360M-4bit with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "samairtimer/MobileLLM-R1-360M-4bit"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "samairtimer/MobileLLM-R1-360M-4bit" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
- MLX LM
How to use samairtimer/MobileLLM-R1-360M-4bit with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "samairtimer/MobileLLM-R1-360M-4bit"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "samairtimer/MobileLLM-R1-360M-4bit" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "samairtimer/MobileLLM-R1-360M-4bit", "messages": [ {"role": "user", "content": "Hello"} ] }'
| license: other | |
| license_name: fair-noncommercial-research | |
| extra_gated_prompt: "FAIR Noncommercial Research License v1 Last Updated: August 18,\ | |
| \ 2025\n“Acceptable Use Policy” means the FAIR Acceptable Use Policy, applicable\ | |
| \ to Research Materials, that is incorporated into this Agreement.\n“Agreement”\ | |
| \ means the terms and conditions for use, reproduction, distribution and modification\ | |
| \ of the Research Materials set forth herein.\n\n“Documentation” means the specifications,\ | |
| \ manuals and documentation accompanying Research Materials distributed by Meta.\n\ | |
| \n“Licensee” or “you” means you, or your employer or any other person or entity\ | |
| \ (if you are entering into this Agreement on such person or entity’s behalf), of\ | |
| \ the age required under applicable laws, rules or regulations to provide legal\ | |
| \ consent and that has legal authority to bind your employer or such other person\ | |
| \ or entity if you are entering in this Agreement on their behalf.\n\n“Meta” or\ | |
| \ “we” means Meta Platforms Ireland Limited (if you are located in or, if you are\ | |
| \ an entity, your principal place of business is in the EEA or Switzerland) and\ | |
| \ Meta Platforms, Inc. (if you are located outside of the EEA or Switzerland).\n\ | |
| “Noncommercial Research Uses” means noncommercial research use cases related to\ | |
| \ research, development, education, processing, or analysis and in each case, is\ | |
| \ not primarily intended for commercial advantage or monetary compensation to you\ | |
| \ or others.\n“Research Materials” means, collectively, Documentation and the models,\ | |
| \ software and algorithms, including machine-learning model code, trained model\ | |
| \ weights, inference-enabling code, training-enabling code, fine-tuning enabling\ | |
| \ code, demonstration materials and other elements of the foregoing distributed\ | |
| \ by Meta and made available under this Agreement.\nBy clicking “I Accept” below\ | |
| \ or by using or distributing any portion or element of the Research Materials,\ | |
| \ you agree to be bound by this Agreement.\n\n1. License Rights and Redistribution.\n\ | |
| \na. Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable\ | |
| \ and royalty-free limited license under Meta’s intellectual property or other rights\ | |
| \ owned by Meta embodied in the Research Materials to use, reproduce, distribute,\ | |
| \ copy, create derivative works of, and make modifications to the Research Materials.\ | |
| \ \nb. Redistribution and Use. i. You will not use the Research Materials or\ | |
| \ any outputs or results of the Research Materials in connection with any commercial\ | |
| \ uses or for any uses other than Noncommercial Research Uses;\n\nii. Distribution\ | |
| \ of Research Materials, and any derivative works thereof, are subject to the terms\ | |
| \ of this Agreement. If you distribute or make the Research Materials, or any derivative\ | |
| \ works thereof, available to a third party, you may only do so under the terms\ | |
| \ of this Agreement. You shall also provide a copy of this Agreement to such third\ | |
| \ party.\n\niii. If you submit for publication the results of research you perform\ | |
| \ on, using, or otherwise in connection with Research Materials, you must acknowledge\ | |
| \ the use of Research Materials in your publication.\n\niv. Your use of the Research\ | |
| \ Materials must comply with applicable laws and regulations (including Trade Control\ | |
| \ Laws) and adhere to the FAIR Acceptable Use Policy, which is hereby incorporated\ | |
| \ by reference into this Agreement. 2. User Support. Your Noncommercial Research\ | |
| \ Use of the Research Materials is done at your own discretion; Meta does not process\ | |
| \ any information nor provide any service in relation to such use. Meta is under\ | |
| \ no obligation to provide any support services for the Research Materials. Any\ | |
| \ support provided is “as is”, “with all faults”, and without warranty of any kind.\n\ | |
| \n3. Disclaimer of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE RESEARCH MATERIALS\ | |
| \ AND ANY OUTPUT AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” BASIS, WITHOUT\ | |
| \ WARRANTIES OF ANY KIND, AND META DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS\ | |
| \ AND IMPLIED, INCLUDING, WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT,\ | |
| \ MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE\ | |
| \ FOR DETERMINING THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE RESEARCH MATERIALS\ | |
| \ AND ASSUME ANY RISKS ASSOCIATED WITH YOUR USE OF THE RESEARCH MATERIALS AND ANY\ | |
| \ OUTPUT AND RESULTS.\n4. Limitation of Liability. IN NO EVENT WILL META OR ITS\ | |
| \ AFFILIATES BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT,\ | |
| \ NEGLIGENCE, PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR\ | |
| \ ANY LOST PROFITS OR ANY DIRECT OR INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL,\ | |
| \ EXEMPLARY OR PUNITIVE DAMAGES, EVEN IF META OR ITS AFFILIATES HAVE BEEN ADVISED\ | |
| \ OF THE POSSIBILITY OF ANY OF THE FOREGOING.\n5. Intellectual Property.\n\na. Subject\ | |
| \ to Meta’s ownership of Research Materials and derivatives made by or for Meta,\ | |
| \ with respect to any derivative works and modifications of the Research Materials\ | |
| \ that are made by you, as between you and Meta, you are and will be the owner of\ | |
| \ such derivative works and modifications.\nb. If you institute litigation or other\ | |
| \ proceedings against Meta or any entity (including a cross-claim or counterclaim\ | |
| \ in a lawsuit) alleging that the Research Materials, outputs or results, or any\ | |
| \ portion of any of the foregoing, constitutes infringement of intellectual property\ | |
| \ or other rights owned or licensable by you, then any licenses granted to you under\ | |
| \ this Agreement shall terminate as of the date such litigation or claim is filed\ | |
| \ or instituted. You will indemnify and hold harmless Meta from and against any\ | |
| \ claim by any third party arising out of or related to your use or distribution\ | |
| \ of the Research Materials.\n6. Term and Termination. The term of this Agreement\ | |
| \ will commence upon your acceptance of this Agreement or access to the Research\ | |
| \ Materials and will continue in full force and effect until terminated in accordance\ | |
| \ with the terms and conditions herein. Meta may terminate this Agreement if you\ | |
| \ are in breach of any term or condition of this Agreement. Upon termination of\ | |
| \ this Agreement, you shall delete and cease use of the Research Materials. Sections\ | |
| \ 3, 4 and 7 shall survive the termination of this Agreement. \n7. Governing Law\ | |
| \ and Jurisdiction. This Agreement will be governed and construed under the laws\ | |
| \ of the State of California without regard to choice of law principles, and the\ | |
| \ UN Convention on Contracts for the International Sale of Goods does not apply\ | |
| \ to this Agreement. The courts of California shall have exclusive jurisdiction\ | |
| \ of any dispute arising out of this Agreement. \n\n8. Modifications and Amendments.\ | |
| \ Meta may modify this Agreement from time to time; provided that they are similar\ | |
| \ in spirit to the current version of the Agreement, but may differ in detail to\ | |
| \ address new problems or concerns. All such changes will be effective immediately.\ | |
| \ Your continued use of the Research Materials after any modification to this Agreement\ | |
| \ constitutes your agreement to such modification. Except as provided in this Agreement,\ | |
| \ no modification or addition to any provision of this Agreement will be binding\ | |
| \ unless it is in writing and signed by an authorized representative of both you\ | |
| \ and Meta.\n\nFAIR Acceptable Use Policy \nThe Fundamental AI Research (FAIR) team\ | |
| \ at Meta seeks to further understanding of new and existing research domains with\ | |
| \ the mission of advancing the state-of-the-art in artificial intelligence through\ | |
| \ open research for the benefit of all. \nAs part of this mission, Meta makes certain\ | |
| \ research materials available for noncommercial research use. Meta is committed\ | |
| \ to promoting the safe and responsible use of such research materials. \nProhibited\ | |
| \ Uses\nYou agree you will not use, or allow others to use, Research Materials to:\n\ | |
| Violate the law or others’ rights, including to: Engage in, promote, generate, contribute\ | |
| \ to, encourage, plan, incite, or further illegal or unlawful activity or content,\ | |
| \ such as: Violence or terrorism Exploitation or harm to children, including the\ | |
| \ solicitation, creation, acquisition, or dissemination of child exploitative content\ | |
| \ or failure to report Child Sexual Abuse Material Human trafficking, exploitation,\ | |
| \ and sexual violence The illegal distribution of information or materials to minors,\ | |
| \ including obscene materials, or failure to employ legally required age-gating\ | |
| \ in connection with such information or materials. Sexual solicitation Any other\ | |
| \ criminal activity\nEngage in, promote, incite, or facilitate the harassment, abuse,\ | |
| \ threatening, or bullying of individuals or groups of individuals\nEngage in, promote,\ | |
| \ incite, or facilitate discrimination or other unlawful or harmful conduct in the\ | |
| \ provision of employment, employment benefits, credit, housing, other economic\ | |
| \ benefits, or other essential goods and services\nEngage in the unauthorized or\ | |
| \ unlicensed practice of any profession including, but not limited to, financial,\ | |
| \ legal, medical/health, or related professional practices\nCollect, process, disclose,\ | |
| \ generate, or infer health, demographic, or other sensitive personal or private\ | |
| \ information about individuals without rights and consents required by applicable\ | |
| \ laws\nEngage in or facilitate any action or generate any content that infringes,\ | |
| \ misappropriates, or otherwise violates any third-party rights, including the outputs\ | |
| \ or results of any technology using FAIR research materials\nCreate, generate,\ | |
| \ or facilitate the creation of malicious code, malware, computer viruses or do\ | |
| \ anything else that could disable, overburden, interfere with or impair the proper\ | |
| \ working, integrity, operation or appearance of a website or computer system\n\ | |
| 2. Engage in, promote, incite, facilitate, or assist in the planning or development\ | |
| \ of activities that present a risk of death or bodily harm to individuals, including\ | |
| \ use of research artifacts related to the following:\nMilitary, warfare, nuclear\ | |
| \ industries or applications, espionage, use for materials or activities that are\ | |
| \ subject to the International Traffic Arms Regulations (ITAR) maintained by the\ | |
| \ United States Department of State\nGuns and illegal weapons (including weapon\ | |
| \ development)\nIllegal drugs and regulated/controlled substances\nOperation of\ | |
| \ critical infrastructure, transportation technologies, or heavy machinery\nSelf-harm\ | |
| \ or harm to others, including suicide, cutting, and eating disorders\nAny content\ | |
| \ intended to incite or promote violence, abuse, or any infliction of bodily harm\ | |
| \ to an individual\n3. Intentionally deceive or mislead others, including use of\ | |
| \ FAIR Research Materials related to the following:\nGenerating, promoting, or furthering\ | |
| \ fraud or the creation or promotion of disinformation\nGenerating, promoting, or\ | |
| \ furthering defamatory content, including the creation of defamatory statements,\ | |
| \ images, or other content\nGenerating, promoting, or further distributing spam\n\ | |
| Impersonating another individual without consent, authorization, or legal right\n\ | |
| Representing that outputs of FAIR research materials or outputs from technology\ | |
| \ using FAIR research materials are human-generated\nGenerating or facilitating\ | |
| \ false online engagement, including fake reviews and other means of fake online\ | |
| \ engagement\n4. Fail to appropriately disclose to end users any known dangers of\ | |
| \ your Research Materials.\nPlease report any violation of this Policy or other\ | |
| \ problems that could lead to a violation of this Policy by submitting a report\ | |
| \ here [https://docs.google.com/forms/d/e/1FAIpQLSeb11cryAopJ7LNrC4nxEUXrHY26hfkXQMf_uH-oFgA3WlYZQ/viewform].\ | |
| \ \n" | |
| extra_gated_fields: | |
| First Name: text | |
| Last Name: text | |
| Date of birth: date_picker | |
| Country: country | |
| Affiliation: text | |
| Job title: | |
| type: select | |
| options: | |
| - Student | |
| - Research Graduate | |
| - AI researcher | |
| - AI developer/engineer | |
| - Reporter | |
| - Other | |
| geo: ip_location | |
| ? By clicking Submit below I accept the terms of the license and acknowledge that | |
| the information I provide will be collected stored processed and shared in accordance | |
| with the Meta Privacy Policy | |
| : checkbox | |
| extra_gated_description: The information you provide will be collected, stored, processed | |
| and shared in accordance with the [Meta Privacy Policy](https://www.facebook.com/privacy/policy/). | |
| extra_gated_button_content: Submit | |
| extra_gated_heading: Please be sure to provide your full legal name, date of birth, | |
| and full organization name with all corporate identifiers. Avoid the use of acronyms | |
| and special characters. Failure to follow these instructions may prevent you from | |
| accessing this model and others on Hugging Face. You will not have the ability to | |
| edit this form after submission, so please ensure all information is accurate. | |
| language: | |
| - en | |
| library_name: mlx | |
| tags: | |
| - meta | |
| - pytorch | |
| - mobilellm | |
| - mlx | |
| base_model: facebook/MobileLLM-R1-360M | |
| pipeline_tag: text-generation | |
| # samairtimer/MobileLLM-R1-360M-4bit | |
| This model [samairtimer/MobileLLM-R1-360M-4bit](https://huggingface.co/samairtimer/MobileLLM-R1-360M-4bit) was | |
| converted to MLX format from [facebook/MobileLLM-R1-360M](https://huggingface.co/facebook/MobileLLM-R1-360M) | |
| using mlx-lm version **0.27.1**. | |
| ## Use with mlx | |
| ```bash | |
| pip install mlx-lm | |
| ``` | |
| ```python | |
| from mlx_lm import load, generate | |
| model, tokenizer = load("samairtimer/MobileLLM-R1-360M-4bit") | |
| prompt = "hello" | |
| if tokenizer.chat_template is not None: | |
| messages = [{"role": "user", "content": prompt}] | |
| prompt = tokenizer.apply_chat_template( | |
| messages, add_generation_prompt=True | |
| ) | |
| response = generate(model, tokenizer, prompt=prompt, verbose=True) | |
| ``` | |