237 lines
16 KiB
Markdown
237 lines
16 KiB
Markdown
---
|
||
base_model: facebook/MobileLLM-1.5B
|
||
extra_gated_button_content: Submit
|
||
extra_gated_fields:
|
||
Affiliation: text
|
||
? By clicking Submit below I accept the terms of the license and acknowledge that
|
||
the information I provide will be collected stored processed and shared in accordance
|
||
with the Meta Privacy Policy
|
||
: checkbox
|
||
Country: country
|
||
Date of birth: date_picker
|
||
First Name: text
|
||
Job title:
|
||
options:
|
||
- Student
|
||
- Research Graduate
|
||
- AI researcher
|
||
- AI developer/engineer
|
||
- Reporter
|
||
- Other
|
||
type: select
|
||
Last Name: text
|
||
geo: ip_location
|
||
extra_gated_heading: Please be sure to provide your full legal name, date of birth,
|
||
and full organization name with all corporate identifiers. Avoid the use of acronyms
|
||
and special characters. Failure to follow these instructions may prevent you from
|
||
accessing this model and others on Hugging Face. You will not have the ability to
|
||
edit this form after submission, so please ensure all information is accurate.
|
||
extra_gated_prompt: "FAIR Noncommercial Research License\nLast Updated: April 17,
|
||
2025\n\n“Acceptable Use Policy” means the FAIR Acceptable Use Policy, applicable
|
||
to Research Materials, that is incorporated into this Agreement.\n\n“Agreement”
|
||
means the terms and conditions for use, reproduction, distribution and modification
|
||
of the Research Materials set forth herein.\n\n\n“Documentation” means the specifications,
|
||
manuals and documentation accompanying \nResearch Materials distributed by Meta.\n\n\n“Licensee”
|
||
or “you” means you, or your employer or any other person or entity (if you are entering
|
||
into this Agreement on such person or entity’s behalf), of the age required under
|
||
applicable laws, rules or regulations to provide legal consent and that has legal
|
||
authority to bind your employer or such other person or entity if you are entering
|
||
in this Agreement on their behalf.\n\n\n“Meta” or “we” means Meta Platforms Ireland
|
||
Limited (if you are located in or, if you are an entity, your principal place of
|
||
business is in the EEA or Switzerland) and Meta Platforms, Inc. (if you are located
|
||
outside of the EEA or Switzerland).\n\n“Noncommercial Research Uses” means noncommercial
|
||
research use cases related to research, development, education, processing, or analysis
|
||
and in each case, is not primarily intended for commercial advantage or monetary
|
||
compensation to you or others.\n\n“Research Materials” means, collectively, Documentation
|
||
and the models, software and algorithms, including machine-learning model code,
|
||
trained model weights, inference-enabling code, training-enabling code, fine-tuning
|
||
enabling code, demonstration materials and other elements of the foregoing distributed
|
||
by Meta and made available under this Agreement.\n\nBy clicking “I Accept” below
|
||
or by using or distributing any portion or element of the Research Materials, you
|
||
agree to be bound by this Agreement.\n\n\n1. License Rights and Redistribution.\n\n\na.
|
||
Grant of Rights. You are granted a non-exclusive, worldwide, non-transferable and
|
||
royalty-free limited license under Meta’s intellectual property or other rights
|
||
owned by Meta embodied in the Research Materials to use, reproduce, distribute,
|
||
copy, create derivative works of, and make modifications to the Research Materials.
|
||
\ \n \nb. Redistribution and Use. \n i. You will not use the Research Materials
|
||
or any outputs or results of the Research Materials in connection with any commercial
|
||
uses or for any uses other than Noncommercial Research Uses;\n\n\nii. Distribution
|
||
of Research Materials, and any derivative works thereof, are subject to the terms
|
||
of this Agreement. If you distribute or make the Research Materials, or any derivative
|
||
works thereof, available to a third party, you may only do so under the terms of
|
||
this Agreement. You shall also provide a copy of this Agreement to such third party.\n\n\niii.
|
||
\ If you submit for publication the results of research you perform on, using, or
|
||
otherwise in connection with Research Materials, you must acknowledge the use of
|
||
Research Materials in your publication.\n\n\niv. Your use of the Research Materials
|
||
must comply with applicable laws and regulations (including Trade Control Laws)
|
||
and adhere to the FAIR Acceptable Use Policy, which is hereby incorporated by reference
|
||
into this Agreement.\n2. User Support. Your Noncommercial Research Use of the Research
|
||
Materials is done at your own discretion; Meta does not process any information
|
||
nor provide any service in relation to such use. Meta is under no obligation to
|
||
provide any support services for the Research Materials. Any support provided is
|
||
“as is”, “with all faults”, and without warranty of any kind.\n\n\n3. Disclaimer
|
||
of Warranty. UNLESS REQUIRED BY APPLICABLE LAW, THE RESEARCH MATERIALS AND ANY OUTPUT
|
||
AND RESULTS THEREFROM ARE PROVIDED ON AN “AS IS” BASIS, WITHOUT WARRANTIES OF ANY
|
||
KIND, AND META DISCLAIMS ALL WARRANTIES OF ANY KIND, BOTH EXPRESS AND IMPLIED, INCLUDING,
|
||
WITHOUT LIMITATION, ANY WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY,
|
||
OR FITNESS FOR A PARTICULAR PURPOSE. YOU ARE SOLELY RESPONSIBLE FOR DETERMINING
|
||
THE APPROPRIATENESS OF USING OR REDISTRIBUTING THE RESEARCH MATERIALS AND ASSUME
|
||
ANY RISKS ASSOCIATED WITH YOUR USE OF THE RESEARCH MATERIALS AND ANY OUTPUT AND
|
||
RESULTS.\n \n4. Limitation of Liability. IN NO EVENT WILL META OR ITS AFFILIATES
|
||
BE LIABLE UNDER ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, TORT, NEGLIGENCE,
|
||
PRODUCTS LIABILITY, OR OTHERWISE, ARISING OUT OF THIS AGREEMENT, FOR ANY LOST PROFITS
|
||
OR ANY DIRECT OR INDIRECT, SPECIAL, CONSEQUENTIAL, INCIDENTAL, EXEMPLARY OR PUNITIVE
|
||
DAMAGES, EVEN IF META OR ITS AFFILIATES HAVE BEEN ADVISED OF THE POSSIBILITY OF
|
||
ANY OF THE FOREGOING.\n \n5. Intellectual Property.\n\n\na. Subject to Meta’s ownership
|
||
of Research Materials and derivatives made by or for Meta, with respect to any derivative
|
||
works and modifications of the Research Materials that are made by you, as between
|
||
you and Meta, you are and will be the owner of such derivative works and modifications.\n
|
||
\nb. If you institute litigation or other proceedings against Meta or any entity
|
||
(including a cross-claim or counterclaim in a lawsuit) alleging that the Research
|
||
Materials, outputs or results, or any portion of any of the foregoing, constitutes
|
||
infringement of intellectual property or other rights owned or licensable by you,
|
||
then any licenses granted to you under this Agreement shall terminate as of the
|
||
date such litigation or claim is filed or instituted. You will indemnify and hold
|
||
harmless Meta from and against any claim by any third party arising out of or related
|
||
to your use or distribution of the Research Materials.\n \n6. Term and Termination.
|
||
The term of this Agreement will commence upon your acceptance of this Agreement
|
||
or access to the Research Materials and will continue in full force and effect until
|
||
terminated in accordance with the terms and conditions herein. Meta may terminate
|
||
this Agreement if you are in breach of any term or condition of this Agreement.
|
||
Upon termination of this Agreement, you shall delete and cease use of the Research
|
||
Materials. Sections 5, 6 and 9 shall survive the termination of this Agreement.
|
||
\n \n7. Governing Law and Jurisdiction. This Agreement will be governed and construed
|
||
under the laws of the State of California without regard to choice of law principles,
|
||
and the UN Convention on Contracts for the International Sale of Goods does not
|
||
apply to this Agreement. The courts of California shall have exclusive jurisdiction
|
||
of any dispute arising out of this Agreement. \n\n\n8. Modifications and Amendments.
|
||
Meta may modify this Agreement from time to time by posting a revised version at
|
||
[https://huggingface.co/facebook/Perception-LM-8B/blob/main/LICENSE]; provided that
|
||
they are similar in spirit to the current version of the Agreement, but may differ
|
||
in detail to address new problems or concerns. All such changes will be effective
|
||
immediately. Your continued use of the Research Materials after any modification
|
||
to this Agreement constitutes your agreement to such modification. Except as provided
|
||
in this Agreement, no modification or addition to any provision of this Agreement
|
||
will be binding unless it is in writing and signed by an authorized representative
|
||
of both you and Meta.\n\n\nFAIR Acceptable Use Policy \n\nThe Fundamental AI Research
|
||
(FAIR) team at Meta seeks to further understanding of new and existing research
|
||
domains with the mission of advancing the state-of-the-art in artificial intelligence
|
||
through open research for the benefit of all. \n\nAs part of this mission, Meta
|
||
makes certain research materials available for noncommercial research use. Meta
|
||
is committed to promoting the safe and responsible use of such research materials.
|
||
\ \n\nProhibited Uses\n\nYou agree you will not use, or allow others to use, Research
|
||
Materials to:\n\n Violate the law or others’ rights, including to:\nEngage in, promote,
|
||
generate, contribute to, encourage, plan, incite, or further illegal or unlawful
|
||
activity or content, such as:\nViolence or terrorism\nExploitation or harm to children,
|
||
including the solicitation, creation, acquisition, or dissemination of child exploitative
|
||
content or failure to report Child Sexual Abuse Material\nHuman trafficking, exploitation,
|
||
and sexual violence\nThe illegal distribution of information or materials to minors,
|
||
including obscene materials, or failure to employ legally required age-gating in
|
||
connection with such information or materials.\nSexual solicitation\nAny other criminal
|
||
activity\n\nEngage in, promote, incite, or facilitate the harassment, abuse, threatening,
|
||
or bullying of individuals or groups of individuals\n\nEngage in, promote, incite,
|
||
or facilitate discrimination or other unlawful or harmful conduct in the provision
|
||
of employment, employment benefits, credit, housing, other economic benefits, or
|
||
other essential goods and services\n\nEngage in the unauthorized or unlicensed practice
|
||
of any profession including, but not limited to, financial, legal, medical/health,
|
||
or related professional practices\n\nCollect, process, disclose, generate, or infer
|
||
health, demographic, or other sensitive personal or private information about individuals
|
||
without rights and consents required by applicable laws\n\nEngage in or facilitate
|
||
any action or generate any content that infringes, misappropriates, or otherwise
|
||
violates any third-party rights, including the outputs or results of any technology
|
||
using FAIR research materials\n\nCreate, generate, or facilitate the creation of
|
||
malicious code, malware, computer viruses or do anything else that could disable,
|
||
overburden, interfere with or impair the proper working, integrity, operation or
|
||
appearance of a website or computer system\n\n2. Engage in, promote, incite, facilitate,
|
||
or assist in the planning or development of activities that present a risk of death
|
||
or bodily harm to individuals, including use of research artifacts related to the
|
||
following:\n\nMilitary, warfare, nuclear industries or applications, espionage,
|
||
use for materials or activities that are subject to the International Traffic Arms
|
||
Regulations (ITAR) maintained by the United States Department of State\n\nGuns and
|
||
illegal weapons (including weapon development)\n\nIllegal drugs and regulated/controlled
|
||
substances\n\nOperation of critical infrastructure, transportation technologies,
|
||
or heavy machinery\n\nSelf-harm or harm to others, including suicide, cutting, and
|
||
eating disorders\n\nAny content intended to incite or promote violence, abuse, or
|
||
any infliction of bodily harm to an individual\n\n3. Intentionally deceive or mislead
|
||
others, including use of FAIR Research Materials related to the following:\n\n Generating,
|
||
promoting, or furthering fraud or the creation or promotion of disinformation\n\n
|
||
Generating, promoting, or furthering defamatory content, including the creation
|
||
of defamatory statements, images, or other content\n\nGenerating, promoting, or
|
||
further distributing spam\n\n Impersonating another individual without consent,
|
||
authorization, or legal right\n\nRepresenting that outputs of FAIR research materials
|
||
or outputs from technology using FAIR research materials are human-generated\n\nGenerating
|
||
or facilitating false online engagement, including fake reviews and other means
|
||
of fake online engagement\n\n4. Fail to appropriately disclose to end users any
|
||
known dangers of your Research Materials.\n\nPlease report any violation of this
|
||
Policy or other problems that could lead to a violation of this Policy by submitting
|
||
a report here [https://docs.google.com/forms/d/e/1FAIpQLSeb11cryAopJ7LNrC4nxEUXrHY26hfkXQMf_uH-oFgA3WlYZQ/viewform].
|
||
\n"
|
||
language:
|
||
- en
|
||
library_name: transformers
|
||
license: other
|
||
license_name: fair-noncommercial-research
|
||
quantized_by: mradermacher
|
||
tags:
|
||
- facebook
|
||
- meta
|
||
- pytorch
|
||
- mobilellm
|
||
---
|
||
## About
|
||
|
||
<!-- ### quantize_version: 2 -->
|
||
<!-- ### output_tensor_quantised: 1 -->
|
||
<!-- ### convert_type: hf -->
|
||
<!-- ### vocab_type: -->
|
||
<!-- ### tags: -->
|
||
static quants of https://huggingface.co/facebook/MobileLLM-1.5B
|
||
|
||
<!-- provided-files -->
|
||
weighted/imatrix quants are available at https://huggingface.co/mradermacher/MobileLLM-1.5B-i1-GGUF
|
||
## Usage
|
||
|
||
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
||
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
||
more details, including on how to concatenate multi-part files.
|
||
|
||
## Provided Quants
|
||
|
||
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
||
|
||
| Link | Type | Size/GB | Notes |
|
||
|:-----|:-----|--------:|:------|
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_S.gguf) | Q3_K_S | 1.0 | |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q2_K.gguf) | Q2_K | 1.0 | |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.IQ4_XS.gguf) | IQ4_XS | 1.0 | |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_M.gguf) | Q3_K_M | 1.0 | lower quality |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q3_K_L.gguf) | Q3_K_L | 1.1 | |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q4_K_S.gguf) | Q4_K_S | 1.2 | fast, recommended |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q4_K_M.gguf) | Q4_K_M | 1.2 | fast, recommended |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q5_K_S.gguf) | Q5_K_S | 1.3 | |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q5_K_M.gguf) | Q5_K_M | 1.3 | |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q6_K.gguf) | Q6_K | 1.7 | very good quality |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.Q8_0.gguf) | Q8_0 | 1.8 | fast, best quality |
|
||
| [GGUF](https://huggingface.co/mradermacher/MobileLLM-1.5B-GGUF/resolve/main/MobileLLM-1.5B.f16.gguf) | f16 | 3.2 | 16 bpw, overkill |
|
||
|
||
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
||
types (lower is better):
|
||
|
||
|
||
|
||
And here are Artefact2's thoughts on the matter:
|
||
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
||
|
||
## FAQ / Model Request
|
||
|
||
See https://huggingface.co/mradermacher/model_requests for some answers to
|
||
questions you might have and/or if you want some other model quantized.
|
||
|
||
## Thanks
|
||
|
||
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
||
me use its servers and providing upgrades to my workstation to enable
|
||
this work in my free time.
|
||
|
||
<!-- end -->
|