初始化项目，由ModelHub XC社区提供模型

Model: QuantFactory/emma-500-llama2-7b-GGUF
Source: Original Platform

.gitattributes

@@ -0,0 +1,49 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
+emma-500-llama2-7b.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,95 @@
+
+---
+
+license: llama2
+datasets:
+- MaLA-LM/mala-monolingual-split
+base_model:
+- meta-llama/Llama-2-7b-hf
+library_name: transformers
+
+---
+
+[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
+
+
+# QuantFactory/emma-500-llama2-7b-GGUF
+This is quantized version of [MaLA-LM/emma-500-llama2-7b](https://huggingface.co/MaLA-LM/emma-500-llama2-7b) created using llama.cpp
+
+# Original Model Card
+
+
+# EMMA-500: Enhancing Massively Multilingual Adaptation of Large Language Models
+
+## Model Description
+
+**EMMA-500** is a state-of-the-art multilingual language model designed to improve language representation, especially in low-resource languages, through continual pre-training on the **Llama 2 7B** architecture. Leveraging the **MaLA Corpus**, which spans over 500 languages and 74 billion tokens, EMMA-500 excels in multilingual tasks like commonsense reasoning, machine translation, open-ended generation, and text classification.
+
+**EMMA-500** outperforms other Llama 2-based models in diverse multilingual settings while maintaining robustness in specialized tasks.
+
+---
+
+## Model Details
+
+- **Architecture**: Built on Llama 2 7B with enhanced language adaptation through continual pre-training.
+- **Languages**: Supports **546 languages** with substantial training data (over 100k tokens each).
+- **Data Mix**: A diverse mix of text from domains like code, books, instruction data, and more.
+- **Key Tasks**: Commonsense reasoning, machine translation, text classification, natural language inference, code generation, and open-ended generation.
+
+### Data Access
+- [MaLA Corpus](https://huggingface.co/collections/MaLA-LM/mala-corpus-66e05127641a51de34d39529)
+- [PolyWrite Benchmark](https://huggingface.co/datasets/MaLA-LM/PolyWrite)
+
+---
+
+## Usage
+
+You can use **EMMA-500** for multilingual text generation. Below is an example to generate text using the model:
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model_name = "MaLA-LM/emma-500-llama2-7b"
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModelForCausalLM.from_pretrained(model_name)
+
+input_text = "Once upon a time"
+inputs = tokenizer(input_text, return_tensors="pt")
+outputs = model.generate(**inputs)
+
+print(tokenizer.decode(outputs[0], skip_special_tokens=True))
+```
+
+---
+
+## Model Performance
+
+**EMMA-500** was evaluated across multiple benchmarks and tasks, demonstrating:
+
+- **Lowest negative log-likelihood** in intrinsic evaluations.
+- Significant improvements in **commonsense reasoning**, **machine translation**, and **open-ended generation**.
+- **Outperformed** all Llama 2-based models in **text classification** and **natural language inference**.
+- Enhanced performance in **code generation** and **machine reading comprehension (MRC)**.
+
+Challenges remain in low-resource languages, where the model tends to have higher **Self-BLEU** scores, indicating reduced output diversity.
+
+---
+
+
+## Citation
+
+```
+@article{ji2024emma500enhancingmassivelymultilingual,
+      title={{EMMA}-500: Enhancing Massively Multilingual Adaptation of Large Language Models}, 
+      author={Shaoxiong Ji and Zihao Li and Indraneil Paul and Jaakko Paavola and Peiqin Lin and Pinzhen Chen and Dayyán O'Brien and Hengyu Luo and Hinrich Schütze and Jörg Tiedemann and Barry Haddow},
+      year={2024},
+      journal={arXiv preprint 2409.17892},
+      url={https://arxiv.org/abs/2409.17892}, 
+}
+```
+
+## Acknowledgements
+
+We extend our thanks to the language communities and contributors who helped source, clean, and validate the diverse data used in the MaLA Corpus. Their efforts are invaluable in supporting linguistic diversity in AI research.
+
+This work is done by researchers at [Helsinki-NLP](https://huggingface.co/Helsinki-NLP) in collaboration with partners from TU Darmstadt, the University of Edinburgh, and LMU Munich. It is funded by [HPLT](https://hplt-project.org) and [UTTER](https://he-utter.eu).

configuration.json

@@ -0,0 +1 @@
+{"framework": "pytorch", "task": "others", "allow_remote": true}

emma-500-llama2-7b.Q2_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:3988d2e113692dc66935f9c975a601d91321998532aab5c8f56d81c3019906d2
+size 2532864320

emma-500-llama2-7b.Q3_K_L.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:da85687e58ed4b1f2f601a043f133f794205e8e135b3b51dbddb0f12243ea95f
+size 3597111616

emma-500-llama2-7b.Q3_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1c9a4b817b542249d3e9e836f1b1c546ce645278fadbfbfed39b909d8e49de5c
+size 3298005312

emma-500-llama2-7b.Q3_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:db3cb50665a5bc0a56624bb48ab4aae713fc3e767e57fd07de59bbe67c9fc880
+size 2948305216

emma-500-llama2-7b.Q4_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:eb57f52381bec496fc6dfe0f7f75bb85f9fa79aaa0c23d0cc3711bb7b97675c4
+size 3825807680

emma-500-llama2-7b.Q4_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9c460e4143d4617ff33bb11385105813a8f5c0256c9dfb1cf9e05d9ac1c588a
+size 4238750016

emma-500-llama2-7b.Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ed7667142da8400377c3166562ae47e89069e04a038abf3d6cd9f304d7b599af
+size 4081004864

emma-500-llama2-7b.Q4_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e42cd21d907b6a369c68268ee8aa968a664d34e8d92f07534cb87e52b9281a6
+size 3856740672

emma-500-llama2-7b.Q5_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:06a35ca365744761327b75872edd29d2bbfb6ea53c721816636579c138949055
+size 4651692352

emma-500-llama2-7b.Q5_1.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2002b6b5ee28eac7353b89ec366e67c93c383146bb2e766bfe65d04f8b1de0aa
+size 5064634688

emma-500-llama2-7b.Q5_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4542cdf03bd4a78f94228493bb27ab9fd4af4303239101da1dc6895ccc6294ee
+size 4783157568

emma-500-llama2-7b.Q5_K_S.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1892ce19495ee697e9ba38ff1cc5008814a079636e4d15ce429f138a9e033df8
+size 4651692352

emma-500-llama2-7b.Q6_K.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4c56792bef9ddadf724c15a17a592c5bd099cd9604a0527323f192f322245962
+size 5529194816

emma-500-llama2-7b.Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b1439d45303643c1b194e498a3783910eec08247cb4aa6a0c081c1f5ea0ade4
+size 7161090368