QuantFactory/ELYZA-japanese-Llama-2-7b-instruct-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: QuantFactory/ELYZA-japanese-Llama-2-7b-instruct-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-07 15:17:14 +08:00
commit b6fb4b951b
20 changed files with 230 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

52
.gitattributes vendored Normal file
View File

@@ -0,0 +1,52 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q4_0_4_4.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q4_0_4_8.gguf filter=lfs diff=lfs merge=lfs -text
ELYZA-japanese-Llama-2-7b-instruct.Q4_0_8_8.gguf filter=lfs diff=lfs merge=lfs -text

3
ELYZA-japanese-Llama-2-7b-instruct.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:19cbc1be2211f99e5c2254fc38de832ffd9fa667824b3d1f4223c7d36e3940e0
size 2532864160

3
ELYZA-japanese-Llama-2-7b-instruct.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:089211208633a4adce8dd164be1780d3e434ef16ce9dfd336507cd191e69e743
size 3597111456

3
ELYZA-japanese-Llama-2-7b-instruct.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d9b9d2538cde5526489886bae288fcfbc2463e01abb446dc9cfbc8e872612362
size 3298005152

3
ELYZA-japanese-Llama-2-7b-instruct.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9350d036693f08f14f947a2817026e06d0caaf311e6406c490f61be4587c57fa
size 2948305056

3
ELYZA-japanese-Llama-2-7b-instruct.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:eb8f86242875961cf1ef7796476e79674bb4562b1a07141724e299ece7bcfbdd
size 3825807520

3
ELYZA-japanese-Llama-2-7b-instruct.Q4_0_4_4.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c23127bd51dbab4af47ddc947b9ae56b726771f2f631b95b5015d3cfbc0ecc48
size 3825807520

3
ELYZA-japanese-Llama-2-7b-instruct.Q4_0_4_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9b43b9cbd4767ff60bec2addcbe9ace24bd2c5acaf49e20f4aedfcc48fe41b05
size 3825807520

3
ELYZA-japanese-Llama-2-7b-instruct.Q4_0_8_8.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:72fdbc8b1b1e35f25c67693968f66c15e283a1b549c0a8258f18252ad6a3c748
size 3825807520

3
ELYZA-japanese-Llama-2-7b-instruct.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f1f40a55de50d79a095711701dcdc4c11dd6ba2b508324d0a1d235aa5cb9b7eb
size 4238749856

3
ELYZA-japanese-Llama-2-7b-instruct.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:397c3ec788d5fcf697e509c590b576c1520c75c2b96778ed821713fa5d6f8160
size 4081004704

3
ELYZA-japanese-Llama-2-7b-instruct.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e5ee77f55531ba955f53b600dab9c007520d110f5bbaa6d397b49dda6a062590
size 3856740512

3
ELYZA-japanese-Llama-2-7b-instruct.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e0f8b3efaff80a3149e212d575c319d5c6f7e9da4662a8c1e2f08f9f53f1a45e
size 4651692192

3
ELYZA-japanese-Llama-2-7b-instruct.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6376860e5a0cbc0cf318fbadc1d8bd59c48d7fa1b4f1026e98cdd3da0f4cca80
size 5064634528

3
ELYZA-japanese-Llama-2-7b-instruct.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62ea89ae6517264822cc98aafb84e4e5f704f8679d204b2cd8187ea0cacfb398
size 4783157408

3
ELYZA-japanese-Llama-2-7b-instruct.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3002c98e22c51ece5805f3b841ae2d3d1a2b853cd26e5e315d686d6ff5b67c88
size 4651692192

3
ELYZA-japanese-Llama-2-7b-instruct.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:02db601620da10af1d8a915e5d210434baa71463b9fc008255a77f3b91401a90
size 5529194656

3
ELYZA-japanese-Llama-2-7b-instruct.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2485640b0d29f48e1b8fb1e7006fa5b8ac7074541e9893a3f20fe1a6ee602a49
size 7161090208

126
README.md Normal file
View File

@@ -0,0 +1,126 @@
---
license: llama2
language:
- ja
- en
---
[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)
# QuantFactory/ELYZA-japanese-Llama-2-7b-instruct-GGUF
This is quantized version of [elyza/ELYZA-japanese-Llama-2-7b-instruct](https://huggingface.co/elyza/ELYZA-japanese-Llama-2-7b-instruct) created using llama.cpp
# Original Model Card
## ELYZA-japanese-Llama-2-7b
![ELYZA-Japanese-Llama2-image](./key_visual.png)
### Model Description
**ELYZA-japanese-Llama-2-7b** は、 Llama2をベースとして日本語能力を拡張するために追加事前学習を行ったモデルです。
詳細は [Blog記事](https://note.com/elyza/n/na405acaca130) を参照してください。
### Usage
```python
import torch
from transformers import AutoModelForCausalLM, AutoTokenizer
B_INST, E_INST = "[INST]", "[/INST]"
B_SYS, E_SYS = "<<SYS>>\n", "\n<</SYS>>\n\n"
DEFAULT_SYSTEM_PROMPT = "あなたは誠実で優秀な日本人のアシスタントです。"
text = "クマが海辺に行ってアザラシと友達になり、最終的には家に帰るというプロットの短編小説を書いてください。"
model_name = "elyza/ELYZA-japanese-Llama-2-7b-instruct"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name, torch_dtype="auto")
if torch.cuda.is_available():
model = model.to("cuda")
prompt = "{bos_token}{b_inst} {system}{prompt} {e_inst} ".format(
bos_token=tokenizer.bos_token,
b_inst=B_INST,
system=f"{B_SYS}{DEFAULT_SYSTEM_PROMPT}{E_SYS}",
prompt=text,
e_inst=E_INST,
)
with torch.no_grad():
token_ids = tokenizer.encode(prompt, add_special_tokens=False, return_tensors="pt")
output_ids = model.generate(
token_ids.to(model.device),
max_new_tokens=256,
pad_token_id=tokenizer.pad_token_id,
eos_token_id=tokenizer.eos_token_id,
)
output = tokenizer.decode(output_ids.tolist()[0][token_ids.size(1) :], skip_special_tokens=True)
print(output)
"""
承知しました。以下にクマが海辺に行ってアザラシと友達になり、最終的には家に帰るというプロットの短編小説を記述します。
クマは山の中でゆっくりと眠っていた。
その眠りに落ちたクマは、夢の中で海辺を歩いていた。
そこにはアザラシがいた。
クマはアザラシに話しかける。
「おはよう」とクマが言うと、アザラシは驚いたように顔を上げた。
「あ、こんにちは」アザラシは答えた。
クマはアザラシと友達になりたいと思う。
「私はクマと申します。」クマは...
"""
```
### ELYZA-japanese-Llama-2-7b Models
| Model Name | Vocab Size | #Params |
|:---------------------------------------------|:----------:|:-------:|
|[elyza/ELYZA-japanese-Llama-2-7b](https://huggingface.co/elyza/ELYZA-japanese-Llama-2-7b)| 32000 | 6.27B |
|[elyza/ELYZA-japanese-Llama-2-7b-instruct](https://huggingface.co/elyza/ELYZA-japanese-Llama-2-7b-instruct)| 32000 | 6.27B |
|[elyza/ELYZA-japanese-Llama-2-7b-fast](https://huggingface.co/elyza/ELYZA-japanese-Llama-2-7b-fast)| 45043 | 6.37B |
|[elyza/ELYZA-japanese-Llama-2-7b-fast-instruct](https://huggingface.co/elyza/ELYZA-japanese-Llama-2-7b-fast-instruct)| 45043 | 6.37B |
### Developers
以下アルファベット順
- [Akira Sasaki](https://huggingface.co/akirasasaki)
- [Masato Hirakawa](https://huggingface.co/m-hirakawa)
- [Shintaro Horie](https://huggingface.co/e-mon)
- [Tomoaki Nakamura](https://huggingface.co/tyoyo)
### Licence
Llama 2 is licensed under the LLAMA 2 Community License, Copyright (c) Meta Platforms, Inc. All Rights Reserved.
### How to Cite
```tex
@misc{elyzallama2023,
title={ELYZA-japanese-Llama-2-7b},
url={https://huggingface.co/elyza/ELYZA-japanese-Llama-2-7b},
author={Akira Sasaki and Masato Hirakawa and Shintaro Horie and Tomoaki Nakamura},
year={2023},
}
```
### Citations
```tex
@misc{touvron2023llama,
title={Llama 2: Open Foundation and Fine-Tuned Chat Models},
author={Hugo Touvron and Louis Martin and Kevin Stone and Peter Albert and Amjad Almahairi and Yasmine Babaei and Nikolay Bashlykov and Soumya Batra and Prajjwal Bhargava and Shruti Bhosale and Dan Bikel and Lukas Blecher and Cristian Canton Ferrer and Moya Chen and Guillem Cucurull and David Esiobu and Jude Fernandes and Jeremy Fu and Wenyin Fu and Brian Fuller and Cynthia Gao and Vedanuj Goswami and Naman Goyal and Anthony Hartshorn and Saghar Hosseini and Rui Hou and Hakan Inan and Marcin Kardas and Viktor Kerkez and Madian Khabsa and Isabel Kloumann and Artem Korenev and Punit Singh Koura and Marie-Anne Lachaux and Thibaut Lavril and Jenya Lee and Diana Liskovich and Yinghai Lu and Yuning Mao and Xavier Martinet and Todor Mihaylov and Pushkar Mishra and Igor Molybog and Yixin Nie and Andrew Poulton and Jeremy Reizenstein and Rashi Rungta and Kalyan Saladi and Alan Schelten and Ruan Silva and Eric Michael Smith and Ranjan Subramanian and Xiaoqing Ellen Tan and Binh Tang and Ross Taylor and Adina Williams and Jian Xiang Kuan and Puxin Xu and Zheng Yan and Iliyan Zarov and Yuchen Zhang and Angela Fan and Melanie Kambadur and Sharan Narang and Aurelien Rodriguez and Robert Stojnic and Sergey Edunov and Thomas Scialom},
year={2023},
eprint={2307.09288},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "others", "allow_remote": true}