baicai003/llama-3-8b-Instruct-chinese_v2
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: baicai003/llama-3-8b-Instruct-chinese_v2
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-07-28 22:56:17 +08:00
commit 9260fe0325
11 changed files with 413240 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

34
.gitattributes vendored Normal file
View File

@@ -0,0 +1,34 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bin.* filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zstandard filter=lfs diff=lfs merge=lfs -text
*.tfevents* filter=lfs diff=lfs merge=lfs -text
*.db* filter=lfs diff=lfs merge=lfs -text
*.ark* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*data* filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.meta filter=lfs diff=lfs merge=lfs -text
**/*ckpt*.index filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
frameworks:
- Pytorch
license: Apache License 2.0
tasks:
- chatbot
#model-type:
##如 gpt、phi、llama、chatglm、baichuan 等
#- gpt
#domain:
##如 nlp、cv、audio、multi-modal
#- nlp
#language:
##语言代码列表 https://help.aliyun.com/document_detail/215387.html?spm=a2c4g.11186623.0.0.9f8d7467kni6Aa
#- cn
#metrics:
##如 CIDEr、Blue、ROUGE 等
#- CIDEr
#tags:
##各种自定义，包括 pretrained、fine-tuned、instruction-tuned、RL-tuned 等训练方法和其他
#- pretrained
#tools:
##如 vllm、fastchat、llamacpp、AdaSeq 等
#- vllm
---
### 模型介绍
首个llama3 中文版系列模型，v1版本 2024-04-19 下午1点
该版本是instruct 中文版 （本系列第3个模型），支持system prompt自定义，基于英文原版instruct增量170k优质中文对话数据进行sft得到
Github：https://github.com/CrazyBoyM/llama3-Chinese-chat
### 模型推理
首先拉取本模型和Github仓库代码
```
git clone https://github.com/CrazyBoyM/llama3-Chinese-chat --depth 1
git lfs clone https://www.modelscope.cn/baicai003/llama-3-8b-Instruct-chinese_v2.git
```
接着
```
pip install -U streamlit
```
通过以上命令安装streamlit，然后通过下面命令启动网页以便访问，'/path/to/model'需要改成你的权重下载路径。
V1版本：
```shell
cd llama3-Chinese-chat
streamlit run deploy/web_streamlit_for_v1.py /path/to/model --theme.base="dark"
```
Instruct版本 （支持自定义system prompt)
```
cd llama3-Chinese-chat
streamlit run deploy/web_streamlit_for_instruct.py /path/to/model --theme.base="dark"
```
### 模型下载
SDK下载
```bash
#安装ModelScope
pip install modelscope
```
```python
#SDK模型下载
from modelscope import snapshot_download
model_dir = snapshot_download('baicai003/llama-3-8b-Instruct-chinese_v2')
```
Git下载
```
#Git模型下载
git clone https://www.modelscope.cn/baicai003/llama-3-8b-Instruct-chinese_v2.git
```
<p style="color: lightgrey;">如果您是本模型的贡献者，我们邀请您根据<a href="https://modelscope.cn/docs/ModelScope%E6%A8%A1%E5%9E%8B%E6%8E%A5%E5%85%A5%E6%B5%81%E7%A8%8B%E6%A6%82%E8%A7%88" style="color: lightgrey; text-decoration: underline;">模型贡献文档</a>，及时完善模型卡片内容。</p>

28
config.json Normal file
View File

@@ -0,0 +1,28 @@
{
"_name_or_path": "/root/lxl/PP_llama3/Meta-Llama-3-8B-Instruct",
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 128000,
"eos_token_id": 128001,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 8192,
"model_type": "llama",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pretraining_tp": 1,
"rms_norm_eps": 1e-05,
"rope_scaling": null,
"rope_theta": 500000.0,
"tie_word_embeddings": false,
"torch_dtype": "float16",
"transformers_version": "4.34.0",
"use_cache": true,
"vocab_size": 128256
}

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework":"Pytorch","task":"chatbot"}

6
generation_config.json Normal file
View File

@@ -0,0 +1,6 @@
{
"_from_model_config": true,
"bos_token_id": 128000,
"eos_token_id": 128001,
"transformers_version": "4.34.0"
}

3
pytorch_model-00001-of-00002.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c32a5d32d40f5dc9213bb36bd3dc3b4bafbfd579c8b9900457fe3fc18d644365
size 9976544444

3
pytorch_model-00002-of-00002.bin Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:65c492042e5711eb8ee7cc3710154b98417ac4d23628a0d3e912b98308278a00
size 6084078885

BIN
pytorch_model.bin.index.json (Stored with Git LFS) Normal file
View File

Binary file not shown.

262
special_tokens_map.json Normal file
View File

@@ -0,0 +1,262 @@
{
"additional_special_tokens": [
"<|begin_of_text|>",
"<|end_of_text|>",
"<|reserved_special_token_0|>",
"<|reserved_special_token_1|>",
"<|reserved_special_token_2|>",
"<|reserved_special_token_3|>",
"<|start_header_id|>",
"<|end_header_id|>",
"<|reserved_special_token_4|>",
"<|eot_id|>",
"<|reserved_special_token_5|>",
"<|reserved_special_token_6|>",
"<|reserved_special_token_7|>",
"<|reserved_special_token_8|>",
"<|reserved_special_token_9|>",
"<|reserved_special_token_10|>",
"<|reserved_special_token_11|>",
"<|reserved_special_token_12|>",
"<|reserved_special_token_13|>",
"<|reserved_special_token_14|>",
"<|reserved_special_token_15|>",
"<|reserved_special_token_16|>",
"<|reserved_special_token_17|>",
"<|reserved_special_token_18|>",
"<|reserved_special_token_19|>",
"<|reserved_special_token_20|>",
"<|reserved_special_token_21|>",
"<|reserved_special_token_22|>",
"<|reserved_special_token_23|>",
"<|reserved_special_token_24|>",
"<|reserved_special_token_25|>",
"<|reserved_special_token_26|>",
"<|reserved_special_token_27|>",
"<|reserved_special_token_28|>",
"<|reserved_special_token_29|>",
"<|reserved_special_token_30|>",
"<|reserved_special_token_31|>",
"<|reserved_special_token_32|>",
"<|reserved_special_token_33|>",
"<|reserved_special_token_34|>",
"<|reserved_special_token_35|>",
"<|reserved_special_token_36|>",
"<|reserved_special_token_37|>",
"<|reserved_special_token_38|>",
"<|reserved_special_token_39|>",
"<|reserved_special_token_40|>",
"<|reserved_special_token_41|>",
"<|reserved_special_token_42|>",
"<|reserved_special_token_43|>",
"<|reserved_special_token_44|>",
"<|reserved_special_token_45|>",
"<|reserved_special_token_46|>",
"<|reserved_special_token_47|>",
"<|reserved_special_token_48|>",
"<|reserved_special_token_49|>",
"<|reserved_special_token_50|>",
"<|reserved_special_token_51|>",
"<|reserved_special_token_52|>",
"<|reserved_special_token_53|>",
"<|reserved_special_token_54|>",
"<|reserved_special_token_55|>",
"<|reserved_special_token_56|>",
"<|reserved_special_token_57|>",
"<|reserved_special_token_58|>",
"<|reserved_special_token_59|>",
"<|reserved_special_token_60|>",
"<|reserved_special_token_61|>",
"<|reserved_special_token_62|>",
"<|reserved_special_token_63|>",
"<|reserved_special_token_64|>",
"<|reserved_special_token_65|>",
"<|reserved_special_token_66|>",
"<|reserved_special_token_67|>",
"<|reserved_special_token_68|>",
"<|reserved_special_token_69|>",
"<|reserved_special_token_70|>",
"<|reserved_special_token_71|>",
"<|reserved_special_token_72|>",
"<|reserved_special_token_73|>",
"<|reserved_special_token_74|>",
"<|reserved_special_token_75|>",
"<|reserved_special_token_76|>",
"<|reserved_special_token_77|>",
"<|reserved_special_token_78|>",
"<|reserved_special_token_79|>",
"<|reserved_special_token_80|>",
"<|reserved_special_token_81|>",
"<|reserved_special_token_82|>",
"<|reserved_special_token_83|>",
"<|reserved_special_token_84|>",
"<|reserved_special_token_85|>",
"<|reserved_special_token_86|>",
"<|reserved_special_token_87|>",
"<|reserved_special_token_88|>",
"<|reserved_special_token_89|>",
"<|reserved_special_token_90|>",
"<|reserved_special_token_91|>",
"<|reserved_special_token_92|>",
"<|reserved_special_token_93|>",
"<|reserved_special_token_94|>",
"<|reserved_special_token_95|>",
"<|reserved_special_token_96|>",
"<|reserved_special_token_97|>",
"<|reserved_special_token_98|>",
"<|reserved_special_token_99|>",
"<|reserved_special_token_100|>",
"<|reserved_special_token_101|>",
"<|reserved_special_token_102|>",
"<|reserved_special_token_103|>",
"<|reserved_special_token_104|>",
"<|reserved_special_token_105|>",
"<|reserved_special_token_106|>",
"<|reserved_special_token_107|>",
"<|reserved_special_token_108|>",
"<|reserved_special_token_109|>",
"<|reserved_special_token_110|>",
"<|reserved_special_token_111|>",
"<|reserved_special_token_112|>",
"<|reserved_special_token_113|>",
"<|reserved_special_token_114|>",
"<|reserved_special_token_115|>",
"<|reserved_special_token_116|>",
"<|reserved_special_token_117|>",
"<|reserved_special_token_118|>",
"<|reserved_special_token_119|>",
"<|reserved_special_token_120|>",
"<|reserved_special_token_121|>",
"<|reserved_special_token_122|>",
"<|reserved_special_token_123|>",
"<|reserved_special_token_124|>",
"<|reserved_special_token_125|>",
"<|reserved_special_token_126|>",
"<|reserved_special_token_127|>",
"<|reserved_special_token_128|>",
"<|reserved_special_token_129|>",
"<|reserved_special_token_130|>",
"<|reserved_special_token_131|>",
"<|reserved_special_token_132|>",
"<|reserved_special_token_133|>",
"<|reserved_special_token_134|>",
"<|reserved_special_token_135|>",
"<|reserved_special_token_136|>",
"<|reserved_special_token_137|>",
"<|reserved_special_token_138|>",
"<|reserved_special_token_139|>",
"<|reserved_special_token_140|>",
"<|reserved_special_token_141|>",
"<|reserved_special_token_142|>",
"<|reserved_special_token_143|>",
"<|reserved_special_token_144|>",
"<|reserved_special_token_145|>",
"<|reserved_special_token_146|>",
"<|reserved_special_token_147|>",
"<|reserved_special_token_148|>",
"<|reserved_special_token_149|>",
"<|reserved_special_token_150|>",
"<|reserved_special_token_151|>",
"<|reserved_special_token_152|>",
"<|reserved_special_token_153|>",
"<|reserved_special_token_154|>",
"<|reserved_special_token_155|>",
"<|reserved_special_token_156|>",
"<|reserved_special_token_157|>",
"<|reserved_special_token_158|>",
"<|reserved_special_token_159|>",
"<|reserved_special_token_160|>",
"<|reserved_special_token_161|>",
"<|reserved_special_token_162|>",
"<|reserved_special_token_163|>",
"<|reserved_special_token_164|>",
"<|reserved_special_token_165|>",
"<|reserved_special_token_166|>",
"<|reserved_special_token_167|>",
"<|reserved_special_token_168|>",
"<|reserved_special_token_169|>",
"<|reserved_special_token_170|>",
"<|reserved_special_token_171|>",
"<|reserved_special_token_172|>",
"<|reserved_special_token_173|>",
"<|reserved_special_token_174|>",
"<|reserved_special_token_175|>",
"<|reserved_special_token_176|>",
"<|reserved_special_token_177|>",
"<|reserved_special_token_178|>",
"<|reserved_special_token_179|>",
"<|reserved_special_token_180|>",
"<|reserved_special_token_181|>",
"<|reserved_special_token_182|>",
"<|reserved_special_token_183|>",
"<|reserved_special_token_184|>",
"<|reserved_special_token_185|>",
"<|reserved_special_token_186|>",
"<|reserved_special_token_187|>",
"<|reserved_special_token_188|>",
"<|reserved_special_token_189|>",
"<|reserved_special_token_190|>",
"<|reserved_special_token_191|>",
"<|reserved_special_token_192|>",
"<|reserved_special_token_193|>",
"<|reserved_special_token_194|>",
"<|reserved_special_token_195|>",
"<|reserved_special_token_196|>",
"<|reserved_special_token_197|>",
"<|reserved_special_token_198|>",
"<|reserved_special_token_199|>",
"<|reserved_special_token_200|>",
"<|reserved_special_token_201|>",
"<|reserved_special_token_202|>",
"<|reserved_special_token_203|>",
"<|reserved_special_token_204|>",
"<|reserved_special_token_205|>",
"<|reserved_special_token_206|>",
"<|reserved_special_token_207|>",
"<|reserved_special_token_208|>",
"<|reserved_special_token_209|>",
"<|reserved_special_token_210|>",
"<|reserved_special_token_211|>",
"<|reserved_special_token_212|>",
"<|reserved_special_token_213|>",
"<|reserved_special_token_214|>",
"<|reserved_special_token_215|>",
"<|reserved_special_token_216|>",
"<|reserved_special_token_217|>",
"<|reserved_special_token_218|>",
"<|reserved_special_token_219|>",
"<|reserved_special_token_220|>",
"<|reserved_special_token_221|>",
"<|reserved_special_token_222|>",
"<|reserved_special_token_223|>",
"<|reserved_special_token_224|>",
"<|reserved_special_token_225|>",
"<|reserved_special_token_226|>",
"<|reserved_special_token_227|>",
"<|reserved_special_token_228|>",
"<|reserved_special_token_229|>",
"<|reserved_special_token_230|>",
"<|reserved_special_token_231|>",
"<|reserved_special_token_232|>",
"<|reserved_special_token_233|>",
"<|reserved_special_token_234|>",
"<|reserved_special_token_235|>",
"<|reserved_special_token_236|>",
"<|reserved_special_token_237|>",
"<|reserved_special_token_238|>",
"<|reserved_special_token_239|>",
"<|reserved_special_token_240|>",
"<|reserved_special_token_241|>",
"<|reserved_special_token_242|>",
"<|reserved_special_token_243|>",
"<|reserved_special_token_244|>",
"<|reserved_special_token_245|>",
"<|reserved_special_token_246|>",
"<|reserved_special_token_247|>",
"<|reserved_special_token_248|>",
"<|reserved_special_token_249|>",
"<|reserved_special_token_250|>"
],
"bos_token": "<|begin_of_text|>",
"eos_token": "<|end_of_text|>"
}

410503
tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

2320
tokenizer_config.json Normal file
View File

File diff suppressed because it is too large Load Diff