41 lines
2.6 KiB
Markdown
41 lines
2.6 KiB
Markdown
---
|
||
license: cc-by-nc-4.0
|
||
language:
|
||
- zh
|
||
---
|
||
|
||
---
|
||
|
||
# RA-IT-NER-zh-7B
|
||
|
||
**Description**: The RA-IT-NER-zh-7B model is trained from Qwen1.5-7B using the proposed Retrieval Augmented Instruction Tuning (RA-IT) approach. This model can be used for Chinese Open NER with and without RAG. The training data is our constructed [Sky-NER ](https://huggingface.co/datasets/EmmaStrong/Sky-NER), an instruction tuning dataset for Chinese OpenNER. We follow the recipe of [UniversalNER](https://arxiv.org/abs/2308.03279) and use the large-scale [SkyPile Corpus](https://huggingface.co/datasets/Skywork/SkyPile-150B) to construct this dataset. The data was collected by prompting gpt-3.5-turbo-0125 to label entities from passages and provide entity tags. The data collection prompt is as follows:
|
||
|
||
<div style="background-color: #f6f8fa; padding: 20px; border-radius: 10px; border: 1px solid #e1e4e8; box-shadow: 0 2px 5px rgba(0,0,0,0.1);">
|
||
<strong>Instruction:</strong><br/>
|
||
给定一段文本，你的任务是抽取所有实体并识别它们的实体类别。输出应为以下JSON格式：[{"实体1": "实体1的类别"}, ...]。</div>
|
||
|
||
Check our [paper](https://arxiv.org/abs/2406.17305) for more information. Check our [github repo](https://github.com/Emma1066/Retrieval-Augmented-IT-OpenNER) about how to use the model.
|
||
|
||
## Inference
|
||
The template for inference instances is as follows:
|
||
<div style="background-color: #f6f8fa; padding: 20px; border-radius: 10px; border: 1px solid #e1e4e8; box-shadow: 0 2px 5px rgba(0,0,0,0.1);">
|
||
<strong>Prompting template:</strong><br/>
|
||
USER: 以下是一些命名实体识别的例子：<span style="color: #d73a49;">{Fill the NER examples here}</span><br/>
|
||
ASSISTANT: 我已读完这些例子。<br/>
|
||
USER: 文本：<span style="color: #d73a49;">{Fill the input text here}</span><br/>
|
||
ASSISTANT: 我已读完这段文本。<br/>
|
||
USER: 文本中属于"<span style="color: #d73a49;">{Fill the entity type here}</span> "的实体有哪些？<br/>
|
||
ASSISTANT: <span style="color: #0366d6;">(model's predictions in JSON format)</span><br/>
|
||
</div>
|
||
|
||
Note:
|
||
* The model can conduct inference **with and without** NER examples. If you want to conduct inference without examples, just start from the third line in the above template by directly inputting "文本：{input text}" in the "USER" role.
|
||
* Inferences are based on one entity type at a time. For multiple entity types, create separate instances for each type.
|
||
|
||
|
||
|
||
## License
|
||
|
||
This model and its associated data are released under the [CC BY-NC 4.0](https://creativecommons.org/licenses/by-nc/4.0/) license. They are primarily used for research purposes.
|
||
|