初始化项目,由ModelHub XC社区提供模型
Model: LiquidAI/LFM2-350M-PII-Extract-JP-GGUF Source: Original Platform
This commit is contained in:
41
.gitattributes
vendored
Normal file
41
.gitattributes
vendored
Normal file
@@ -0,0 +1,41 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
LFM2-350M-PII-Extract-JP-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
LFM2-350M-PII-Extract-JP-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
LFM2-350M-PII-Extract-JP-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
LFM2-350M-PII-Extract-JP-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
LFM2-350M-PII-Extract-JP-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
LFM2-350M-PII-Extract-JP-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
LFM2-350M-PII-Extract-JP-F16.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e0222e9f8162f4b4029239d83866bcd1974fe57e4f90df8a6649511f3ef2e7cb
|
||||||
|
size 711484000
|
||||||
3
LFM2-350M-PII-Extract-JP-Q4_0.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:cf978ba1a5b63c4c8f78e86f60cb3b07ff7c5f1be4f2baf6934df3ba6edbe1b7
|
||||||
|
size 219308640
|
||||||
3
LFM2-350M-PII-Extract-JP-Q4_K_M.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6ae7bb97a543ee57629f322da2b5f499d10825245b1d29aaec09076d6b8f4bcb
|
||||||
|
size 229311072
|
||||||
3
LFM2-350M-PII-Extract-JP-Q5_K_M.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:db7ad9fc5980b972b702245ee0c1e763f4c8254162ae38d6edcab457d0de8cb1
|
||||||
|
size 260375136
|
||||||
3
LFM2-350M-PII-Extract-JP-Q6_K.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ab4eb9a5a7e05353485e1e2ee9243ce835d2d4b3517aadbfd56feeed8bc9ede7
|
||||||
|
size 293380704
|
||||||
3
LFM2-350M-PII-Extract-JP-Q8_0.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:901e33f4d7aa151e2016748f3a2012d98daf20d94cbba794c5b5f9fd8edd5bb5
|
||||||
|
size 379216480
|
||||||
53
README.md
Normal file
53
README.md
Normal file
@@ -0,0 +1,53 @@
|
|||||||
|
|
||||||
|
---
|
||||||
|
license: other
|
||||||
|
license_name: lfm1.0
|
||||||
|
license_link: LICENSE
|
||||||
|
tags:
|
||||||
|
- liquid
|
||||||
|
- lfm2
|
||||||
|
- edge
|
||||||
|
base_model:
|
||||||
|
- LiquidAI/LFM2-350M-PII-Extract-JP
|
||||||
|
---
|
||||||
|
|
||||||
|
<center>
|
||||||
|
<div style="text-align: center;">
|
||||||
|
<img
|
||||||
|
src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png"
|
||||||
|
alt="Liquid AI"
|
||||||
|
style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
|
||||||
|
/>
|
||||||
|
</div>
|
||||||
|
<div style="display: flex; justify-content: center; gap: 0.5em;">
|
||||||
|
<a href="https://playground.liquid.ai/chat">
|
||||||
|
<a href="https://playground.liquid.ai/"><strong>Try LFM</strong></a> • <a href="https://docs.liquid.ai/lfm"><strong>Documentation</strong></a> • <a href="https://leap.liquid.ai/"><strong>LEAP</strong></a></a>
|
||||||
|
</div>
|
||||||
|
</center>
|
||||||
|
|
||||||
|
# LFM2-350M-PII-Extract-JP-GGUF
|
||||||
|
|
||||||
|
Based on [LFM2-350M](https://huggingface.co/LiquidAI/LFM2-350M), this checkpoint is designed to **extract personally identifiable information (PII) from Japanese text and output it in JSON format.**
|
||||||
|
The output can then be used to mask out sensitive information in contracts, emails, personal medical reports, insurance bills, etc. directly on-device.
|
||||||
|
|
||||||
|
Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2-350M-PII-Extract-JP
|
||||||
|
|
||||||
|
## 🏃 How to run LFM2
|
||||||
|
|
||||||
|
Example usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):
|
||||||
|
|
||||||
|
- Extract address, company/institution names, email addresses, human names, and phone numbers from Japanese text.
|
||||||
|
```
|
||||||
|
llama-cli -hf LiquidAI/LFM2-350M-PII-Extract-JP-GGUF -st --temp 0.0 --json-schema {} --jinja
|
||||||
|
```
|
||||||
|
|
||||||
|
- Specifying a particular quantization scheme (e.g. `Q8_0`):
|
||||||
|
```
|
||||||
|
llama-cli -hf LiquidAI/LFM2-350M-PII-Extract-JP-GGUF:Q8_0 -st --temp 0.0 --json-schema {} --jinja
|
||||||
|
```
|
||||||
|
Several quantization variants are available (`Q4_0`, `Q4_K_M`, `Q5_K_M`, `Q6_K`, `Q8_0`, and `F16`).
|
||||||
|
|
||||||
|
- Only extracting particular entities (e.g. only extract `address` and `company_name`):
|
||||||
|
```
|
||||||
|
llama-cli -hf LiquidAI/LFM2-350M-PII-Extract-JP-GGUF -st --temp 0.0 --json-schema {} -sys "Extract <address>, <company_name>"
|
||||||
|
```
|
||||||
12
leap/Q4_0.json
Normal file
12
leap/Q4_0.json
Normal file
@@ -0,0 +1,12 @@
|
|||||||
|
{
|
||||||
|
"inference_type": "llama.cpp/text-to-text",
|
||||||
|
"schema_version": "1.0.0",
|
||||||
|
"load_time_parameters": {
|
||||||
|
"model": "../LFM2-350M-PII-Extract-JP-Q4_0.gguf"
|
||||||
|
},
|
||||||
|
"generation_time_parameters": {
|
||||||
|
"sampling_parameters": {
|
||||||
|
"temperature": 0.0
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
12
leap/Q4_K_M.json
Normal file
12
leap/Q4_K_M.json
Normal file
@@ -0,0 +1,12 @@
|
|||||||
|
{
|
||||||
|
"inference_type": "llama.cpp/text-to-text",
|
||||||
|
"schema_version": "1.0.0",
|
||||||
|
"load_time_parameters": {
|
||||||
|
"model": "../LFM2-350M-PII-Extract-JP-Q4_K_M.gguf"
|
||||||
|
},
|
||||||
|
"generation_time_parameters": {
|
||||||
|
"sampling_parameters": {
|
||||||
|
"temperature": 0.0
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
12
leap/Q5_K_M.json
Normal file
12
leap/Q5_K_M.json
Normal file
@@ -0,0 +1,12 @@
|
|||||||
|
{
|
||||||
|
"inference_type": "llama.cpp/text-to-text",
|
||||||
|
"schema_version": "1.0.0",
|
||||||
|
"load_time_parameters": {
|
||||||
|
"model": "../LFM2-350M-PII-Extract-JP-Q5_K_M.gguf"
|
||||||
|
},
|
||||||
|
"generation_time_parameters": {
|
||||||
|
"sampling_parameters": {
|
||||||
|
"temperature": 0.0
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
12
leap/Q8_0.json
Normal file
12
leap/Q8_0.json
Normal file
@@ -0,0 +1,12 @@
|
|||||||
|
{
|
||||||
|
"inference_type": "llama.cpp/text-to-text",
|
||||||
|
"schema_version": "1.0.0",
|
||||||
|
"load_time_parameters": {
|
||||||
|
"model": "../LFM2-350M-PII-Extract-JP-Q8_0.gguf"
|
||||||
|
},
|
||||||
|
"generation_time_parameters": {
|
||||||
|
"sampling_parameters": {
|
||||||
|
"temperature": 0.0
|
||||||
|
}
|
||||||
|
}
|
||||||
|
}
|
||||||
Reference in New Issue
Block a user