初始化项目,由ModelHub XC社区提供模型
Model: LiquidAI/LFM2-350M-PII-Extract-JP-GGUF Source: Original Platform
This commit is contained in:
41
.gitattributes
vendored
Normal file
41
.gitattributes
vendored
Normal file
@@ -0,0 +1,41 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2-350M-PII-Extract-JP-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2-350M-PII-Extract-JP-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2-350M-PII-Extract-JP-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2-350M-PII-Extract-JP-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2-350M-PII-Extract-JP-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
LFM2-350M-PII-Extract-JP-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
3
LFM2-350M-PII-Extract-JP-F16.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e0222e9f8162f4b4029239d83866bcd1974fe57e4f90df8a6649511f3ef2e7cb
|
||||
size 711484000
|
||||
3
LFM2-350M-PII-Extract-JP-Q4_0.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:cf978ba1a5b63c4c8f78e86f60cb3b07ff7c5f1be4f2baf6934df3ba6edbe1b7
|
||||
size 219308640
|
||||
3
LFM2-350M-PII-Extract-JP-Q4_K_M.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6ae7bb97a543ee57629f322da2b5f499d10825245b1d29aaec09076d6b8f4bcb
|
||||
size 229311072
|
||||
3
LFM2-350M-PII-Extract-JP-Q5_K_M.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:db7ad9fc5980b972b702245ee0c1e763f4c8254162ae38d6edcab457d0de8cb1
|
||||
size 260375136
|
||||
3
LFM2-350M-PII-Extract-JP-Q6_K.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ab4eb9a5a7e05353485e1e2ee9243ce835d2d4b3517aadbfd56feeed8bc9ede7
|
||||
size 293380704
|
||||
3
LFM2-350M-PII-Extract-JP-Q8_0.gguf
Normal file
3
LFM2-350M-PII-Extract-JP-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:901e33f4d7aa151e2016748f3a2012d98daf20d94cbba794c5b5f9fd8edd5bb5
|
||||
size 379216480
|
||||
53
README.md
Normal file
53
README.md
Normal file
@@ -0,0 +1,53 @@
|
||||
|
||||
---
|
||||
license: other
|
||||
license_name: lfm1.0
|
||||
license_link: LICENSE
|
||||
tags:
|
||||
- liquid
|
||||
- lfm2
|
||||
- edge
|
||||
base_model:
|
||||
- LiquidAI/LFM2-350M-PII-Extract-JP
|
||||
---
|
||||
|
||||
<center>
|
||||
<div style="text-align: center;">
|
||||
<img
|
||||
src="https://cdn-uploads.huggingface.co/production/uploads/61b8e2ba285851687028d395/2b08LKpev0DNEk6DlnWkY.png"
|
||||
alt="Liquid AI"
|
||||
style="width: 100%; max-width: 100%; height: auto; display: inline-block; margin-bottom: 0.5em; margin-top: 0.5em;"
|
||||
/>
|
||||
</div>
|
||||
<div style="display: flex; justify-content: center; gap: 0.5em;">
|
||||
<a href="https://playground.liquid.ai/chat">
|
||||
<a href="https://playground.liquid.ai/"><strong>Try LFM</strong></a> • <a href="https://docs.liquid.ai/lfm"><strong>Documentation</strong></a> • <a href="https://leap.liquid.ai/"><strong>LEAP</strong></a></a>
|
||||
</div>
|
||||
</center>
|
||||
|
||||
# LFM2-350M-PII-Extract-JP-GGUF
|
||||
|
||||
Based on [LFM2-350M](https://huggingface.co/LiquidAI/LFM2-350M), this checkpoint is designed to **extract personally identifiable information (PII) from Japanese text and output it in JSON format.**
|
||||
The output can then be used to mask out sensitive information in contracts, emails, personal medical reports, insurance bills, etc. directly on-device.
|
||||
|
||||
Find more details in the original model card: https://huggingface.co/LiquidAI/LFM2-350M-PII-Extract-JP
|
||||
|
||||
## 🏃 How to run LFM2
|
||||
|
||||
Example usage with [llama.cpp](https://github.com/ggml-org/llama.cpp):
|
||||
|
||||
- Extract address, company/institution names, email addresses, human names, and phone numbers from Japanese text.
|
||||
```
|
||||
llama-cli -hf LiquidAI/LFM2-350M-PII-Extract-JP-GGUF -st --temp 0.0 --json-schema {} --jinja
|
||||
```
|
||||
|
||||
- Specifying a particular quantization scheme (e.g. `Q8_0`):
|
||||
```
|
||||
llama-cli -hf LiquidAI/LFM2-350M-PII-Extract-JP-GGUF:Q8_0 -st --temp 0.0 --json-schema {} --jinja
|
||||
```
|
||||
Several quantization variants are available (`Q4_0`, `Q4_K_M`, `Q5_K_M`, `Q6_K`, `Q8_0`, and `F16`).
|
||||
|
||||
- Only extracting particular entities (e.g. only extract `address` and `company_name`):
|
||||
```
|
||||
llama-cli -hf LiquidAI/LFM2-350M-PII-Extract-JP-GGUF -st --temp 0.0 --json-schema {} -sys "Extract <address>, <company_name>"
|
||||
```
|
||||
12
leap/Q4_0.json
Normal file
12
leap/Q4_0.json
Normal file
@@ -0,0 +1,12 @@
|
||||
{
|
||||
"inference_type": "llama.cpp/text-to-text",
|
||||
"schema_version": "1.0.0",
|
||||
"load_time_parameters": {
|
||||
"model": "../LFM2-350M-PII-Extract-JP-Q4_0.gguf"
|
||||
},
|
||||
"generation_time_parameters": {
|
||||
"sampling_parameters": {
|
||||
"temperature": 0.0
|
||||
}
|
||||
}
|
||||
}
|
||||
12
leap/Q4_K_M.json
Normal file
12
leap/Q4_K_M.json
Normal file
@@ -0,0 +1,12 @@
|
||||
{
|
||||
"inference_type": "llama.cpp/text-to-text",
|
||||
"schema_version": "1.0.0",
|
||||
"load_time_parameters": {
|
||||
"model": "../LFM2-350M-PII-Extract-JP-Q4_K_M.gguf"
|
||||
},
|
||||
"generation_time_parameters": {
|
||||
"sampling_parameters": {
|
||||
"temperature": 0.0
|
||||
}
|
||||
}
|
||||
}
|
||||
12
leap/Q5_K_M.json
Normal file
12
leap/Q5_K_M.json
Normal file
@@ -0,0 +1,12 @@
|
||||
{
|
||||
"inference_type": "llama.cpp/text-to-text",
|
||||
"schema_version": "1.0.0",
|
||||
"load_time_parameters": {
|
||||
"model": "../LFM2-350M-PII-Extract-JP-Q5_K_M.gguf"
|
||||
},
|
||||
"generation_time_parameters": {
|
||||
"sampling_parameters": {
|
||||
"temperature": 0.0
|
||||
}
|
||||
}
|
||||
}
|
||||
12
leap/Q8_0.json
Normal file
12
leap/Q8_0.json
Normal file
@@ -0,0 +1,12 @@
|
||||
{
|
||||
"inference_type": "llama.cpp/text-to-text",
|
||||
"schema_version": "1.0.0",
|
||||
"load_time_parameters": {
|
||||
"model": "../LFM2-350M-PII-Extract-JP-Q8_0.gguf"
|
||||
},
|
||||
"generation_time_parameters": {
|
||||
"sampling_parameters": {
|
||||
"temperature": 0.0
|
||||
}
|
||||
}
|
||||
}
|
||||
Reference in New Issue
Block a user