初始化项目,由ModelHub XC社区提供模型
Model: North-ML1/Forge-1-GGUF Source: Original Platform
This commit is contained in:
37
.gitattributes
vendored
Normal file
37
.gitattributes
vendored
Normal file
@@ -0,0 +1,37 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
forge-1-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
forge-1-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
53
README.md
Normal file
53
README.md
Normal file
@@ -0,0 +1,53 @@
|
|||||||
|
---
|
||||||
|
license: other
|
||||||
|
library_name: llama.cpp
|
||||||
|
tags:
|
||||||
|
- gguf
|
||||||
|
- llama.cpp
|
||||||
|
- text-generation
|
||||||
|
- forge-1
|
||||||
|
base_model: North-ML1/Forge-1
|
||||||
|
---
|
||||||
|

|
||||||
|
|
||||||
|
# Forge-1 GGUF
|
||||||
|
|
||||||
|
GGUF exports for [`North-ML1/Forge-1`](https://huggingface.co/North-ML1/Forge-1).
|
||||||
|
|
||||||
|
Files:
|
||||||
|
|
||||||
|
- `forge-1-f16.gguf` - F16 GGUF export.
|
||||||
|
- `forge-1-q4_k_m.gguf` - Q4_K_M quantized GGUF for practical local inference.
|
||||||
|
|
||||||
|
Source model: `North-ML1/Forge-1`, moved from `North-ML1/Forge-1-Base`.
|
||||||
|
|
||||||
|
Conversion notes:
|
||||||
|
|
||||||
|
- Converted with `llama.cpp` from the Hugging Face safetensors export.
|
||||||
|
- The model uses a locally trained ByteLevel BPE tokenizer. Current `llama.cpp` did not recognize its tokenizer hash, so the converter was patched to mark this ByteLevel BPE tokenizer as `gpt-2` pre-tokenization.
|
||||||
|
- A smoke test with `llama-cli` loaded `forge-1-q4_k_m.gguf` and answered `2 + 2 = 4`.
|
||||||
|
|
||||||
|
Example:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
llama-cli -m forge-1-q4_k_m.gguf -p '<|im_start|>user\nWhat is 2 + 2?<|im_end|>\n<|im_start|>assistant\n' -n 32 --temp 0
|
||||||
|
```
|
||||||
|
|
||||||
|
SHA256:
|
||||||
|
|
||||||
|
```text
|
||||||
|
56b5f16b11e742e82874f11f5db20bc9be497793626989a5ed4000108773a87c forge-1-f16.gguf
|
||||||
|
2272f246381687462abac21a8f9b8cda1d891fa0cdba22d45c16f77c7527c51c forge-1-q4_k_m.gguf
|
||||||
|
```
|
||||||
|
|
||||||
|
## Prompt Format
|
||||||
|
|
||||||
|
Forge-1 is ChatML-tuned. Use a ChatML prompt, for example:
|
||||||
|
|
||||||
|
```text
|
||||||
|
<|im_start|>user
|
||||||
|
What is 2 + 2?<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
```
|
||||||
|
|
||||||
|
Plain completion prompts are not reliable for this checkpoint. If your UI has a chat-template selector, choose ChatML.
|
||||||
3
forge-1-f16.gguf
Normal file
3
forge-1-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:56b5f16b11e742e82874f11f5db20bc9be497793626989a5ed4000108773a87c
|
||||||
|
size 227167040
|
||||||
3
forge-1-q4_k_m.gguf
Normal file
3
forge-1-q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:2272f246381687462abac21a8f9b8cda1d891fa0cdba22d45c16f77c7527c51c
|
||||||
|
size 71267392
|
||||||
Reference in New Issue
Block a user