初始化项目,由ModelHub XC社区提供模型
Model: North-ML1/Forge-1-GGUF Source: Original Platform
This commit is contained in:
37
.gitattributes
vendored
Normal file
37
.gitattributes
vendored
Normal file
@@ -0,0 +1,37 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
forge-1-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
forge-1-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
53
README.md
Normal file
53
README.md
Normal file
@@ -0,0 +1,53 @@
|
||||
---
|
||||
license: other
|
||||
library_name: llama.cpp
|
||||
tags:
|
||||
- gguf
|
||||
- llama.cpp
|
||||
- text-generation
|
||||
- forge-1
|
||||
base_model: North-ML1/Forge-1
|
||||
---
|
||||

|
||||
|
||||
# Forge-1 GGUF
|
||||
|
||||
GGUF exports for [`North-ML1/Forge-1`](https://huggingface.co/North-ML1/Forge-1).
|
||||
|
||||
Files:
|
||||
|
||||
- `forge-1-f16.gguf` - F16 GGUF export.
|
||||
- `forge-1-q4_k_m.gguf` - Q4_K_M quantized GGUF for practical local inference.
|
||||
|
||||
Source model: `North-ML1/Forge-1`, moved from `North-ML1/Forge-1-Base`.
|
||||
|
||||
Conversion notes:
|
||||
|
||||
- Converted with `llama.cpp` from the Hugging Face safetensors export.
|
||||
- The model uses a locally trained ByteLevel BPE tokenizer. Current `llama.cpp` did not recognize its tokenizer hash, so the converter was patched to mark this ByteLevel BPE tokenizer as `gpt-2` pre-tokenization.
|
||||
- A smoke test with `llama-cli` loaded `forge-1-q4_k_m.gguf` and answered `2 + 2 = 4`.
|
||||
|
||||
Example:
|
||||
|
||||
```bash
|
||||
llama-cli -m forge-1-q4_k_m.gguf -p '<|im_start|>user\nWhat is 2 + 2?<|im_end|>\n<|im_start|>assistant\n' -n 32 --temp 0
|
||||
```
|
||||
|
||||
SHA256:
|
||||
|
||||
```text
|
||||
56b5f16b11e742e82874f11f5db20bc9be497793626989a5ed4000108773a87c forge-1-f16.gguf
|
||||
2272f246381687462abac21a8f9b8cda1d891fa0cdba22d45c16f77c7527c51c forge-1-q4_k_m.gguf
|
||||
```
|
||||
|
||||
## Prompt Format
|
||||
|
||||
Forge-1 is ChatML-tuned. Use a ChatML prompt, for example:
|
||||
|
||||
```text
|
||||
<|im_start|>user
|
||||
What is 2 + 2?<|im_end|>
|
||||
<|im_start|>assistant
|
||||
```
|
||||
|
||||
Plain completion prompts are not reliable for this checkpoint. If your UI has a chat-template selector, choose ChatML.
|
||||
3
forge-1-f16.gguf
Normal file
3
forge-1-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:56b5f16b11e742e82874f11f5db20bc9be497793626989a5ed4000108773a87c
|
||||
size 227167040
|
||||
3
forge-1-q4_k_m.gguf
Normal file
3
forge-1-q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2272f246381687462abac21a8f9b8cda1d891fa0cdba22d45c16f77c7527c51c
|
||||
size 71267392
|
||||
Reference in New Issue
Block a user