commit 06129d428f91970999fef74fe88f06a9b43a7945 Author: ModelHub XC Date: Tue Aug 11 15:15:16 2026 +0800 初始化项目,由ModelHub XC社区提供模型 Model: North-ML1/Forge-1-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..afcfc58 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,37 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +forge-1-f16.gguf filter=lfs diff=lfs merge=lfs -text +forge-1-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/3.png b/3.png new file mode 100644 index 0000000..20d46a6 Binary files /dev/null and b/3.png differ diff --git a/README.md b/README.md new file mode 100644 index 0000000..a692093 --- /dev/null +++ b/README.md @@ -0,0 +1,53 @@ +--- +license: other +library_name: llama.cpp +tags: +- gguf +- llama.cpp +- text-generation +- forge-1 +base_model: North-ML1/Forge-1 +--- +![forge random image for style, idk why just why not](3.png) + +# Forge-1 GGUF + +GGUF exports for [`North-ML1/Forge-1`](https://huggingface.co/North-ML1/Forge-1). + +Files: + +- `forge-1-f16.gguf` - F16 GGUF export. +- `forge-1-q4_k_m.gguf` - Q4_K_M quantized GGUF for practical local inference. + +Source model: `North-ML1/Forge-1`, moved from `North-ML1/Forge-1-Base`. + +Conversion notes: + +- Converted with `llama.cpp` from the Hugging Face safetensors export. +- The model uses a locally trained ByteLevel BPE tokenizer. Current `llama.cpp` did not recognize its tokenizer hash, so the converter was patched to mark this ByteLevel BPE tokenizer as `gpt-2` pre-tokenization. +- A smoke test with `llama-cli` loaded `forge-1-q4_k_m.gguf` and answered `2 + 2 = 4`. + +Example: + +```bash +llama-cli -m forge-1-q4_k_m.gguf -p '<|im_start|>user\nWhat is 2 + 2?<|im_end|>\n<|im_start|>assistant\n' -n 32 --temp 0 +``` + +SHA256: + +```text +56b5f16b11e742e82874f11f5db20bc9be497793626989a5ed4000108773a87c forge-1-f16.gguf +2272f246381687462abac21a8f9b8cda1d891fa0cdba22d45c16f77c7527c51c forge-1-q4_k_m.gguf +``` + +## Prompt Format + +Forge-1 is ChatML-tuned. Use a ChatML prompt, for example: + +```text +<|im_start|>user +What is 2 + 2?<|im_end|> +<|im_start|>assistant +``` + +Plain completion prompts are not reliable for this checkpoint. If your UI has a chat-template selector, choose ChatML. diff --git a/forge-1-f16.gguf b/forge-1-f16.gguf new file mode 100644 index 0000000..1a7ca2c --- /dev/null +++ b/forge-1-f16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:56b5f16b11e742e82874f11f5db20bc9be497793626989a5ed4000108773a87c +size 227167040 diff --git a/forge-1-q4_k_m.gguf b/forge-1-q4_k_m.gguf new file mode 100644 index 0000000..472b400 --- /dev/null +++ b/forge-1-q4_k_m.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:2272f246381687462abac21a8f9b8cda1d891fa0cdba22d45c16f77c7527c51c +size 71267392