commit e1eeabdfb2e878256ad530af337932ab25ef6636 Author: ModelHub XC Date: Mon Aug 17 16:29:17 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: jbomdev/AlterEgo-GGUF Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..441e679 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,38 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +alterego-F16.gguf filter=lfs diff=lfs merge=lfs -text +alterego-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +alterego-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/README.md b/README.md new file mode 100644 index 0000000..4a1b4f2 --- /dev/null +++ b/README.md @@ -0,0 +1,87 @@ +--- +license: apache-2.0 +base_model: jbomdev/AlterEgo +language: +- en +pipeline_tag: text-generation +library_name: transformers +tags: +- gguf +- llama.cpp +- ollama +- text-generation +- from-scratch +- chatml +--- + +
+ +# 🧠 AlterEgo-373M - GGUF + +**GGUF builds of a 373M language model designed, trained, and served entirely from scratch.** + +[![Model](https://img.shields.io/badge/🤗-Original%20model-yellow)](https://huggingface.co/jbomdev/AlterEgo) +[![Code](https://img.shields.io/badge/GitHub-AlterEgo%20(training)-181717?logo=github)](https://github.com/J-bom/AlterEgo) +[![Platform](https://img.shields.io/badge/GitHub-LLME%20(platform)-181717?logo=github)](https://github.com/J-bom/LLME) +[![Params](https://img.shields.io/badge/params-373M-green)]() + +
+ +--- + +GGUF quantizations of [**jbomdev/AlterEgo**](https://huggingface.co/jbomdev/AlterEgo), a 373M-parameter decoder-only model built from the ground up: architecture, training, tokenizer, and inference all written from scratch. For the full story, including architecture, training curves, hyperparameters, and benchmarks, see the [main model card](https://huggingface.co/jbomdev/AlterEgo). + +## Run it with Ollama (one command) + +```bash +ollama run hf.co/jbomdev/AlterEgo-GGUF:Q8_0 +``` + +Swap the tag for any quant in the table (`:Q4_K_M`, `:F16`). The ChatML template, stop tokens, and sampling defaults are applied automatically from the GGUF metadata and the `params` file in this repo. + +## Run it with llama.cpp + +```bash +llama-cli -hf jbomdev/AlterEgo-GGUF:Q8_0 -p "Tell me about the ocean." +``` + +## Quantizations + +| File | Quant | Size | Notes | +|---|---|---|---| +| `alterego-Q8_0.gguf` | Q8_0 | ~0.4 GB | **Recommended.** Near-lossless, still tiny. | +| `alterego-Q4_K_M.gguf` | Q4_K_M | ~0.25 GB | Smallest. Some quality loss, more noticeable on a model this small. | +| `alterego-F16.gguf` | F16 | ~0.75 GB | Full precision, max quality. | + +AlterEgo is small enough that Q8_0 (or even F16) runs comfortably on any laptop, and at this scale those preserve quality better than aggressive 4-bit quantization. Reach for Q4_K_M only if you want the smallest possible download. + +## Recommended generation settings + +These are the defaults AlterEgo was tuned and served with in LLME: + +| Parameter | Value | +|---|---| +| `temperature` | 0.7 | +| `top_k` | 50 | +| `top_p` | 1.0 | +| `repeat_penalty` | 1.1 | + +## Chat format + +AlterEgo uses **ChatML**, and stops on `<|im_end|>` or `<|endoftext|>`: + +``` +<|im_start|>system +{system prompt}<|im_end|> +<|im_start|>user +{message}<|im_end|> +<|im_start|>assistant +``` + +## Limitations + +A 373M model on a modest token budget behaves like one: it can be factually wrong, repeat itself, and lose coherence on long prompts. English only. Not safety- or preference-tuned. See the [main model card](https://huggingface.co/jbomdev/AlterEgo#limitations) for details. + +## License + +Apache 2.0, same as the [base model](https://huggingface.co/jbomdev/AlterEgo). diff --git a/alterego-F16.gguf b/alterego-F16.gguf new file mode 100644 index 0000000..8ae652a --- /dev/null +++ b/alterego-F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:0ae704c74a0705e8ad55f7a78f69105e9a730d965c0a38b88df63b4461ec4314 +size 752918656 diff --git a/alterego-Q4_K_M.gguf b/alterego-Q4_K_M.gguf new file mode 100644 index 0000000..34517a4 --- /dev/null +++ b/alterego-Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:233b12cd8139a382a5c90668626f39cbf7df1350519927d59e762520196ff94a +size 252534912 diff --git a/alterego-Q8_0.gguf b/alterego-Q8_0.gguf new file mode 100644 index 0000000..9632e36 --- /dev/null +++ b/alterego-Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:20d4000edf48f6f862547f81abf592996acde61e1038829706c5bbb2d787a039 +size 402956416 diff --git a/params b/params new file mode 100644 index 0000000..f6e376c --- /dev/null +++ b/params @@ -0,0 +1,8 @@ +{ + "stop": ["<|im_end|>", "<|endoftext|>"], + "temperature": 0.7, + "top_k": 50, + "top_p": 1.0, + "repeat_penalty": 1.1, + "num_ctx": 2048 +} diff --git a/system b/system new file mode 100644 index 0000000..f56657d --- /dev/null +++ b/system @@ -0,0 +1 @@ +You are Alter Ego, a small AI built from scratch. You're casual and direct. You're not great with facts, math, or current events. When you don't know something, just say so. You're better at chatting than at answering questions.