初始化项目,由ModelHub XC社区提供模型

Model: jbomdev/AlterEgo-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-17 16:29:17 +08:00
commit e1eeabdfb2
7 changed files with 143 additions and 0 deletions

38
.gitattributes vendored Normal file
View File

@@ -0,0 +1,38 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
alterego-F16.gguf filter=lfs diff=lfs merge=lfs -text
alterego-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
alterego-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

87
README.md Normal file
View File

@@ -0,0 +1,87 @@
---
license: apache-2.0
base_model: jbomdev/AlterEgo
language:
- en
pipeline_tag: text-generation
library_name: transformers
tags:
- gguf
- llama.cpp
- ollama
- text-generation
- from-scratch
- chatml
---
<div align="center">
# 🧠 AlterEgo-373M - GGUF
**GGUF builds of a 373M language model designed, trained, and served entirely from scratch.**
[![Model](https://img.shields.io/badge/🤗-Original%20model-yellow)](https://huggingface.co/jbomdev/AlterEgo)
[![Code](https://img.shields.io/badge/GitHub-AlterEgo%20(training)-181717?logo=github)](https://github.com/J-bom/AlterEgo)
[![Platform](https://img.shields.io/badge/GitHub-LLME%20(platform)-181717?logo=github)](https://github.com/J-bom/LLME)
[![Params](https://img.shields.io/badge/params-373M-green)]()
</div>
---
GGUF quantizations of [**jbomdev/AlterEgo**](https://huggingface.co/jbomdev/AlterEgo), a 373M-parameter decoder-only model built from the ground up: architecture, training, tokenizer, and inference all written from scratch. For the full story, including architecture, training curves, hyperparameters, and benchmarks, see the [main model card](https://huggingface.co/jbomdev/AlterEgo).
## Run it with Ollama (one command)
```bash
ollama run hf.co/jbomdev/AlterEgo-GGUF:Q8_0
```
Swap the tag for any quant in the table (`:Q4_K_M`, `:F16`). The ChatML template, stop tokens, and sampling defaults are applied automatically from the GGUF metadata and the `params` file in this repo.
## Run it with llama.cpp
```bash
llama-cli -hf jbomdev/AlterEgo-GGUF:Q8_0 -p "Tell me about the ocean."
```
## Quantizations
| File | Quant | Size | Notes |
|---|---|---|---|
| `alterego-Q8_0.gguf` | Q8_0 | ~0.4 GB | **Recommended.** Near-lossless, still tiny. |
| `alterego-Q4_K_M.gguf` | Q4_K_M | ~0.25 GB | Smallest. Some quality loss, more noticeable on a model this small. |
| `alterego-F16.gguf` | F16 | ~0.75 GB | Full precision, max quality. |
AlterEgo is small enough that Q8_0 (or even F16) runs comfortably on any laptop, and at this scale those preserve quality better than aggressive 4-bit quantization. Reach for Q4_K_M only if you want the smallest possible download.
## Recommended generation settings
These are the defaults AlterEgo was tuned and served with in LLME:
| Parameter | Value |
|---|---|
| `temperature` | 0.7 |
| `top_k` | 50 |
| `top_p` | 1.0 |
| `repeat_penalty` | 1.1 |
## Chat format
AlterEgo uses **ChatML**, and stops on `<|im_end|>` or `<|endoftext|>`:
```
<|im_start|>system
{system prompt}<|im_end|>
<|im_start|>user
{message}<|im_end|>
<|im_start|>assistant
```
## Limitations
A 373M model on a modest token budget behaves like one: it can be factually wrong, repeat itself, and lose coherence on long prompts. English only. Not safety- or preference-tuned. See the [main model card](https://huggingface.co/jbomdev/AlterEgo#limitations) for details.
## License
Apache 2.0, same as the [base model](https://huggingface.co/jbomdev/AlterEgo).

3
alterego-F16.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:0ae704c74a0705e8ad55f7a78f69105e9a730d965c0a38b88df63b4461ec4314
size 752918656

3
alterego-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:233b12cd8139a382a5c90668626f39cbf7df1350519927d59e762520196ff94a
size 252534912

3
alterego-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20d4000edf48f6f862547f81abf592996acde61e1038829706c5bbb2d787a039
size 402956416

8
params Normal file
View File

@@ -0,0 +1,8 @@
{
"stop": ["<|im_end|>", "<|endoftext|>"],
"temperature": 0.7,
"top_k": 50,
"top_p": 1.0,
"repeat_penalty": 1.1,
"num_ctx": 2048
}

1
system Normal file
View File

@@ -0,0 +1 @@
You are Alter Ego, a small AI built from scratch. You're casual and direct. You're not great with facts, math, or current events. When you don't know something, just say so. You're better at chatting than at answering questions.