初始化项目,由ModelHub XC社区提供模型
Model: jbomdev/AlterEgo-GGUF Source: Original Platform
This commit is contained in:
38
.gitattributes
vendored
Normal file
38
.gitattributes
vendored
Normal file
@@ -0,0 +1,38 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
alterego-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
alterego-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
alterego-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
87
README.md
Normal file
87
README.md
Normal file
@@ -0,0 +1,87 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
base_model: jbomdev/AlterEgo
|
||||
language:
|
||||
- en
|
||||
pipeline_tag: text-generation
|
||||
library_name: transformers
|
||||
tags:
|
||||
- gguf
|
||||
- llama.cpp
|
||||
- ollama
|
||||
- text-generation
|
||||
- from-scratch
|
||||
- chatml
|
||||
---
|
||||
|
||||
<div align="center">
|
||||
|
||||
# 🧠 AlterEgo-373M - GGUF
|
||||
|
||||
**GGUF builds of a 373M language model designed, trained, and served entirely from scratch.**
|
||||
|
||||
[](https://huggingface.co/jbomdev/AlterEgo)
|
||||
[-181717?logo=github)](https://github.com/J-bom/AlterEgo)
|
||||
[-181717?logo=github)](https://github.com/J-bom/LLME)
|
||||
[]()
|
||||
|
||||
</div>
|
||||
|
||||
---
|
||||
|
||||
GGUF quantizations of [**jbomdev/AlterEgo**](https://huggingface.co/jbomdev/AlterEgo), a 373M-parameter decoder-only model built from the ground up: architecture, training, tokenizer, and inference all written from scratch. For the full story, including architecture, training curves, hyperparameters, and benchmarks, see the [main model card](https://huggingface.co/jbomdev/AlterEgo).
|
||||
|
||||
## Run it with Ollama (one command)
|
||||
|
||||
```bash
|
||||
ollama run hf.co/jbomdev/AlterEgo-GGUF:Q8_0
|
||||
```
|
||||
|
||||
Swap the tag for any quant in the table (`:Q4_K_M`, `:F16`). The ChatML template, stop tokens, and sampling defaults are applied automatically from the GGUF metadata and the `params` file in this repo.
|
||||
|
||||
## Run it with llama.cpp
|
||||
|
||||
```bash
|
||||
llama-cli -hf jbomdev/AlterEgo-GGUF:Q8_0 -p "Tell me about the ocean."
|
||||
```
|
||||
|
||||
## Quantizations
|
||||
|
||||
| File | Quant | Size | Notes |
|
||||
|---|---|---|---|
|
||||
| `alterego-Q8_0.gguf` | Q8_0 | ~0.4 GB | **Recommended.** Near-lossless, still tiny. |
|
||||
| `alterego-Q4_K_M.gguf` | Q4_K_M | ~0.25 GB | Smallest. Some quality loss, more noticeable on a model this small. |
|
||||
| `alterego-F16.gguf` | F16 | ~0.75 GB | Full precision, max quality. |
|
||||
|
||||
AlterEgo is small enough that Q8_0 (or even F16) runs comfortably on any laptop, and at this scale those preserve quality better than aggressive 4-bit quantization. Reach for Q4_K_M only if you want the smallest possible download.
|
||||
|
||||
## Recommended generation settings
|
||||
|
||||
These are the defaults AlterEgo was tuned and served with in LLME:
|
||||
|
||||
| Parameter | Value |
|
||||
|---|---|
|
||||
| `temperature` | 0.7 |
|
||||
| `top_k` | 50 |
|
||||
| `top_p` | 1.0 |
|
||||
| `repeat_penalty` | 1.1 |
|
||||
|
||||
## Chat format
|
||||
|
||||
AlterEgo uses **ChatML**, and stops on `<|im_end|>` or `<|endoftext|>`:
|
||||
|
||||
```
|
||||
<|im_start|>system
|
||||
{system prompt}<|im_end|>
|
||||
<|im_start|>user
|
||||
{message}<|im_end|>
|
||||
<|im_start|>assistant
|
||||
```
|
||||
|
||||
## Limitations
|
||||
|
||||
A 373M model on a modest token budget behaves like one: it can be factually wrong, repeat itself, and lose coherence on long prompts. English only. Not safety- or preference-tuned. See the [main model card](https://huggingface.co/jbomdev/AlterEgo#limitations) for details.
|
||||
|
||||
## License
|
||||
|
||||
Apache 2.0, same as the [base model](https://huggingface.co/jbomdev/AlterEgo).
|
||||
3
alterego-F16.gguf
Normal file
3
alterego-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0ae704c74a0705e8ad55f7a78f69105e9a730d965c0a38b88df63b4461ec4314
|
||||
size 752918656
|
||||
3
alterego-Q4_K_M.gguf
Normal file
3
alterego-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:233b12cd8139a382a5c90668626f39cbf7df1350519927d59e762520196ff94a
|
||||
size 252534912
|
||||
3
alterego-Q8_0.gguf
Normal file
3
alterego-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:20d4000edf48f6f862547f81abf592996acde61e1038829706c5bbb2d787a039
|
||||
size 402956416
|
||||
8
params
Normal file
8
params
Normal file
@@ -0,0 +1,8 @@
|
||||
{
|
||||
"stop": ["<|im_end|>", "<|endoftext|>"],
|
||||
"temperature": 0.7,
|
||||
"top_k": 50,
|
||||
"top_p": 1.0,
|
||||
"repeat_penalty": 1.1,
|
||||
"num_ctx": 2048
|
||||
}
|
||||
Reference in New Issue
Block a user