初始化项目,由ModelHub XC社区提供模型
Model: hitonet/hito-1.7b-GGUF Source: Original Platform
This commit is contained in:
48
.gitattributes
vendored
Normal file
48
.gitattributes
vendored
Normal file
@@ -0,0 +1,48 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
hito-1.7b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
174
README.md
Normal file
174
README.md
Normal file
@@ -0,0 +1,174 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
tags:
|
||||
- qwen3
|
||||
- fine-tuned
|
||||
- hito
|
||||
- hitonet
|
||||
- reasoning
|
||||
- thinking
|
||||
- llama-cpp
|
||||
- ollama
|
||||
- conversational
|
||||
- gguf
|
||||
pipeline_tag: text-generation
|
||||
base_model: hitonet/hito-1.7b
|
||||
---
|
||||
|
||||
<div align="center">
|
||||
|
||||
# Hito 1.7B - GGUF
|
||||
|
||||
### Quantized versions for llama.cpp, Ollama, LM Studio, and more
|
||||
|
||||
[](https://huggingface.co/hitonet/hito-1.7b)
|
||||
[](https://hitonet.com)
|
||||
[](https://chat.hitonet.com)
|
||||
[](https://platform.hitonet.com)
|
||||
|
||||
---
|
||||
|
||||
<img src="https://img.shields.io/badge/Model_Weights-Apache_2.0_(Open)-green?style=flat-square" alt="Model License"/>
|
||||
<img src="https://img.shields.io/badge/Training_Method-Commercial_License_Required-red?style=flat-square" alt="Method License"/>
|
||||
|
||||
</div>
|
||||
|
||||
---
|
||||
|
||||
## About
|
||||
|
||||
This repository contains **GGUF quantized versions** of [hitonet/hito-1.7b](https://huggingface.co/hitonet/hito-1.7b).
|
||||
|
||||
Hito is a 1.7B parameter model with structured thinking patterns that enable better accuracy and transparency.
|
||||
|
||||
For the original model (safetensors), training details, benchmarks, and full documentation, see the [main repository](https://huggingface.co/hitonet/hito-1.7b).
|
||||
|
||||
---
|
||||
|
||||
## Available Quantizations
|
||||
|
||||
### Recommended
|
||||
|
||||
| File | Quant | Size | Quality | Notes |
|
||||
|------|-------|------|---------|-------|
|
||||
| **[hito-1.7b-Q4_K_M.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_K_M.gguf)** | Q4_K_M | 1.1 GB | **BEST** | Perfect balance of size and quality |
|
||||
| [hito-1.7b-Q5_K_M.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q5_K_M.gguf) | Q5_K_M | 1.2 GB | Excellent | Slightly better than Q4_K_M |
|
||||
| [hito-1.7b-Q8_0.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q8_0.gguf) | Q8_0 | 1.8 GB | Excellent | Highest quality quantization |
|
||||
|
||||
### Good Quality
|
||||
|
||||
| File | Quant | Size | Quality | Notes |
|
||||
|------|-------|------|---------|-------|
|
||||
| [hito-1.7b-Q4_0.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_0.gguf) | Q4_0 | 1.0 GB | Good | Legacy format, works well |
|
||||
| [hito-1.7b-Q4_K_S.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_K_S.gguf) | Q4_K_S | 1.0 GB | Good | Smaller Q4 variant |
|
||||
| [hito-1.7b-Q5_0.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q5_0.gguf) | Q5_0 | 1.2 GB | Good | Legacy 5-bit |
|
||||
| [hito-1.7b-Q5_K_S.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q5_K_S.gguf) | Q5_K_S | 1.2 GB | Good | Smaller Q5 variant |
|
||||
| [hito-1.7b-Q6_K.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q6_K.gguf) | Q6_K | 1.4 GB | Excellent | Near full quality |
|
||||
| [hito-1.7b-F16.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-F16.gguf) | F16 | 3.3 GB | Reference | Full precision GGUF |
|
||||
|
||||
### Low Quality (Not Recommended)
|
||||
|
||||
| File | Quant | Size | Quality | Notes |
|
||||
|------|-------|------|---------|-------|
|
||||
| [hito-1.7b-Q3_K_L.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q3_K_L.gguf) | Q3_K_L | 957 MB | Fair | May get stuck in thinking |
|
||||
| [hito-1.7b-Q3_K_M.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q3_K_M.gguf) | Q3_K_M | 896 MB | Fair | Occasional issues |
|
||||
| [hito-1.7b-Q3_K_S.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q3_K_S.gguf) | Q3_K_S | 827 MB | Fair | Noticeable quality loss |
|
||||
|
||||
### Broken (Do Not Use)
|
||||
|
||||
| File | Quant | Size | Quality | Notes |
|
||||
|------|-------|------|---------|-------|
|
||||
| [hito-1.7b-Q2_K.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q2_K.gguf) | Q2_K | 742 MB | Broken | Produces gibberish |
|
||||
|
||||
---
|
||||
|
||||
## Quick Start
|
||||
|
||||
### Ollama
|
||||
|
||||
```bash
|
||||
# Download the recommended quantization
|
||||
wget https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_K_M.gguf
|
||||
|
||||
# Create Modelfile
|
||||
cat > Modelfile << 'EOF'
|
||||
FROM hito-1.7b-Q4_K_M.gguf
|
||||
SYSTEM "You are Hito by Hitonet.com."
|
||||
PARAMETER temperature 0.7
|
||||
PARAMETER stop "<|im_end|>"
|
||||
EOF
|
||||
|
||||
# Create and run
|
||||
ollama create hito -f Modelfile
|
||||
ollama run hito
|
||||
```
|
||||
|
||||
### llama.cpp
|
||||
|
||||
```bash
|
||||
./llama-cli -m hito-1.7b-Q4_K_M.gguf \
|
||||
-sys "You are Hito by Hitonet.com." \
|
||||
-p "What is your name?" \
|
||||
-n 256
|
||||
```
|
||||
|
||||
### LM Studio
|
||||
|
||||
1. Download any GGUF file from this repository
|
||||
2. Open LM Studio → Load Model
|
||||
3. Set system prompt: `You are Hito by Hitonet.com.`
|
||||
4. Start chatting!
|
||||
|
||||
---
|
||||
|
||||
## Compatibility
|
||||
|
||||
These GGUF files work with:
|
||||
|
||||
- **Ollama** (recommended)
|
||||
- **llama.cpp**
|
||||
- **LM Studio**
|
||||
- **Jan**
|
||||
- **GPT4All**
|
||||
- **llama-cpp-python**
|
||||
- Any llama.cpp-compatible application
|
||||
|
||||
---
|
||||
|
||||
## What Makes Hito Special
|
||||
|
||||
- **Structured Thinking**: Uses `<think>` tags for transparent reasoning
|
||||
- **Self-Correcting**: Catches errors mid-reasoning
|
||||
- **Humble by Design**: Admits uncertainty rather than hallucinating
|
||||
- **Efficient**: Only 1.7B parameters, runs on CPU
|
||||
|
||||
For full documentation, benchmarks, and training details, see the [main repository](https://huggingface.co/hitonet/hito-1.7b).
|
||||
|
||||
---
|
||||
|
||||
## Licensing
|
||||
|
||||
| Component | License | Commercial Use |
|
||||
|-----------|---------|----------------|
|
||||
| **Model Weights** | Apache 2.0 | ✅ Free to use |
|
||||
| **Training Methodology** | Proprietary | ⚠️ **Commercial License Required** |
|
||||
|
||||
### Model Weights (Apache 2.0)
|
||||
The model weights are open source under Apache 2.0. You may use, modify, and distribute them freely.
|
||||
|
||||
### Training Methodology (Commercial License Required)
|
||||
The training methodology and cognitive framework used to create this model are proprietary to Hitonet.
|
||||
|
||||
**Commercial use of the training methodology requires a license.**
|
||||
|
||||
**Attribution is mandatory** when using this model or discussing its capabilities.
|
||||
|
||||
For commercial licensing inquiries: **legal@hitonet.com**
|
||||
|
||||
---
|
||||
|
||||
<div align="center">
|
||||
<b>Made with genuine curiosity by Hitonet</b>
|
||||
</div>
|
||||
3
hito-1.7b-F16.gguf
Normal file
3
hito-1.7b-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ccedd36c1434b0bede95b7e265df147be124f6e9cf44e1309dec71edffc2f117
|
||||
size 3446537408
|
||||
3
hito-1.7b-Q2_K.gguf
Normal file
3
hito-1.7b-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b8aa31509399a68ba2b99c2a6c525f46e84351e96e79f32aff777a818399a908
|
||||
size 777459712
|
||||
3
hito-1.7b-Q3_K_L.gguf
Normal file
3
hito-1.7b-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1d72237ea313a375a1bb2634f730545a2a57772763dcf900b456357980614caf
|
||||
size 1003165696
|
||||
3
hito-1.7b-Q3_K_M.gguf
Normal file
3
hito-1.7b-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4f9a9abe79886470e8705e68cfac0e94b3261714d3a71c0fcc681520807a86c6
|
||||
size 939202560
|
||||
3
hito-1.7b-Q3_K_S.gguf
Normal file
3
hito-1.7b-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6f9b7fb9140ef604ba98562131c25dab5f001bd297fa461f0c6054615397f147
|
||||
size 866916352
|
||||
3
hito-1.7b-Q4_0.gguf
Normal file
3
hito-1.7b-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a70892d1d55b6d09a78b3e21a6ddd6e702ecddc4e41436aef335e494acbb842b
|
||||
size 1054087168
|
||||
3
hito-1.7b-Q4_K_M.gguf
Normal file
3
hito-1.7b-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f6c82a335e89a7b740a11631351e73592eae790c9e78e1c024681dc249eef9d7
|
||||
size 1107073024
|
||||
3
hito-1.7b-Q4_K_S.gguf
Normal file
3
hito-1.7b-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ea3c022c1c2bc8a78554a908f07e8a6e95254cd2137d30ceb4e2be4a35f2e1f4
|
||||
size 1059854336
|
||||
3
hito-1.7b-Q5_0.gguf
Normal file
3
hito-1.7b-Q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4fb0bd0c74f90e7b3ca6945074dea7bcbd80e8edd9a1d250f50798c21f280364
|
||||
size 1230247936
|
||||
3
hito-1.7b-Q5_K_M.gguf
Normal file
3
hito-1.7b-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:23bf712ccccf1128e62891f1900b6a856a76fba3013684251bc868e0fc3050fd
|
||||
size 1257543680
|
||||
3
hito-1.7b-Q5_K_S.gguf
Normal file
3
hito-1.7b-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6d20b9312cc58eeaaea3a46f0bfe2487f875f3c035b37441ca67c25cddddd4cf
|
||||
size 1230247936
|
||||
3
hito-1.7b-Q6_K.gguf
Normal file
3
hito-1.7b-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:645ea7f30ab4b5a7ecbabd04bc573ae14c471f898db5d5e42285ce7573fe76ff
|
||||
size 1417418752
|
||||
3
hito-1.7b-Q8_0.gguf
Normal file
3
hito-1.7b-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9c8983bd817c2904b172013ac3ea71a827c96f4029f22f63996cd152b6bddb02
|
||||
size 1833992768
|
||||
Reference in New Issue
Block a user