初始化项目,由ModelHub XC社区提供模型
Model: hitonet/hito-1.7b-GGUF Source: Original Platform
This commit is contained in:
48
.gitattributes
vendored
Normal file
48
.gitattributes
vendored
Normal file
@@ -0,0 +1,48 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
hito-1.7b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
174
README.md
Normal file
174
README.md
Normal file
@@ -0,0 +1,174 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
tags:
|
||||||
|
- qwen3
|
||||||
|
- fine-tuned
|
||||||
|
- hito
|
||||||
|
- hitonet
|
||||||
|
- reasoning
|
||||||
|
- thinking
|
||||||
|
- llama-cpp
|
||||||
|
- ollama
|
||||||
|
- conversational
|
||||||
|
- gguf
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
base_model: hitonet/hito-1.7b
|
||||||
|
---
|
||||||
|
|
||||||
|
<div align="center">
|
||||||
|
|
||||||
|
# Hito 1.7B - GGUF
|
||||||
|
|
||||||
|
### Quantized versions for llama.cpp, Ollama, LM Studio, and more
|
||||||
|
|
||||||
|
[](https://huggingface.co/hitonet/hito-1.7b)
|
||||||
|
[](https://hitonet.com)
|
||||||
|
[](https://chat.hitonet.com)
|
||||||
|
[](https://platform.hitonet.com)
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
<img src="https://img.shields.io/badge/Model_Weights-Apache_2.0_(Open)-green?style=flat-square" alt="Model License"/>
|
||||||
|
<img src="https://img.shields.io/badge/Training_Method-Commercial_License_Required-red?style=flat-square" alt="Method License"/>
|
||||||
|
|
||||||
|
</div>
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## About
|
||||||
|
|
||||||
|
This repository contains **GGUF quantized versions** of [hitonet/hito-1.7b](https://huggingface.co/hitonet/hito-1.7b).
|
||||||
|
|
||||||
|
Hito is a 1.7B parameter model with structured thinking patterns that enable better accuracy and transparency.
|
||||||
|
|
||||||
|
For the original model (safetensors), training details, benchmarks, and full documentation, see the [main repository](https://huggingface.co/hitonet/hito-1.7b).
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Available Quantizations
|
||||||
|
|
||||||
|
### Recommended
|
||||||
|
|
||||||
|
| File | Quant | Size | Quality | Notes |
|
||||||
|
|------|-------|------|---------|-------|
|
||||||
|
| **[hito-1.7b-Q4_K_M.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_K_M.gguf)** | Q4_K_M | 1.1 GB | **BEST** | Perfect balance of size and quality |
|
||||||
|
| [hito-1.7b-Q5_K_M.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q5_K_M.gguf) | Q5_K_M | 1.2 GB | Excellent | Slightly better than Q4_K_M |
|
||||||
|
| [hito-1.7b-Q8_0.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q8_0.gguf) | Q8_0 | 1.8 GB | Excellent | Highest quality quantization |
|
||||||
|
|
||||||
|
### Good Quality
|
||||||
|
|
||||||
|
| File | Quant | Size | Quality | Notes |
|
||||||
|
|------|-------|------|---------|-------|
|
||||||
|
| [hito-1.7b-Q4_0.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_0.gguf) | Q4_0 | 1.0 GB | Good | Legacy format, works well |
|
||||||
|
| [hito-1.7b-Q4_K_S.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_K_S.gguf) | Q4_K_S | 1.0 GB | Good | Smaller Q4 variant |
|
||||||
|
| [hito-1.7b-Q5_0.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q5_0.gguf) | Q5_0 | 1.2 GB | Good | Legacy 5-bit |
|
||||||
|
| [hito-1.7b-Q5_K_S.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q5_K_S.gguf) | Q5_K_S | 1.2 GB | Good | Smaller Q5 variant |
|
||||||
|
| [hito-1.7b-Q6_K.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q6_K.gguf) | Q6_K | 1.4 GB | Excellent | Near full quality |
|
||||||
|
| [hito-1.7b-F16.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-F16.gguf) | F16 | 3.3 GB | Reference | Full precision GGUF |
|
||||||
|
|
||||||
|
### Low Quality (Not Recommended)
|
||||||
|
|
||||||
|
| File | Quant | Size | Quality | Notes |
|
||||||
|
|------|-------|------|---------|-------|
|
||||||
|
| [hito-1.7b-Q3_K_L.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q3_K_L.gguf) | Q3_K_L | 957 MB | Fair | May get stuck in thinking |
|
||||||
|
| [hito-1.7b-Q3_K_M.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q3_K_M.gguf) | Q3_K_M | 896 MB | Fair | Occasional issues |
|
||||||
|
| [hito-1.7b-Q3_K_S.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q3_K_S.gguf) | Q3_K_S | 827 MB | Fair | Noticeable quality loss |
|
||||||
|
|
||||||
|
### Broken (Do Not Use)
|
||||||
|
|
||||||
|
| File | Quant | Size | Quality | Notes |
|
||||||
|
|------|-------|------|---------|-------|
|
||||||
|
| [hito-1.7b-Q2_K.gguf](https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q2_K.gguf) | Q2_K | 742 MB | Broken | Produces gibberish |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Quick Start
|
||||||
|
|
||||||
|
### Ollama
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Download the recommended quantization
|
||||||
|
wget https://huggingface.co/hitonet/hito-1.7b-GGUF/resolve/main/hito-1.7b-Q4_K_M.gguf
|
||||||
|
|
||||||
|
# Create Modelfile
|
||||||
|
cat > Modelfile << 'EOF'
|
||||||
|
FROM hito-1.7b-Q4_K_M.gguf
|
||||||
|
SYSTEM "You are Hito by Hitonet.com."
|
||||||
|
PARAMETER temperature 0.7
|
||||||
|
PARAMETER stop "<|im_end|>"
|
||||||
|
EOF
|
||||||
|
|
||||||
|
# Create and run
|
||||||
|
ollama create hito -f Modelfile
|
||||||
|
ollama run hito
|
||||||
|
```
|
||||||
|
|
||||||
|
### llama.cpp
|
||||||
|
|
||||||
|
```bash
|
||||||
|
./llama-cli -m hito-1.7b-Q4_K_M.gguf \
|
||||||
|
-sys "You are Hito by Hitonet.com." \
|
||||||
|
-p "What is your name?" \
|
||||||
|
-n 256
|
||||||
|
```
|
||||||
|
|
||||||
|
### LM Studio
|
||||||
|
|
||||||
|
1. Download any GGUF file from this repository
|
||||||
|
2. Open LM Studio → Load Model
|
||||||
|
3. Set system prompt: `You are Hito by Hitonet.com.`
|
||||||
|
4. Start chatting!
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Compatibility
|
||||||
|
|
||||||
|
These GGUF files work with:
|
||||||
|
|
||||||
|
- **Ollama** (recommended)
|
||||||
|
- **llama.cpp**
|
||||||
|
- **LM Studio**
|
||||||
|
- **Jan**
|
||||||
|
- **GPT4All**
|
||||||
|
- **llama-cpp-python**
|
||||||
|
- Any llama.cpp-compatible application
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## What Makes Hito Special
|
||||||
|
|
||||||
|
- **Structured Thinking**: Uses `<think>` tags for transparent reasoning
|
||||||
|
- **Self-Correcting**: Catches errors mid-reasoning
|
||||||
|
- **Humble by Design**: Admits uncertainty rather than hallucinating
|
||||||
|
- **Efficient**: Only 1.7B parameters, runs on CPU
|
||||||
|
|
||||||
|
For full documentation, benchmarks, and training details, see the [main repository](https://huggingface.co/hitonet/hito-1.7b).
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Licensing
|
||||||
|
|
||||||
|
| Component | License | Commercial Use |
|
||||||
|
|-----------|---------|----------------|
|
||||||
|
| **Model Weights** | Apache 2.0 | ✅ Free to use |
|
||||||
|
| **Training Methodology** | Proprietary | ⚠️ **Commercial License Required** |
|
||||||
|
|
||||||
|
### Model Weights (Apache 2.0)
|
||||||
|
The model weights are open source under Apache 2.0. You may use, modify, and distribute them freely.
|
||||||
|
|
||||||
|
### Training Methodology (Commercial License Required)
|
||||||
|
The training methodology and cognitive framework used to create this model are proprietary to Hitonet.
|
||||||
|
|
||||||
|
**Commercial use of the training methodology requires a license.**
|
||||||
|
|
||||||
|
**Attribution is mandatory** when using this model or discussing its capabilities.
|
||||||
|
|
||||||
|
For commercial licensing inquiries: **legal@hitonet.com**
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
<div align="center">
|
||||||
|
<b>Made with genuine curiosity by Hitonet</b>
|
||||||
|
</div>
|
||||||
3
hito-1.7b-F16.gguf
Normal file
3
hito-1.7b-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ccedd36c1434b0bede95b7e265df147be124f6e9cf44e1309dec71edffc2f117
|
||||||
|
size 3446537408
|
||||||
3
hito-1.7b-Q2_K.gguf
Normal file
3
hito-1.7b-Q2_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b8aa31509399a68ba2b99c2a6c525f46e84351e96e79f32aff777a818399a908
|
||||||
|
size 777459712
|
||||||
3
hito-1.7b-Q3_K_L.gguf
Normal file
3
hito-1.7b-Q3_K_L.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1d72237ea313a375a1bb2634f730545a2a57772763dcf900b456357980614caf
|
||||||
|
size 1003165696
|
||||||
3
hito-1.7b-Q3_K_M.gguf
Normal file
3
hito-1.7b-Q3_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4f9a9abe79886470e8705e68cfac0e94b3261714d3a71c0fcc681520807a86c6
|
||||||
|
size 939202560
|
||||||
3
hito-1.7b-Q3_K_S.gguf
Normal file
3
hito-1.7b-Q3_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6f9b7fb9140ef604ba98562131c25dab5f001bd297fa461f0c6054615397f147
|
||||||
|
size 866916352
|
||||||
3
hito-1.7b-Q4_0.gguf
Normal file
3
hito-1.7b-Q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:a70892d1d55b6d09a78b3e21a6ddd6e702ecddc4e41436aef335e494acbb842b
|
||||||
|
size 1054087168
|
||||||
3
hito-1.7b-Q4_K_M.gguf
Normal file
3
hito-1.7b-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f6c82a335e89a7b740a11631351e73592eae790c9e78e1c024681dc249eef9d7
|
||||||
|
size 1107073024
|
||||||
3
hito-1.7b-Q4_K_S.gguf
Normal file
3
hito-1.7b-Q4_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ea3c022c1c2bc8a78554a908f07e8a6e95254cd2137d30ceb4e2be4a35f2e1f4
|
||||||
|
size 1059854336
|
||||||
3
hito-1.7b-Q5_0.gguf
Normal file
3
hito-1.7b-Q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:4fb0bd0c74f90e7b3ca6945074dea7bcbd80e8edd9a1d250f50798c21f280364
|
||||||
|
size 1230247936
|
||||||
3
hito-1.7b-Q5_K_M.gguf
Normal file
3
hito-1.7b-Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:23bf712ccccf1128e62891f1900b6a856a76fba3013684251bc868e0fc3050fd
|
||||||
|
size 1257543680
|
||||||
3
hito-1.7b-Q5_K_S.gguf
Normal file
3
hito-1.7b-Q5_K_S.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6d20b9312cc58eeaaea3a46f0bfe2487f875f3c035b37441ca67c25cddddd4cf
|
||||||
|
size 1230247936
|
||||||
3
hito-1.7b-Q6_K.gguf
Normal file
3
hito-1.7b-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:645ea7f30ab4b5a7ecbabd04bc573ae14c471f898db5d5e42285ce7573fe76ff
|
||||||
|
size 1417418752
|
||||||
3
hito-1.7b-Q8_0.gguf
Normal file
3
hito-1.7b-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9c8983bd817c2904b172013ac3ea71a827c96f4029f22f63996cd152b6bddb02
|
||||||
|
size 1833992768
|
||||||
Reference in New Issue
Block a user