初始化项目,由ModelHub XC社区提供模型
Model: McaTech/Nonet Source: Original Platform
This commit is contained in:
9
.gitattributes
vendored
Normal file
9
.gitattributes
vendored
Normal file
@@ -0,0 +1,9 @@
|
||||
ChatNONET4.apk filter=lfs diff=lfs merge=lfs -text
|
||||
arm64-v8a/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
|
||||
armeabi-v7a/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
|
||||
x86/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
|
||||
x86_64/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
|
||||
Precompiled_Binaries_Android/jniLibs/arm64-v8a/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
|
||||
Precompiled_Binaries_Android/jniLibs/armeabi-v7a/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
|
||||
Precompiled_Binaries_Android/jniLibs/x86_64/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
|
||||
Precompiled_Binaries_Android/jniLibs/x86/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
|
||||
3
ChatNONET-135m-tuned-q8_0.gguf
Normal file
3
ChatNONET-135m-tuned-q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:94db9834ae2c4e26b54ff46cbf70dbb9685972a2bcaaf60034bcb655b8ea1984
|
||||
size 144811552
|
||||
3
ChatNONET-1B-tuned-q8_0.gguf
Normal file
3
ChatNONET-1B-tuned-q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f8d4a25c675cabdbb385719173e5f7d350286942b8fd4fb2e54f499b3bd88b3b
|
||||
size 1321082592
|
||||
3
ChatNONET-300m-tuned-q8_0.gguf
Normal file
3
ChatNONET-300m-tuned-q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:052a16bbff92852809dd3a822b1f412b2322ed2344b2de78bf7232911304acda
|
||||
size 386405824
|
||||
3
ChatNONET-3B-tuned-q8_0.gguf
Normal file
3
ChatNONET-3B-tuned-q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d09ac1d25e5497a1e046699cd2dfc631e37f237f5fbb0301264bad750dd86e1d
|
||||
size 3421898912
|
||||
3
ChatNONET4.apk
Normal file
3
ChatNONET4.apk
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f278ffa7661b6af4ee3b66a4ea1bf36af7124fa1142c2e02792d38d3e697f1de
|
||||
size 11355104
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ebd326c43090074ddc1cd9104f50ed7a0a44fcbf7744237993de14c65d9c9263
|
||||
size 31600448
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e7172346db96835584efe2f4628831a84f3e3b7191f14f0e2eff85c2abf34045
|
||||
size 26663752
|
||||
3
Precompiled_Binaries_Android/jniLibs/x86/libllama_cli.so
Normal file
3
Precompiled_Binaries_Android/jniLibs/x86/libllama_cli.so
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:20ee17daa25f80c6351505fad9f5989fe0b918b20d64766cc70856a386cf3659
|
||||
size 31522288
|
||||
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:20ee17daa25f80c6351505fad9f5989fe0b918b20d64766cc70856a386cf3659
|
||||
size 31522288
|
||||
119
README.md
Normal file
119
README.md
Normal file
@@ -0,0 +1,119 @@
|
||||
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
library_name: llama.cpp
|
||||
tags:
|
||||
- gguf
|
||||
- quantized
|
||||
- int8
|
||||
- offline-ai
|
||||
- local-llm
|
||||
- chatnonet
|
||||
model_type: causal
|
||||
inference: true
|
||||
pipeline_tag: text-generation
|
||||
---
|
||||
|
||||
# NONET
|
||||
|
||||
**NONET** is a family of **offline**, quantized large language models fine-tuned for **question answering** with **direct, concise answers**. Designed for local execution using `llama.cpp`, NONET is available in multiple sizes and optimized for Android or Python-based environments.
|
||||
|
||||
## Model Details
|
||||
|
||||
### Model Description
|
||||
|
||||
NONET is intended for lightweight offline use, particularly on local devices like mobile phones or single-board computers. The models have been **fine-tuned for direct-answer QA** and quantized to **int8 (q8_0)** using `llama.cpp`.
|
||||
|
||||
| Model Name | Base Model | Size |
|
||||
|----------------------------------|--------------------|--------|
|
||||
| ChatNONET-135m-tuned-q8_0.gguf | Smollm | 135M |
|
||||
| ChatNONET-300m-tuned-q8_0.gguf | Smollm | 300M |
|
||||
| ChatNONET-1B-tuned-q8_0.gguf | LLaMA 3.2 | 1B |
|
||||
| ChatNONET-3B-tuned-q8_0.gguf | LLaMA 3.2 | 3B |
|
||||
|
||||
- **Developed by:** McaTech (Michael Cobol Agan)
|
||||
- **Model type:** Causal decoder-only transformer
|
||||
- **Languages:** English
|
||||
- **License:** Apache 2.0
|
||||
- **Finetuned from:**
|
||||
- Smollm (135M, 300M variants)
|
||||
- LLaMA 3.2 (1B, 3B variants)
|
||||
|
||||
## Uses
|
||||
|
||||
### Direct Use
|
||||
|
||||
- Offline QA chatbot
|
||||
- Local assistants (no internet required)
|
||||
- Embedded Android or Python apps
|
||||
|
||||
### Out-of-Scope Use
|
||||
|
||||
- Long-form text generation
|
||||
- Tasks requiring real-time web access
|
||||
- Creative storytelling or coding tasks
|
||||
|
||||
## Bias, Risks, and Limitations
|
||||
|
||||
NONET may reproduce biases present in its base models or fine-tuning data. Outputs should not be relied upon for sensitive or critical decisions.
|
||||
|
||||
### Recommendations
|
||||
|
||||
- Validate important responses
|
||||
- Choose model size based on your device capability
|
||||
- Avoid over-reliance for personal or legal advice
|
||||
|
||||
## How to Get Started with the Model
|
||||
### For Android Devices
|
||||
- Try the **Android app** in my **Github**: [Download ChatNONET APK](https://github.com/Mca-Tech/ChatNONET)
|
||||
### You can also build llama.cpp your own and run it
|
||||
```bash
|
||||
# Clone llama.cpp and build it
|
||||
git clone https://github.com/ggerganov/llama.cpp
|
||||
cd llama.cpp
|
||||
make
|
||||
|
||||
# Run the model
|
||||
./llama-cli -m ./ChatNONET-300m-tuned-q8_0.gguf -p "You are ChatNONET AI assistant." -cnv
|
||||
````
|
||||
|
||||
## Training Details
|
||||
|
||||
* **Finetuning Goal:** Direct-answer question answering
|
||||
* **Precision:** FP16 mixed precision
|
||||
* **Frameworks:** PyTorch, Transformers, Bitsandbytes
|
||||
* **Quantization:** int8 GGUF (`q8_0`) via `llama.cpp`
|
||||
|
||||
## Evaluation
|
||||
|
||||
* Evaluated internally on short QA prompts
|
||||
* Capable of direct factual or logical answers
|
||||
* Larger models perform better on reasoning tasks
|
||||
|
||||
## Technical Specifications
|
||||
|
||||
* **Architecture:**
|
||||
|
||||
* Smollm (135M, 300M)
|
||||
* LLaMA 3.2 (1B, 3B)
|
||||
* **Format:** GGUF
|
||||
* **Quantization:** q8\_0 (int8)
|
||||
* **Deployment:** Mobile (Android) and desktop via `llama.cpp`
|
||||
|
||||
## Citation
|
||||
|
||||
```bibtex
|
||||
@misc{chatnonet2025,
|
||||
title={ChatNONET: Offline Quantized Q&A Models},
|
||||
author={Michael Cobol Agan},
|
||||
year={2025},
|
||||
note={\url{https://huggingface.co/McaTech/Nonet}},
|
||||
}
|
||||
```
|
||||
|
||||
## Contact
|
||||
|
||||
* **Author:** Michael Cobol Agan (McaTech)
|
||||
* **Facebook:** [FB Profile](https://www.facebook.com/michael.cobol.agan.2025/)
|
||||
Reference in New Issue
Block a user