初始化项目,由ModelHub XC社区提供模型

Model: McaTech/Nonet
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-19 04:39:18 +08:00
commit 18c41a063a
11 changed files with 155 additions and 0 deletions

9
.gitattributes vendored Normal file
View File

@@ -0,0 +1,9 @@
ChatNONET4.apk filter=lfs diff=lfs merge=lfs -text
arm64-v8a/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
armeabi-v7a/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
x86/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
x86_64/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
Precompiled_Binaries_Android/jniLibs/arm64-v8a/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
Precompiled_Binaries_Android/jniLibs/armeabi-v7a/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
Precompiled_Binaries_Android/jniLibs/x86_64/libllama_cli.so filter=lfs diff=lfs merge=lfs -text
Precompiled_Binaries_Android/jniLibs/x86/libllama_cli.so filter=lfs diff=lfs merge=lfs -text

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:94db9834ae2c4e26b54ff46cbf70dbb9685972a2bcaaf60034bcb655b8ea1984
size 144811552

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f8d4a25c675cabdbb385719173e5f7d350286942b8fd4fb2e54f499b3bd88b3b
size 1321082592

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:052a16bbff92852809dd3a822b1f412b2322ed2344b2de78bf7232911304acda
size 386405824

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d09ac1d25e5497a1e046699cd2dfc631e37f237f5fbb0301264bad750dd86e1d
size 3421898912

3
ChatNONET4.apk Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f278ffa7661b6af4ee3b66a4ea1bf36af7124fa1142c2e02792d38d3e697f1de
size 11355104

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:ebd326c43090074ddc1cd9104f50ed7a0a44fcbf7744237993de14c65d9c9263
size 31600448

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e7172346db96835584efe2f4628831a84f3e3b7191f14f0e2eff85c2abf34045
size 26663752

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20ee17daa25f80c6351505fad9f5989fe0b918b20d64766cc70856a386cf3659
size 31522288

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:20ee17daa25f80c6351505fad9f5989fe0b918b20d64766cc70856a386cf3659
size 31522288

119
README.md Normal file
View File

@@ -0,0 +1,119 @@
---
license: apache-2.0
language:
- en
library_name: llama.cpp
tags:
- gguf
- quantized
- int8
- offline-ai
- local-llm
- chatnonet
model_type: causal
inference: true
pipeline_tag: text-generation
---
# NONET
**NONET** is a family of **offline**, quantized large language models fine-tuned for **question answering** with **direct, concise answers**. Designed for local execution using `llama.cpp`, NONET is available in multiple sizes and optimized for Android or Python-based environments.
## Model Details
### Model Description
NONET is intended for lightweight offline use, particularly on local devices like mobile phones or single-board computers. The models have been **fine-tuned for direct-answer QA** and quantized to **int8 (q8_0)** using `llama.cpp`.
| Model Name | Base Model | Size |
|----------------------------------|--------------------|--------|
| ChatNONET-135m-tuned-q8_0.gguf | Smollm | 135M |
| ChatNONET-300m-tuned-q8_0.gguf | Smollm | 300M |
| ChatNONET-1B-tuned-q8_0.gguf | LLaMA 3.2 | 1B |
| ChatNONET-3B-tuned-q8_0.gguf | LLaMA 3.2 | 3B |
- **Developed by:** McaTech (Michael Cobol Agan)
- **Model type:** Causal decoder-only transformer
- **Languages:** English
- **License:** Apache 2.0
- **Finetuned from:**
- Smollm (135M, 300M variants)
- LLaMA 3.2 (1B, 3B variants)
## Uses
### Direct Use
- Offline QA chatbot
- Local assistants (no internet required)
- Embedded Android or Python apps
### Out-of-Scope Use
- Long-form text generation
- Tasks requiring real-time web access
- Creative storytelling or coding tasks
## Bias, Risks, and Limitations
NONET may reproduce biases present in its base models or fine-tuning data. Outputs should not be relied upon for sensitive or critical decisions.
### Recommendations
- Validate important responses
- Choose model size based on your device capability
- Avoid over-reliance for personal or legal advice
## How to Get Started with the Model
### For Android Devices
- Try the **Android app** in my **Github**: [Download ChatNONET APK](https://github.com/Mca-Tech/ChatNONET)
### You can also build llama.cpp your own and run it
```bash
# Clone llama.cpp and build it
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp
make
# Run the model
./llama-cli -m ./ChatNONET-300m-tuned-q8_0.gguf -p "You are ChatNONET AI assistant." -cnv
````
## Training Details
* **Finetuning Goal:** Direct-answer question answering
* **Precision:** FP16 mixed precision
* **Frameworks:** PyTorch, Transformers, Bitsandbytes
* **Quantization:** int8 GGUF (`q8_0`) via `llama.cpp`
## Evaluation
* Evaluated internally on short QA prompts
* Capable of direct factual or logical answers
* Larger models perform better on reasoning tasks
## Technical Specifications
* **Architecture:**
* Smollm (135M, 300M)
* LLaMA 3.2 (1B, 3B)
* **Format:** GGUF
* **Quantization:** q8\_0 (int8)
* **Deployment:** Mobile (Android) and desktop via `llama.cpp`
## Citation
```bibtex
@misc{chatnonet2025,
title={ChatNONET: Offline Quantized Q&A Models},
author={Michael Cobol Agan},
year={2025},
note={\url{https://huggingface.co/McaTech/Nonet}},
}
```
## Contact
* **Author:** Michael Cobol Agan (McaTech)
* **Facebook:** [FB Profile](https://www.facebook.com/michael.cobol.agan.2025/)