初始化项目，由ModelHub XC社区提供模型
Model: laabamone/laabam-ai-3b-v1-gguf Source: Original Platform
This commit is contained in:
ModelHub XC
37
.gitattributes
vendored
Normal file
37
.gitattributes
vendored
Normal file
@@ -0,0 +1,37 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
laabam-ai-3b-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
laabam-ai-3b-v1-bf16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
103
LICENSE-AGNI-COMMUNITY.md
Normal file
103
LICENSE-AGNI-COMMUNITY.md
Normal file
@@ -0,0 +1,103 @@
|
|||||||
|
# Agni Community License Agreement
|
||||||
|
## Version 1.0 — June 2026
|
||||||
|
|
||||||
|
**Copyright (c) 2026 Laabam One Business Solutions Private Limited. All rights reserved.**
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 1. Definitions
|
||||||
|
|
||||||
|
- **"Agreement"** means this Agni Community License Agreement.
|
||||||
|
- **"Licensor"** means Laabam One Business Solutions Private Limited.
|
||||||
|
- **"Model"** means the Agni model weights, parameters, and associated configuration files made available by the Licensor under this Agreement.
|
||||||
|
- **"Derivative Work"** means any model, software, or work that is based on, incorporates, or is created using the Model, including but not limited to fine-tuned versions, merged models, distilled models, and quantized versions.
|
||||||
|
- **"Output"** means any content generated by the Model or a Derivative Work.
|
||||||
|
- **"Competing Model"** means any foundation model, large language model, or similar AI system intended to compete with the Model or the Licensor's commercial offerings.
|
||||||
|
- **"You"** (or **"Your"**) means any individual or entity exercising the rights granted under this Agreement.
|
||||||
|
|
||||||
|
## 2. Grant of Rights
|
||||||
|
|
||||||
|
Subject to the terms of this Agreement, the Licensor hereby grants You a non-exclusive, worldwide, non-transferable, royalty-free license to:
|
||||||
|
|
||||||
|
a) **Use** the Model for research, personal, and commercial purposes.
|
||||||
|
|
||||||
|
b) **Modify** the Model to create Derivative Works.
|
||||||
|
|
||||||
|
c) **Distribute** the Model or Derivative Works, provided that:
|
||||||
|
- You include a copy of this Agreement with any distribution.
|
||||||
|
- You clearly state that the Derivative Work is based on Agni by Laabam One Business Solutions.
|
||||||
|
- You do not remove or alter any attribution notices.
|
||||||
|
|
||||||
|
d) **Deploy** the Model or Derivative Works in applications and services.
|
||||||
|
|
||||||
|
## 3. Restrictions
|
||||||
|
|
||||||
|
You shall NOT:
|
||||||
|
|
||||||
|
a) **Train Competing Models**: Use the Model, any Derivative Work, or any Output to develop, train, fine-tune, distill, or improve any Competing Model or foundation model, whether directly or indirectly.
|
||||||
|
|
||||||
|
b) **Remove Attribution**: Remove, obscure, or modify any copyright notices, trademarks, or attribution to Laabam One Business Solutions or the Agni brand from the Model or any Derivative Work.
|
||||||
|
|
||||||
|
c) **Misrepresent Origin**: Claim that the Model or any Derivative Work was created entirely by You without acknowledging the Agni base model.
|
||||||
|
|
||||||
|
d) **Unlawful Use**: Use the Model or any Derivative Work for any purpose that violates applicable laws, including but not limited to:
|
||||||
|
- Generating content that exploits or harms minors
|
||||||
|
- Surveillance, mass profiling, or social scoring without consent
|
||||||
|
- Generating spam, misinformation, or deceptive content at scale
|
||||||
|
- Weapons development or military applications prohibited by law
|
||||||
|
- Discrimination based on protected characteristics
|
||||||
|
|
||||||
|
e) **Exceed Usage Thresholds Without Commercial License**: If Your application or service using the Model or a Derivative Work exceeds **100 million monthly active users**, You must obtain a separate commercial license from the Licensor.
|
||||||
|
|
||||||
|
## 4. Attribution Requirements
|
||||||
|
|
||||||
|
Any distribution or deployment of the Model or Derivative Works must include:
|
||||||
|
|
||||||
|
a) The statement: **"Built with Agni by Laabam One Business Solutions"** in a reasonably prominent location (e.g., model card, about page, or documentation).
|
||||||
|
|
||||||
|
b) A link to the original Model repository on Hugging Face.
|
||||||
|
|
||||||
|
c) A copy of this License Agreement.
|
||||||
|
|
||||||
|
## 5. Intellectual Property
|
||||||
|
|
||||||
|
a) The Licensor retains all rights, title, and interest in and to the Model.
|
||||||
|
|
||||||
|
b) You retain ownership of any Derivative Works You create, subject to the terms of this Agreement.
|
||||||
|
|
||||||
|
c) Nothing in this Agreement grants You any rights to the Licensor's trademarks, service marks, or trade names, except as required for attribution.
|
||||||
|
|
||||||
|
## 6. Disclaimer of Warranty
|
||||||
|
|
||||||
|
THE MODEL IS PROVIDED "AS IS" WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, AND NON-INFRINGEMENT. THE LICENSOR DOES NOT WARRANT THAT THE MODEL WILL BE ERROR-FREE, ACCURATE, OR SUITABLE FOR ANY PARTICULAR PURPOSE.
|
||||||
|
|
||||||
|
## 7. Limitation of Liability
|
||||||
|
|
||||||
|
IN NO EVENT SHALL THE LICENSOR BE LIABLE FOR ANY INDIRECT, INCIDENTAL, SPECIAL, CONSEQUENTIAL, OR PUNITIVE DAMAGES ARISING OUT OF OR RELATED TO THE USE OF THE MODEL, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
|
||||||
|
|
||||||
|
## 8. Termination
|
||||||
|
|
||||||
|
a) This Agreement is effective until terminated.
|
||||||
|
|
||||||
|
b) Your rights under this Agreement will terminate automatically if You fail to comply with any of its terms.
|
||||||
|
|
||||||
|
c) Upon termination, You must cease all use of the Model and destroy any copies in Your possession.
|
||||||
|
|
||||||
|
## 9. Governing Law
|
||||||
|
|
||||||
|
This Agreement shall be governed by and construed in accordance with the laws of India, without regard to its conflict of law provisions. Any disputes arising under this Agreement shall be subject to the exclusive jurisdiction of the courts in Madurai, Tamil Nadu, India.
|
||||||
|
|
||||||
|
## 10. Miscellaneous
|
||||||
|
|
||||||
|
a) If any provision of this Agreement is found to be unenforceable, the remaining provisions shall remain in full force and effect.
|
||||||
|
|
||||||
|
b) This Agreement constitutes the entire agreement between the parties regarding the subject matter hereof.
|
||||||
|
|
||||||
|
c) The Licensor reserves the right to release the Model under different license terms or to stop distributing the Model at any time.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
**Laabam One Business Solutions Private Limited**
|
||||||
|
Chennai, Tamil Nadu, India
|
||||||
|
https://www.laabamone.com/
|
||||||
|
support@laabamone.com
|
||||||
179
README.md
Normal file
179
README.md
Normal file
@@ -0,0 +1,179 @@
|
|||||||
|
---
|
||||||
|
license: other
|
||||||
|
license_name: agni-community
|
||||||
|
license_link: https://huggingface.co/laabamone/laabam-ai-3b-v1-gguf/blob/main/LICENSE-AGNI-COMMUNITY.md
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
- hi
|
||||||
|
- te
|
||||||
|
- kn
|
||||||
|
- ta
|
||||||
|
library_name: gguf
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
tags:
|
||||||
|
- agni
|
||||||
|
- agni-lite
|
||||||
|
- laabam-ai
|
||||||
|
- multilingual
|
||||||
|
- indic
|
||||||
|
- llama-cpp
|
||||||
|
- quantized
|
||||||
|
- conversational
|
||||||
|
- code
|
||||||
|
- tamil
|
||||||
|
- hindi
|
||||||
|
- telugu
|
||||||
|
- kannada
|
||||||
|
base_model:
|
||||||
|
- Qwen/Qwen2.5-3B-Instruct
|
||||||
|
---
|
||||||
|
|
||||||
|
<div align="center">
|
||||||
|
|
||||||
|
# 🔥 Agni Lite 3B v1 — GGUF
|
||||||
|
|
||||||
|
### Quantized for Ollama, llama.cpp, and LM Studio
|
||||||
|
|
||||||
|
**Run Agni on your laptop, phone, or edge device**
|
||||||
|
|
||||||
|
[Full Model (Safetensors)](https://huggingface.co/laabamone/laabam-ai-3b-v1) • [LoRA Adapter](https://huggingface.co/laabamone/laabam-ai-3b-v1-lora) • [Website](https://www.laabamone.com/)
|
||||||
|
|
||||||
|
</div>
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Available Files
|
||||||
|
|
||||||
|
| File | Quantization | Size | Description | Recommendation |
|
||||||
|
|------|-------------|------|-------------|----------------|
|
||||||
|
| `laabam-ai-3b-v1-Q4_K_M.gguf` | Q4_K_M | 1.8 GB | 4-bit quantized (medium) | ✅ **Recommended** — best balance |
|
||||||
|
| `laabam-ai-3b-v1-bf16.gguf` | BF16 | 5.8 GB | Full precision | Maximum quality, needs 8GB+ RAM |
|
||||||
|
|
||||||
|
### Which file should I use?
|
||||||
|
|
||||||
|
- **Q4_K_M (1.8 GB)** — Best for most users. Runs on 4GB+ RAM. Minimal quality loss.
|
||||||
|
- **BF16 (5.8 GB)** — Full precision. Use when you need maximum accuracy.
|
||||||
|
|
||||||
|
## Quick Start
|
||||||
|
|
||||||
|
### Ollama
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Download the model
|
||||||
|
huggingface-cli download laabamone/laabam-ai-3b-v1-gguf \
|
||||||
|
laabam-ai-3b-v1-Q4_K_M.gguf --local-dir .
|
||||||
|
|
||||||
|
# Create a Modelfile
|
||||||
|
cat > Modelfile << 'EOF'
|
||||||
|
FROM ./laabam-ai-3b-v1-Q4_K_M.gguf
|
||||||
|
|
||||||
|
TEMPLATE """<|im_start|>system
|
||||||
|
{{ .System }}<|im_end|>
|
||||||
|
<|im_start|>user
|
||||||
|
{{ .Prompt }}<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
"""
|
||||||
|
|
||||||
|
SYSTEM "You are Agni, a helpful multilingual AI assistant created by Laabam One Business Solutions. You support Hindi, Tamil, Telugu, Kannada, and English."
|
||||||
|
|
||||||
|
PARAMETER temperature 0.7
|
||||||
|
PARAMETER top_p 0.9
|
||||||
|
PARAMETER stop "<|im_end|>"
|
||||||
|
EOF
|
||||||
|
|
||||||
|
# Create and run
|
||||||
|
ollama create agni-lite -f Modelfile
|
||||||
|
ollama run agni-lite "Write hello world in Python"
|
||||||
|
```
|
||||||
|
|
||||||
|
### llama.cpp
|
||||||
|
|
||||||
|
```bash
|
||||||
|
./llama-cli -m laabam-ai-3b-v1-Q4_K_M.gguf \
|
||||||
|
-p "You are Agni, a helpful assistant.\n\nUser: Tell me about Tamil Nadu.\nAssistant:" \
|
||||||
|
-n 256 --temp 0.7
|
||||||
|
```
|
||||||
|
|
||||||
|
### LM Studio
|
||||||
|
|
||||||
|
1. Download `laabam-ai-3b-v1-Q4_K_M.gguf`
|
||||||
|
2. Place in your LM Studio models directory
|
||||||
|
3. Load and chat
|
||||||
|
|
||||||
|
### Python (llama-cpp-python)
|
||||||
|
|
||||||
|
```python
|
||||||
|
from llama_cpp import Llama
|
||||||
|
|
||||||
|
llm = Llama(
|
||||||
|
model_path="laabam-ai-3b-v1-Q4_K_M.gguf",
|
||||||
|
n_ctx=1024,
|
||||||
|
n_threads=8,
|
||||||
|
)
|
||||||
|
|
||||||
|
output = llm.create_chat_completion(messages=[
|
||||||
|
{"role": "system", "content": "You are Agni, a helpful multilingual AI assistant."},
|
||||||
|
{"role": "user", "content": "भारत के बारे में बताओ।"}
|
||||||
|
])
|
||||||
|
|
||||||
|
print(output["choices"][0]["message"]["content"])
|
||||||
|
```
|
||||||
|
|
||||||
|
### Tamil Example
|
||||||
|
|
||||||
|
```python
|
||||||
|
output = llm.create_chat_completion(messages=[
|
||||||
|
{"role": "system", "content": "நீங்கள் அக்னி AI. தமிழில் பதிலளிக்கவும்."},
|
||||||
|
{"role": "user", "content": "சிலப்பதிகாரம் பற்றி சொல்லுங்கள்."}
|
||||||
|
])
|
||||||
|
print(output["choices"][0]["message"]["content"])
|
||||||
|
```
|
||||||
|
|
||||||
|
## Model Details
|
||||||
|
|
||||||
|
| Detail | Value |
|
||||||
|
|--------|-------|
|
||||||
|
| **Model Name** | Agni Lite 3B v1 |
|
||||||
|
| **Developer** | Laabam One Business Solutions Pvt Ltd |
|
||||||
|
| **Architecture** | Qwen2.5 (3B parameters) |
|
||||||
|
| **Training Method** | QLoRA (r=16, alpha=32, 4-bit NF4) with Unsloth |
|
||||||
|
| **Training Data** | ~98,000 curated multilingual samples |
|
||||||
|
| **Quantization Tool** | llama.cpp (convert + quantize) |
|
||||||
|
| **License** | [Agni Community License](LICENSE-AGNI-COMMUNITY.md) |
|
||||||
|
|
||||||
|
## Capabilities
|
||||||
|
|
||||||
|
- 🇮🇳 **Indian Languages** — Native Hindi, Tamil, Telugu, Kannada support
|
||||||
|
- 💻 **Coding** — Python, JavaScript, Bash, SQL, and more
|
||||||
|
- 🧠 **Reasoning** — Math, logic, and step-by-step problem solving
|
||||||
|
- 🤖 **Agentic** — Function calling and tool use
|
||||||
|
- 🏢 **Business** — Customer support, ERP, and automation
|
||||||
|
|
||||||
|
## Limitations
|
||||||
|
|
||||||
|
- 3B parameter model — may struggle with very complex multi-step reasoning
|
||||||
|
- Quantized versions have slight quality reduction vs full-precision
|
||||||
|
- Indian language quality is improving; English is currently stronger
|
||||||
|
- May generate incorrect or fabricated information
|
||||||
|
- Not a substitute for professional medical, legal, or financial advice
|
||||||
|
|
||||||
|
## Citation
|
||||||
|
|
||||||
|
```bibtex
|
||||||
|
@misc{agni-lite-3b-v1-gguf,
|
||||||
|
title={Agni Lite 3B v1: India's Multilingual AI Assistant (GGUF)},
|
||||||
|
author={Laabam One Business Solutions Pvt Ltd},
|
||||||
|
year={2026},
|
||||||
|
url={https://huggingface.co/laabamone/laabam-ai-3b-v1-gguf}
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
<div align="center">
|
||||||
|
|
||||||
|
Built with 🔥 in India by [Laabam One Business Solutions Pvt Ltd](https://www.laabamone.com/)
|
||||||
|
|
||||||
|
[Website](https://www.laabamone.com/) • [Contact](mailto:support@laabamone.com)
|
||||||
|
|
||||||
|
</div>
|
||||||
3
laabam-ai-3b-v1-Q4_K_M.gguf
Normal file
3
laabam-ai-3b-v1-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:fbdb087187e062d0f6e3983254f9808f03b6267380bd48edc742937a0c672191
|
||||||
|
size 1929902368
|
||||||
3
laabam-ai-3b-v1-bf16.gguf
Normal file
3
laabam-ai-3b-v1-bf16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:db6417580e9c8aae1369fecfacb0590f09a7c17c01a44e24c5ac11306dbc84d8
|
||||||
|
size 6178316576
|
||||||
Reference in New Issue
Block a user