初始化项目,由ModelHub XC社区提供模型

Model: vibhansh/Veda-8B-v1-Cognitive
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-08-29 14:48:17 +08:00
commit 3cf3e74868
9 changed files with 212 additions and 0 deletions

41
.gitattributes vendored Normal file
View File

@@ -0,0 +1,41 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Veda-8B-v1-MASTER.gguf filter=lfs diff=lfs merge=lfs -text
Veda-8B-v1-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Veda-8B-v1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Veda-8B-v1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
Veda-8B-v1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Veda-8B-v1.gguf filter=lfs diff=lfs merge=lfs -text

137
README.md Normal file
View File

@@ -0,0 +1,137 @@
---
language:
- en
license: llama3
tags:
- llama
- coding
- reasoning
- logic
- gguf
base_model: meta-llama/Meta-Llama-3-8B-Instruct
pipeline_tag: text-generation
---
<div align="center">
# 💠 VEDA-8B-v1-COGNITIVE
### *Fine-tuned to think. Not just predict.*
![](https://img.shields.io/badge/Base-Llama--3--8B-blue?style=for-the-badge)
![](https://img.shields.io/badge/Method-LoRA-green?style=for-the-badge)
![](https://img.shields.io/badge/Format-GGUF-orange?style=for-the-badge)
![](https://img.shields.io/badge/Context-8192_tokens-purple?style=for-the-badge)
**By Vibhansh Bamnia · 18 · Independent AI Developer · Rajasthan, India**
[🚀 Try Demo](https://huggingface.co/spaces/vibhansh/Veda-Chat) · [📥 Download Model](#-quantization)
</div>
---
## ⚡ Why Veda-8B?
> Most 8B models pattern-match. Veda-8B **reasons.**
LoRA fine-tuned on open-source reasoning datasets — built specifically to solve where standard Llama-3 fails.
| Capability | Standard Llama-3-8B | Veda-8B-v1 |
|---|:---:|:---:|
| Relational Chain Reasoning | ⚠️ Often fails | ✅ Reliable |
| Multi-hop Logic | ⚠️ Inconsistent | ✅ Strong |
| Code Hallucination | ❌ Common | ✅ Reduced |
| Chain-of-Thought | ⚠️ Partial | ✅ Complete |
---
## 🧠 See It In Action
<details>
<summary><b>🔗 Relational Reasoning</b></summary>
**Prompt:** `A is B's father. C is A's sister. D is C's son. What is D's relation to B?`
**Veda-8B:**
```
A is B's father → C is B's aunt → D is C's son
∴ D is B's cousin.
```
</details>
<details>
<summary><b>🔣 Logic Syllogism</b></summary>
**Prompt:** `All Bloops are Razzies. All Razzies are Lazzies. Are all Bloops Lazzies?`
**Veda-8B:**
```
Bloops ⊆ Razzies ⊆ Lazzies
∴ Yes — by transitivity, all Bloops are definitely Lazzies.
```
</details>
<details>
<summary><b>💻 Code (No Hallucination)</b></summary>
**Prompt:** `Second largest unique number without sort()`
**Veda-8B:**
```python
def second_largest(nums):
unique = set(nums)
if len(unique) < 2:
return None
first = second = float('-inf')
for n in unique:
if n > first:
second, first = first, n
elif n > second:
second = n
return second
```
</details>
---
## 💎 Quantization
| Version | Size | RAM | Use |
|:---:|:---:|:---:|:---|
| 🥇 Q4_K_M | 4.92 GB | 8 GB | Local dev, edge |
| 🥈 Q8_0 | 8.54 GB | 16 GB | Production |
| 🔬 F16 | 16 GB+ | 32 GB | Research |
---
## 💻 Quick Start
```python
import llama_cpp
llm = llama_cpp.Llama(model_path="./Veda-8B-v1-Q4_K_M.gguf", n_ctx=8192, n_threads=4)
response = llm("A is taller than B. B is taller than C. Is A taller than C?",
max_tokens=512, temperature=0.1)
```
---
## ⚠️ Limitations
- Inherits Llama-3-8B base limitations
- Not for real-time / factual queries
- Verify math-heavy outputs
- Multilingual not tested
---
<div align="center">
*No institution. No GPU cluster. No team.*
*Just a focused fine-tune built to make small models reason correctly.*
**Veda AI Labs** · [HuggingFace](https://huggingface.co/vibhansh)
</div>

3
Veda-8B-v1-IQ4_XS.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1ed27af2cb3a7b8a3a8a14ae7bdee7a28a3190bda5a0de35ea2c6e1c6aa7f2ed
size 4484367744

3
Veda-8B-v1-MASTER.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c948d8046211dc13a5a10fbe1102921ad8c028fc92cd72f1c7b853d9ad1a623a
size 16068896160

3
Veda-8B-v1-Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1741d1ad299a0740d5b601311871b107e786fc058c63f8feb3586224b3b75652
size 4018922880

3
Veda-8B-v1-Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c29a8b516f2391ea081755d93a601b3e0e0aaacfd9766f4b53e92b3281d47bd7
size 4920739200

3
Veda-8B-v1-Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:40036669867f46dbd5f785945f89edbf86f79f8055eda976ce10688d0ad59d23
size 8540775808

3
Veda-8B-v1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:c948d8046211dc13a5a10fbe1102921ad8c028fc92cd72f1c7b853d9ad1a623a
size 16068896160

16
config.json Normal file
View File

@@ -0,0 +1,16 @@
{
"architectures": [
"LlamaForCausalLM"
],
"model_type": "llama",
"num_hidden_layers": 32,
"hidden_size": 4096,
"intermediate_size": 14336,
"num_attention_heads": 32,
"num_key_value_heads": 8,
"torch_dtype": "bfloat16",
"vocab_size": 128256,
"rms_norm_eps": 1e-05,
"rope_theta": 500000.0,
"max_position_embeddings": 131072
}