初始化项目,由ModelHub XC社区提供模型
Model: PraneetNS/EduMentor-Qwen3-4B-v2-GGUF Source: Original Platform
This commit is contained in:
39
.gitattributes
vendored
Normal file
39
.gitattributes
vendored
Normal file
@@ -0,0 +1,39 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
edumentor-v2-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
edumentor-v2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
edumentor-v2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
edumentor-v2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
169
README.md
Normal file
169
README.md
Normal file
@@ -0,0 +1,169 @@
|
|||||||
|
---
|
||||||
|
license: apache-2.0
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
library_name: llama.cpp
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
base_model: PraneetNS/EduMentor-Qwen3-4B-v2-FP16
|
||||||
|
tags:
|
||||||
|
- gguf
|
||||||
|
- llama.cpp
|
||||||
|
- qwen3
|
||||||
|
- engineering
|
||||||
|
- education
|
||||||
|
- mentor
|
||||||
|
- conversational
|
||||||
|
- ai
|
||||||
|
---
|
||||||
|
|
||||||
|
# EduMentor Qwen3 4B v2 (GGUF)
|
||||||
|
|
||||||
|
This repository contains GGUF quantized versions of **EduMentor Qwen3 4B v2**, an AI engineering mentor designed for university students, technical learning, coding assistance, project guidance, and placement preparation.
|
||||||
|
|
||||||
|
These models are converted from the merged FP16 checkpoint and optimized for inference with **llama.cpp**, **LM Studio**, **Ollama (GGUF import)**, **Open WebUI**, **Jan**, and other GGUF-compatible runtimes.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Base Model
|
||||||
|
|
||||||
|
**FP16 Repository**
|
||||||
|
|
||||||
|
https://huggingface.co/PraneetNS/EduMentor-Qwen3-4B-v2-FP16
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Available Quantizations
|
||||||
|
|
||||||
|
| File | Size | Recommended For |
|
||||||
|
|------|------:|-----------------|
|
||||||
|
| EduMentor-Qwen3-4B-v2-F16.gguf | ~7.5 GB | Maximum quality |
|
||||||
|
| EduMentor-Qwen3-4B-v2-Q8_0.gguf | ~4.0 GB | Near-FP16 quality |
|
||||||
|
| EduMentor-Qwen3-4B-v2-Q6_K.gguf | ~3.1 GB | Best balance of quality and speed |
|
||||||
|
| EduMentor-Qwen3-4B-v2-Q4_K_M.gguf | ~2.4 GB | Fast local inference |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Features
|
||||||
|
|
||||||
|
EduMentor v2 is fine-tuned for engineering education and technical mentoring.
|
||||||
|
|
||||||
|
It supports:
|
||||||
|
|
||||||
|
- Programming Fundamentals
|
||||||
|
- Data Structures & Algorithms
|
||||||
|
- System Design
|
||||||
|
- Machine Learning
|
||||||
|
- Deep Learning
|
||||||
|
- Large Language Models
|
||||||
|
- Electronics
|
||||||
|
- Electrical Engineering
|
||||||
|
- Mechanical Engineering
|
||||||
|
- Civil Engineering
|
||||||
|
- Mathematics
|
||||||
|
- Resume Reviews
|
||||||
|
- Internship Preparation
|
||||||
|
- Placement Preparation
|
||||||
|
- Interview Guidance
|
||||||
|
- Project Mentoring
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Response Format
|
||||||
|
|
||||||
|
EduMentor is optimized for multimodal tutoring systems.
|
||||||
|
|
||||||
|
Typical responses follow the structure:
|
||||||
|
|
||||||
|
```json
|
||||||
|
{
|
||||||
|
"speech": "...",
|
||||||
|
"display": {
|
||||||
|
"type": "code | notes | roadmap | table | diagram",
|
||||||
|
"content": "..."
|
||||||
|
},
|
||||||
|
"follow_up": "..."
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
This enables voice assistants to speak only natural explanations while rendering code, diagrams, or notes separately.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Example
|
||||||
|
|
||||||
|
### User
|
||||||
|
|
||||||
|
Explain Binary Search.
|
||||||
|
|
||||||
|
### Assistant
|
||||||
|
|
||||||
|
```json
|
||||||
|
{
|
||||||
|
"speech": "Binary Search repeatedly divides the search interval in half, making it much faster than linear search on sorted arrays.",
|
||||||
|
|
||||||
|
"display": {
|
||||||
|
"type": "code",
|
||||||
|
"language": "python",
|
||||||
|
"content": "def binary_search(...): ..."
|
||||||
|
},
|
||||||
|
|
||||||
|
"follow_up": "Would you like to understand its time complexity?"
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Running with llama.cpp
|
||||||
|
|
||||||
|
```bash
|
||||||
|
./llama-cli \
|
||||||
|
-m EduMentor-Qwen3-4B-v2-Q4_K_M.gguf \
|
||||||
|
-c 4096 \
|
||||||
|
-p "Explain recursion simply."
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Recommended Quantization
|
||||||
|
|
||||||
|
| Hardware | Recommendation |
|
||||||
|
|-----------|---------------|
|
||||||
|
| 8 GB RAM | Q4_K_M |
|
||||||
|
| 16 GB RAM | Q6_K |
|
||||||
|
| 24 GB+ RAM | Q8_0 |
|
||||||
|
| GPU Servers | F16 |
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Limitations
|
||||||
|
|
||||||
|
EduMentor may occasionally:
|
||||||
|
|
||||||
|
- produce incorrect technical information
|
||||||
|
- require verification for safety-critical engineering tasks
|
||||||
|
- generate imperfect JSON formatting for complex prompts
|
||||||
|
- benefit from retrieval augmentation for rapidly changing topics
|
||||||
|
|
||||||
|
The model should not replace professional engineering advice.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Training
|
||||||
|
|
||||||
|
Base Architecture:
|
||||||
|
|
||||||
|
- Qwen3-4B
|
||||||
|
|
||||||
|
Fine-tuning:
|
||||||
|
|
||||||
|
- Supervised Fine-Tuning (LoRA)
|
||||||
|
- Fully merged into FP16
|
||||||
|
- Converted to GGUF using llama.cpp
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Creator
|
||||||
|
|
||||||
|
**Praneet N S**
|
||||||
|
|
||||||
|
EduMentor is an ongoing effort to build an AI mentor capable of providing high-quality engineering education through natural conversations and voice-first tutoring systems.
|
||||||
3
edumentor-v2-Q4_K_M.gguf
Normal file
3
edumentor-v2-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:190dc7aa1d97c774dd080651724cac299669dd49edff5c26bb003e4833823cde
|
||||||
|
size 2497280800
|
||||||
3
edumentor-v2-Q6_K.gguf
Normal file
3
edumentor-v2-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e5760601197ccdecc3ad47bb1bf1916c05f6c8bb42ced3397c61e9157ce3bf50
|
||||||
|
size 3306261280
|
||||||
3
edumentor-v2-Q8_0.gguf
Normal file
3
edumentor-v2-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:efe3ea5169bd64b7f4324e0451d15d1e032ed179140a6561bc4bc1bb5ae578c8
|
||||||
|
size 4280405280
|
||||||
3
edumentor-v2-f16.gguf
Normal file
3
edumentor-v2-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:6f907a2c4450e052d97eeaec0b54e0bb8feba3be33ead61f0ab51da2504c58f6
|
||||||
|
size 8051285280
|
||||||
Reference in New Issue
Block a user