初始化项目，由ModelHub XC社区提供模型
Model: PraneetNS/EduMentor-Qwen3-4B-v2-GGUF Source: Original Platform
This commit is contained in:
ModelHub XC
39
.gitattributes
vendored
Normal file
39
.gitattributes
vendored
Normal file
@@ -0,0 +1,39 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
edumentor-v2-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
edumentor-v2-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
edumentor-v2-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
edumentor-v2-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
169
README.md
Normal file
169
README.md
Normal file
@@ -0,0 +1,169 @@
|
||||
---
|
||||
license: apache-2.0
|
||||
language:
|
||||
- en
|
||||
library_name: llama.cpp
|
||||
pipeline_tag: text-generation
|
||||
base_model: PraneetNS/EduMentor-Qwen3-4B-v2-FP16
|
||||
tags:
|
||||
- gguf
|
||||
- llama.cpp
|
||||
- qwen3
|
||||
- engineering
|
||||
- education
|
||||
- mentor
|
||||
- conversational
|
||||
- ai
|
||||
---
|
||||
|
||||
# EduMentor Qwen3 4B v2 (GGUF)
|
||||
|
||||
This repository contains GGUF quantized versions of **EduMentor Qwen3 4B v2**, an AI engineering mentor designed for university students, technical learning, coding assistance, project guidance, and placement preparation.
|
||||
|
||||
These models are converted from the merged FP16 checkpoint and optimized for inference with **llama.cpp**, **LM Studio**, **Ollama (GGUF import)**, **Open WebUI**, **Jan**, and other GGUF-compatible runtimes.
|
||||
|
||||
---
|
||||
|
||||
# Base Model
|
||||
|
||||
**FP16 Repository**
|
||||
|
||||
https://huggingface.co/PraneetNS/EduMentor-Qwen3-4B-v2-FP16
|
||||
|
||||
---
|
||||
|
||||
# Available Quantizations
|
||||
|
||||
| File | Size | Recommended For |
|
||||
|------|------:|-----------------|
|
||||
| EduMentor-Qwen3-4B-v2-F16.gguf | ~7.5 GB | Maximum quality |
|
||||
| EduMentor-Qwen3-4B-v2-Q8_0.gguf | ~4.0 GB | Near-FP16 quality |
|
||||
| EduMentor-Qwen3-4B-v2-Q6_K.gguf | ~3.1 GB | Best balance of quality and speed |
|
||||
| EduMentor-Qwen3-4B-v2-Q4_K_M.gguf | ~2.4 GB | Fast local inference |
|
||||
|
||||
---
|
||||
|
||||
# Features
|
||||
|
||||
EduMentor v2 is fine-tuned for engineering education and technical mentoring.
|
||||
|
||||
It supports:
|
||||
|
||||
- Programming Fundamentals
|
||||
- Data Structures & Algorithms
|
||||
- System Design
|
||||
- Machine Learning
|
||||
- Deep Learning
|
||||
- Large Language Models
|
||||
- Electronics
|
||||
- Electrical Engineering
|
||||
- Mechanical Engineering
|
||||
- Civil Engineering
|
||||
- Mathematics
|
||||
- Resume Reviews
|
||||
- Internship Preparation
|
||||
- Placement Preparation
|
||||
- Interview Guidance
|
||||
- Project Mentoring
|
||||
|
||||
---
|
||||
|
||||
# Response Format
|
||||
|
||||
EduMentor is optimized for multimodal tutoring systems.
|
||||
|
||||
Typical responses follow the structure:
|
||||
|
||||
```json
|
||||
{
|
||||
"speech": "...",
|
||||
"display": {
|
||||
"type": "code | notes | roadmap | table | diagram",
|
||||
"content": "..."
|
||||
},
|
||||
"follow_up": "..."
|
||||
}
|
||||
```
|
||||
|
||||
This enables voice assistants to speak only natural explanations while rendering code, diagrams, or notes separately.
|
||||
|
||||
---
|
||||
|
||||
# Example
|
||||
|
||||
### User
|
||||
|
||||
Explain Binary Search.
|
||||
|
||||
### Assistant
|
||||
|
||||
```json
|
||||
{
|
||||
"speech": "Binary Search repeatedly divides the search interval in half, making it much faster than linear search on sorted arrays.",
|
||||
|
||||
"display": {
|
||||
"type": "code",
|
||||
"language": "python",
|
||||
"content": "def binary_search(...): ..."
|
||||
},
|
||||
|
||||
"follow_up": "Would you like to understand its time complexity?"
|
||||
}
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
# Running with llama.cpp
|
||||
|
||||
```bash
|
||||
./llama-cli \
|
||||
-m EduMentor-Qwen3-4B-v2-Q4_K_M.gguf \
|
||||
-c 4096 \
|
||||
-p "Explain recursion simply."
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
# Recommended Quantization
|
||||
|
||||
| Hardware | Recommendation |
|
||||
|-----------|---------------|
|
||||
| 8 GB RAM | Q4_K_M |
|
||||
| 16 GB RAM | Q6_K |
|
||||
| 24 GB+ RAM | Q8_0 |
|
||||
| GPU Servers | F16 |
|
||||
|
||||
---
|
||||
|
||||
# Limitations
|
||||
|
||||
EduMentor may occasionally:
|
||||
|
||||
- produce incorrect technical information
|
||||
- require verification for safety-critical engineering tasks
|
||||
- generate imperfect JSON formatting for complex prompts
|
||||
- benefit from retrieval augmentation for rapidly changing topics
|
||||
|
||||
The model should not replace professional engineering advice.
|
||||
|
||||
---
|
||||
|
||||
# Training
|
||||
|
||||
Base Architecture:
|
||||
|
||||
- Qwen3-4B
|
||||
|
||||
Fine-tuning:
|
||||
|
||||
- Supervised Fine-Tuning (LoRA)
|
||||
- Fully merged into FP16
|
||||
- Converted to GGUF using llama.cpp
|
||||
|
||||
---
|
||||
|
||||
# Creator
|
||||
|
||||
**Praneet N S**
|
||||
|
||||
EduMentor is an ongoing effort to build an AI mentor capable of providing high-quality engineering education through natural conversations and voice-first tutoring systems.
|
||||
3
edumentor-v2-Q4_K_M.gguf
Normal file
3
edumentor-v2-Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:190dc7aa1d97c774dd080651724cac299669dd49edff5c26bb003e4833823cde
|
||||
size 2497280800
|
||||
3
edumentor-v2-Q6_K.gguf
Normal file
3
edumentor-v2-Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e5760601197ccdecc3ad47bb1bf1916c05f6c8bb42ced3397c61e9157ce3bf50
|
||||
size 3306261280
|
||||
3
edumentor-v2-Q8_0.gguf
Normal file
3
edumentor-v2-Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:efe3ea5169bd64b7f4324e0451d15d1e032ed179140a6561bc4bc1bb5ae578c8
|
||||
size 4280405280
|
||||
3
edumentor-v2-f16.gguf
Normal file
3
edumentor-v2-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6f907a2c4450e052d97eeaec0b54e0bb8feba3be33ead61f0ab51da2504c58f6
|
||||
size 8051285280
|
||||
Reference in New Issue
Block a user