初始化项目,由ModelHub XC社区提供模型
Model: Andycurrent/Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC-GGUF Source: Original Platform
This commit is contained in:
42
.gitattributes
vendored
Normal file
42
.gitattributes
vendored
Normal file
@@ -0,0 +1,42 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:dfbff85f9786d65dc68451b872c65d0322fc5191cd5fc5ed08798a3cc15ed961
|
||||||
|
size 24504278496
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:1b82d839dcb4ab9c588f05b2b5cfa45ba45743143874a5d5217d5d5782629186
|
||||||
|
size 4791049696
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3bdbd802682da28a7fc99c54f4fb83fcaeb79283c21f038a3766ee9658d109f6
|
||||||
|
size 6083091936
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:11b20ad1ecb35dab85c4b8f6247cbf2ec10693764ef6cd1bbb51c5753192c347
|
||||||
|
size 7477206496
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:be460d487e5eb47f22a4dedb514df4756189fcd24374590b2d3737ff301332bc
|
||||||
|
size 8727633376
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:b7362e7d4e2c1648ec1aebee1b78a5eb2dd6058708f191eb9611cb4c75a245b4
|
||||||
|
size 10056211936
|
||||||
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:65926687951f53c852333c136e59ade898b9e4803a7351cccdfd38895da002b3
|
||||||
|
size 13022371296
|
||||||
131
README.md
Normal file
131
README.md
Normal file
@@ -0,0 +1,131 @@
|
|||||||
|
---
|
||||||
|
license: other
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
tags:
|
||||||
|
- gguf
|
||||||
|
- mistral
|
||||||
|
- mistral-nemo
|
||||||
|
- local-inference
|
||||||
|
- reasoning
|
||||||
|
- uncensored
|
||||||
|
- text-generation
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
library_name: llama.cpp
|
||||||
|
base_model: mistral-nemo-2407
|
||||||
|
---
|
||||||
|
|
||||||
|
# HERETIC – Mistral-Nemo 2407 12B Thinking (GGUF)
|
||||||
|
|
||||||
|
HERETIC is a reasoning-oriented variant of the **Mistral-Nemo 2407 12B** architecture distributed in **GGUF format** for efficient local inference.
|
||||||
|
The model is intended for users who want a flexible conversational assistant capable of analytical reasoning, long-form explanations, and open-ended dialogue while running entirely on local hardware.
|
||||||
|
|
||||||
|
This repository provides quantized versions optimized for **llama.cpp–based runtimes** and other compatible inference tools.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Model Details
|
||||||
|
|
||||||
|
**Model Name:** Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC
|
||||||
|
**Architecture:** Mistral-Nemo (12B parameters)
|
||||||
|
**Format:** GGUF
|
||||||
|
**Base Model:** Mistral-Nemo-2407
|
||||||
|
**Distribution:** Quantized builds for local inference
|
||||||
|
**Primary Capability:** Instruction-following with extended reasoning and conversational flexibility
|
||||||
|
|
||||||
|
HERETIC focuses on encouraging multi-step reasoning and detailed responses while maintaining a natural conversational style.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Intended Use
|
||||||
|
|
||||||
|
This model is designed primarily for **local deployments** and experimentation.
|
||||||
|
|
||||||
|
Typical use cases include:
|
||||||
|
|
||||||
|
- Personal AI assistants
|
||||||
|
- Coding help and technical explanations
|
||||||
|
- Analytical reasoning tasks
|
||||||
|
- Brainstorming and creative writing
|
||||||
|
- Prompt engineering and LLM experimentation
|
||||||
|
- Offline or privacy-focused AI workflows
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Out-of-Scope Use
|
||||||
|
|
||||||
|
The model should not be relied upon for:
|
||||||
|
|
||||||
|
- Legal advice
|
||||||
|
- Medical advice
|
||||||
|
- Safety-critical decision making
|
||||||
|
- Automated moderation systems
|
||||||
|
|
||||||
|
Outputs may contain inaccuracies or biased information.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Prompt Format
|
||||||
|
|
||||||
|
The model works best with structured role-based prompts.
|
||||||
|
|
||||||
|
Example conversation template:
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
<|system|>
|
||||||
|
You are a helpful AI assistant.
|
||||||
|
|
||||||
|
<|user|>
|
||||||
|
Explain how neural networks learn.
|
||||||
|
|
||||||
|
<|assistant|>
|
||||||
|
|
||||||
|
```
|
||||||
|
|
||||||
|
Some interfaces automatically apply a compatible chat template.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Running the Model
|
||||||
|
|
||||||
|
This model uses the **GGUF format**, making it compatible with several local inference tools.
|
||||||
|
|
||||||
|
## llama.cpp
|
||||||
|
|
||||||
|
Example command:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
./llama.exe -m Mistral-Nemo-2407-12B-Thinking-Claude-Gemini-GPT5.2-Uncensored-HERETIC_Q4_K_M.gguf -p "Explain quantum computing in simple terms."
|
||||||
|
```
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Limitations
|
||||||
|
|
||||||
|
Like most large language models:
|
||||||
|
|
||||||
|
- The model can generate incorrect information.
|
||||||
|
- It may hallucinate facts or citations.
|
||||||
|
- Output quality depends heavily on prompt design.
|
||||||
|
- Responses reflect biases present in training data.
|
||||||
|
|
||||||
|
Users should critically evaluate outputs before relying on them.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Acknowledgements
|
||||||
|
|
||||||
|
This model builds on contributions from several open-source projects:
|
||||||
|
|
||||||
|
- The **Mistral** research team for the underlying architecture
|
||||||
|
- The **llama.cpp** ecosystem enabling efficient local inference
|
||||||
|
- The **GGUF format** used for optimized model distribution
|
||||||
|
- The open-source community that develops tools for local LLM deployment
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
# Disclaimer
|
||||||
|
|
||||||
|
This model is provided for **research, experimentation, and local use**.
|
||||||
|
Users are responsible for ensuring that deployments comply with applicable laws and the licensing terms of the underlying base model.
|
||||||
Reference in New Issue
Block a user