初始化项目,由ModelHub XC社区提供模型
Model: Andycurrent/Dolphin3.0-Llama3.1-8B Source: Original Platform
This commit is contained in:
41
.gitattributes
vendored
Normal file
41
.gitattributes
vendored
Normal file
@@ -0,0 +1,41 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Andycurrent/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Dolphin3.0-Llama3.1-8B_F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Dolphin3.0-Llama3.1-8B_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
Dolphin3.0-Llama3.1-8B_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
3
Dolphin3.0-Llama3.1-8B_F16.gguf
Normal file
3
Dolphin3.0-Llama3.1-8B_F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:181e5f5e722f574b38666e3536197e89ec476b44e6e957c4e2fbc927784f2392
|
||||||
|
size 16068927648
|
||||||
3
Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf
Normal file
3
Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ab881f4c368df0317ff985764197fb626159b82e099e335893aba5ee8927f644
|
||||||
|
size 4920749280
|
||||||
3
Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf
Normal file
3
Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:9fcf3342221eb6fda742790dfb04de54d25f53ce508a4ba0928dd1c49cc49d62
|
||||||
|
size 5733003488
|
||||||
3
Dolphin3.0-Llama3.1-8B_Q6_K.gguf
Normal file
3
Dolphin3.0-Llama3.1-8B_Q6_K.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3437d318383ae74d0d6e1beffdab6b70d734eb1980c777267968e3e1dd8c29d4
|
||||||
|
size 6596023584
|
||||||
3
Dolphin3.0-Llama3.1-8B_Q8_0.gguf
Normal file
3
Dolphin3.0-Llama3.1-8B_Q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:95c83ed30ef3cbd7d8daf68c3dda3e69eacb251960e399ce899f9c7e75a53ea5
|
||||||
|
size 8540791968
|
||||||
87
README.md
Normal file
87
README.md
Normal file
@@ -0,0 +1,87 @@
|
|||||||
|
---
|
||||||
|
license: llama3.1
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
base_model:
|
||||||
|
- dphn/Dolphin3.0-Llama3.1-8B
|
||||||
|
tags:
|
||||||
|
- code
|
||||||
|
- text-generation-inference
|
||||||
|
- medical
|
||||||
|
- uncensored
|
||||||
|
---
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
# Dolphin 3.0 – Llama 3.1 8B_GGUF
|
||||||
|
|
||||||
|
This repository hosts the Quantized versions of **Dolphin 3.0 – Llama 3.1 8B** uncensored model, an instruct-tuned 8 billion-parameter model designed for versatile local use coding, general reasoning, conversational assistance, agentic workflows and more.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Model Overview
|
||||||
|
|
||||||
|
- **Model Name**: Dolphin 3.0 – Llama 3.1 8B
|
||||||
|
- **Base Architecture**: Meta Llama‑3.1, 8 billion parameters (8 B)
|
||||||
|
- **Developer / Curator**: Cognitive Computations (Curated & trained by Eric Hartford, Ben Gitter, BlouseJury)
|
||||||
|
- **License**: Llama 3.1 License (inherits from base model)
|
||||||
|
- **Intended Use**: General-purpose, local deployment model instruction following, conversation, coding, function-calling, agentic behaviour.
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## What is Dolphin?
|
||||||
|
|
||||||
|
Dolphin is a series of instruction-tuned large language models built for local use and full user control. Dolphin 3.0 aims to be the “ultimate general-purpose local model,” supporting:
|
||||||
|
|
||||||
|
- Coding tasks (multiple programming languages)
|
||||||
|
- Mathematical reasoning
|
||||||
|
- Function‐calling and agentic workflows
|
||||||
|
- Conversational and chat-assistant scenarios
|
||||||
|
- Custom alignment and system-prompt steering
|
||||||
|
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## Chat Template & System Prompt
|
||||||
|
|
||||||
|
This model uses the **ChatML** format for interactions:
|
||||||
|
```
|
||||||
|
<|im_start|>system
|
||||||
|
You are Dolphin, a helpful AI assistant.
|
||||||
|
<|im_end|>
|
||||||
|
<|im_start|>user
|
||||||
|
{your prompt here}
|
||||||
|
<|im_end|>
|
||||||
|
<|im_start|>assistant
|
||||||
|
```
|
||||||
|
|
||||||
|
## Key Features & Capabilities
|
||||||
|
|
||||||
|
- Strong instruction-following across coding, mathematics, reasoning & conversation
|
||||||
|
- Function calling/agentic workflow support (via specified templates and runtime)
|
||||||
|
- Designed for local deployment, ensuring user control over alignment, prompts and data
|
||||||
|
- Supports long context windows (depending on runtime and variant)
|
||||||
|
- Tuned for adaptivity: deploy as coding tool, tutor, assistant, or domain-specific agent
|
||||||
|
|
||||||
|
|
||||||
|
## Intended Use Cases
|
||||||
|
|
||||||
|
- **Coding assistant** — multi-language code generation, debugging, refactoring
|
||||||
|
- **Mathematical & scientific reasoning** — step-by-step problem solving
|
||||||
|
- **Chat/assistant prototype** — customizable assistant for your domain
|
||||||
|
- **Agentic workflows** — integrate function calling toolbox, tool‐use, chain-of-thought
|
||||||
|
- **Local/private deployment** — on-premises or edge use, minimizing external data exposure
|
||||||
|
|
||||||
|
|
||||||
|
## Acknowledgements
|
||||||
|
|
||||||
|
**Special thanks to**:
|
||||||
|
- Crusoe Cloud, Akash, Lazarus, Cerebras for hardware/training support
|
||||||
|
- The open-source datasets and foundational work by Meta, Qwen, OpenCoder, etc.
|
||||||
|
- The broader open-source community enabling deployment, quantization and local inference ecosystems.
|
||||||
|
|
||||||
|
|
||||||
|
## Contact & Support
|
||||||
|
- For issues, questions or community discussion: see the model’s Hugging Face discussions page: [https://huggingface.co/dphn/Dolphin3.0-Llama3.1-8B/discussions]
|
||||||
|
- You may also join the Discord community: [https://discord.gg/cognitivecomputations]
|
||||||
Reference in New Issue
Block a user