commit 2934027038544e5431e20243b2ea7b44f0274324 Author: ModelHub XC Date: Wed Jul 29 02:46:10 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: Andycurrent/Dolphin3.0-Llama3.1-8B Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..56c8054 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,41 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Andycurrent/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_F16.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Dolphin3.0-Llama3.1-8B_F16.gguf b/Dolphin3.0-Llama3.1-8B_F16.gguf new file mode 100644 index 0000000..b6f7d17 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:181e5f5e722f574b38666e3536197e89ec476b44e6e957c4e2fbc927784f2392 +size 16068927648 diff --git a/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf b/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf new file mode 100644 index 0000000..88ae905 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ab881f4c368df0317ff985764197fb626159b82e099e335893aba5ee8927f644 +size 4920749280 diff --git a/Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf b/Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf new file mode 100644 index 0000000..b58b013 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9fcf3342221eb6fda742790dfb04de54d25f53ce508a4ba0928dd1c49cc49d62 +size 5733003488 diff --git a/Dolphin3.0-Llama3.1-8B_Q6_K.gguf b/Dolphin3.0-Llama3.1-8B_Q6_K.gguf new file mode 100644 index 0000000..d75bdd0 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3437d318383ae74d0d6e1beffdab6b70d734eb1980c777267968e3e1dd8c29d4 +size 6596023584 diff --git a/Dolphin3.0-Llama3.1-8B_Q8_0.gguf b/Dolphin3.0-Llama3.1-8B_Q8_0.gguf new file mode 100644 index 0000000..e745f58 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:95c83ed30ef3cbd7d8daf68c3dda3e69eacb251960e399ce899f9c7e75a53ea5 +size 8540791968 diff --git a/README.md b/README.md new file mode 100644 index 0000000..a6ebdd0 --- /dev/null +++ b/README.md @@ -0,0 +1,87 @@ +--- +license: llama3.1 +language: +- en +base_model: +- dphn/Dolphin3.0-Llama3.1-8B +tags: +- code +- text-generation-inference +- medical +- uncensored +--- + + + + +# Dolphin 3.0 – Llama 3.1 8B_GGUF + +This repository hosts the Quantized versions of **Dolphin 3.0 – Llama 3.1 8B** uncensored model, an instruct-tuned 8 billion-parameter model designed for versatile local use coding, general reasoning, conversational assistance, agentic workflows and more. + +--- + +## Model Overview + +- **Model Name**: Dolphin 3.0 – Llama 3.1 8B +- **Base Architecture**: Meta Llama‑3.1, 8 billion parameters (8 B) +- **Developer / Curator**: Cognitive Computations (Curated & trained by Eric Hartford, Ben Gitter, BlouseJury) +- **License**: Llama 3.1 License (inherits from base model) +- **Intended Use**: General-purpose, local deployment model instruction following, conversation, coding, function-calling, agentic behaviour. + +--- + +## What is Dolphin? + +Dolphin is a series of instruction-tuned large language models built for local use and full user control. Dolphin 3.0 aims to be the “ultimate general-purpose local model,” supporting: + +- Coding tasks (multiple programming languages) +- Mathematical reasoning +- Function‐calling and agentic workflows +- Conversational and chat-assistant scenarios +- Custom alignment and system-prompt steering + + +--- + +## Chat Template & System Prompt + +This model uses the **ChatML** format for interactions: +``` +<|im_start|>system +You are Dolphin, a helpful AI assistant. +<|im_end|> +<|im_start|>user +{your prompt here} +<|im_end|> +<|im_start|>assistant +``` + +## Key Features & Capabilities + +- Strong instruction-following across coding, mathematics, reasoning & conversation +- Function calling/agentic workflow support (via specified templates and runtime) +- Designed for local deployment, ensuring user control over alignment, prompts and data +- Supports long context windows (depending on runtime and variant) +- Tuned for adaptivity: deploy as coding tool, tutor, assistant, or domain-specific agent + + +## Intended Use Cases + +- **Coding assistant** — multi-language code generation, debugging, refactoring +- **Mathematical & scientific reasoning** — step-by-step problem solving +- **Chat/assistant prototype** — customizable assistant for your domain +- **Agentic workflows** — integrate function calling toolbox, tool‐use, chain-of-thought +- **Local/private deployment** — on-premises or edge use, minimizing external data exposure + + +## Acknowledgements + +**Special thanks to**: +- Crusoe Cloud, Akash, Lazarus, Cerebras for hardware/training support +- The open-source datasets and foundational work by Meta, Qwen, OpenCoder, etc. +- The broader open-source community enabling deployment, quantization and local inference ecosystems. + + +## Contact & Support +- For issues, questions or community discussion: see the model’s Hugging Face discussions page: [https://huggingface.co/dphn/Dolphin3.0-Llama3.1-8B/discussions] +- You may also join the Discord community: [https://discord.gg/cognitivecomputations] \ No newline at end of file