From 2934027038544e5431e20243b2ea7b44f0274324 Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Wed, 29 Jul 2026 02:46:10 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: Andycurrent/Dolphin3.0-Llama3.1-8B Source: Original Platform --- .gitattributes | 41 ++++++++++++++ Dolphin3.0-Llama3.1-8B_F16.gguf | 3 ++ Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf | 3 ++ Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf | 3 ++ Dolphin3.0-Llama3.1-8B_Q6_K.gguf | 3 ++ Dolphin3.0-Llama3.1-8B_Q8_0.gguf | 3 ++ README.md | 87 ++++++++++++++++++++++++++++++ 7 files changed, 143 insertions(+) create mode 100644 .gitattributes create mode 100644 Dolphin3.0-Llama3.1-8B_F16.gguf create mode 100644 Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf create mode 100644 Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf create mode 100644 Dolphin3.0-Llama3.1-8B_Q6_K.gguf create mode 100644 Dolphin3.0-Llama3.1-8B_Q8_0.gguf create mode 100644 README.md diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..56c8054 --- /dev/null +++ b/.gitattributes @@ -0,0 +1,41 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +Andycurrent/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_F16.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text +Dolphin3.0-Llama3.1-8B_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Dolphin3.0-Llama3.1-8B_F16.gguf b/Dolphin3.0-Llama3.1-8B_F16.gguf new file mode 100644 index 0000000..b6f7d17 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:181e5f5e722f574b38666e3536197e89ec476b44e6e957c4e2fbc927784f2392 +size 16068927648 diff --git a/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf b/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf new file mode 100644 index 0000000..88ae905 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_Q4_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:ab881f4c368df0317ff985764197fb626159b82e099e335893aba5ee8927f644 +size 4920749280 diff --git a/Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf b/Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf new file mode 100644 index 0000000..b58b013 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_Q5_K_M.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:9fcf3342221eb6fda742790dfb04de54d25f53ce508a4ba0928dd1c49cc49d62 +size 5733003488 diff --git a/Dolphin3.0-Llama3.1-8B_Q6_K.gguf b/Dolphin3.0-Llama3.1-8B_Q6_K.gguf new file mode 100644 index 0000000..d75bdd0 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_Q6_K.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:3437d318383ae74d0d6e1beffdab6b70d734eb1980c777267968e3e1dd8c29d4 +size 6596023584 diff --git a/Dolphin3.0-Llama3.1-8B_Q8_0.gguf b/Dolphin3.0-Llama3.1-8B_Q8_0.gguf new file mode 100644 index 0000000..e745f58 --- /dev/null +++ b/Dolphin3.0-Llama3.1-8B_Q8_0.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:95c83ed30ef3cbd7d8daf68c3dda3e69eacb251960e399ce899f9c7e75a53ea5 +size 8540791968 diff --git a/README.md b/README.md new file mode 100644 index 0000000..a6ebdd0 --- /dev/null +++ b/README.md @@ -0,0 +1,87 @@ +--- +license: llama3.1 +language: +- en +base_model: +- dphn/Dolphin3.0-Llama3.1-8B +tags: +- code +- text-generation-inference +- medical +- uncensored +--- + + + + +# Dolphin 3.0 – Llama 3.1 8B_GGUF + +This repository hosts the Quantized versions of **Dolphin 3.0 – Llama 3.1 8B** uncensored model, an instruct-tuned 8 billion-parameter model designed for versatile local use coding, general reasoning, conversational assistance, agentic workflows and more. + +--- + +## Model Overview + +- **Model Name**: Dolphin 3.0 – Llama 3.1 8B +- **Base Architecture**: Meta Llama‑3.1, 8 billion parameters (8 B) +- **Developer / Curator**: Cognitive Computations (Curated & trained by Eric Hartford, Ben Gitter, BlouseJury) +- **License**: Llama 3.1 License (inherits from base model) +- **Intended Use**: General-purpose, local deployment model instruction following, conversation, coding, function-calling, agentic behaviour. + +--- + +## What is Dolphin? + +Dolphin is a series of instruction-tuned large language models built for local use and full user control. Dolphin 3.0 aims to be the “ultimate general-purpose local model,” supporting: + +- Coding tasks (multiple programming languages) +- Mathematical reasoning +- Function‐calling and agentic workflows +- Conversational and chat-assistant scenarios +- Custom alignment and system-prompt steering + + +--- + +## Chat Template & System Prompt + +This model uses the **ChatML** format for interactions: +``` +<|im_start|>system +You are Dolphin, a helpful AI assistant. +<|im_end|> +<|im_start|>user +{your prompt here} +<|im_end|> +<|im_start|>assistant +``` + +## Key Features & Capabilities + +- Strong instruction-following across coding, mathematics, reasoning & conversation +- Function calling/agentic workflow support (via specified templates and runtime) +- Designed for local deployment, ensuring user control over alignment, prompts and data +- Supports long context windows (depending on runtime and variant) +- Tuned for adaptivity: deploy as coding tool, tutor, assistant, or domain-specific agent + + +## Intended Use Cases + +- **Coding assistant** — multi-language code generation, debugging, refactoring +- **Mathematical & scientific reasoning** — step-by-step problem solving +- **Chat/assistant prototype** — customizable assistant for your domain +- **Agentic workflows** — integrate function calling toolbox, tool‐use, chain-of-thought +- **Local/private deployment** — on-premises or edge use, minimizing external data exposure + + +## Acknowledgements + +**Special thanks to**: +- Crusoe Cloud, Akash, Lazarus, Cerebras for hardware/training support +- The open-source datasets and foundational work by Meta, Qwen, OpenCoder, etc. +- The broader open-source community enabling deployment, quantization and local inference ecosystems. + + +## Contact & Support +- For issues, questions or community discussion: see the model’s Hugging Face discussions page: [https://huggingface.co/dphn/Dolphin3.0-Llama3.1-8B/discussions] +- You may also join the Discord community: [https://discord.gg/cognitivecomputations] \ No newline at end of file