---
base_model: NousResearch/DeepHermes-3-Llama-3-8B-Preview
pipeline_tag: text-generation
inference: true
language:
- en
license: llama3
model_creator: NousResearch
model_name: DeepHermes-3-Llama-3-8B-Preview
model_type: llama
quantized_by: brittlewis12
tags:
- reasoning
- llama
- llama3
---
# DeepHermes 3 Preview GGUF
**Original model**: [DeepHermes-3-Llama-3-8B-Preview](https://huggingface.co/NousResearch/DeepHermes-3-Llama-3-8B-Preview)
**Model creator**: [NousResearch](https://huggingface.co/NousResearch)
> DeepHermes 3 Preview is the latest version of our flagship Hermes series of LLMs by Nous Research, and one of the first models in the world to unify Reasoning (long chains of thought that improve answer accuracy) and normal LLM response modes into one model. We have also improved LLM annotation, judgement, and function calling.
> _This is a preview Hermes with early reasoning capabilities, distilled from R1 across a variety of tasks that benefit from reasoning and objectivity. Some quirks may be discovered! Please let us know any interesting findings or issues you discover!_
This repo contains GGUF format model files for the NousResearch’s DeepHermes 3 Preview.
### What is GGUF?
GGUF is a file format for representing AI models. It is the third version of the format,
introduced by the llama.cpp team on August 21st 2023.
Converted with llama.cpp build 4710 (revision [8a8c4ce](https://github.com/ggerganov/llama.cpp/commits/8a8c4ceb6050bd9392609114ca56ae6d26f5b8f5)),
using [autogguf-rs](https://github.com/brittlewis12/autogguf-rs).
### Prompt template: Llama 3 Chat
```
<|start_header_id|>system<|end_header_id|>
{{system_prompt}}<|eot_id|><|start_header_id|>user<|end_header_id|>
{{prompt}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
```
#### Reasoning System Prompt
```
You are a deep thinking AI, you may use extremely long chains of thought to deeply consider the problem and deliberate with yourself via systematic reasoning processes to help come to a correct solution prior to answering. You should enclose your thoughts and internal monologue inside tags, and then provide your solution or response to the problem.
```
#### Function calling template
```
<|start_header_id|>system<|end_header_id|>
You are a function calling AI model. You are provided with function signatures within XML tags. You may call one or more functions to assist with the user query. Don't make assumptions about what values to plug into functions. Here are the available tools: {"type": "function", "function": {"name": "myFunc", "description": "myFunc(myParam: myVal) -> str - an explanation of what your function does and when to use it.\\n\\n Args:\\n myParam (myVal): explanation of the parameter.\\n\\n Returns:\\n str: an explanation of the return value.\\n", "parameters": {"type": "object", "properties": {"myParam": {"type": "myVal"}}, "required": ["myParam"]}}} Use the following pydantic model json schema for each tool call you will make: {"properties": {"arguments": {"title": "Arguments", "type": "object"}, "name": {"title": "Name", "type": "string"}}, "required": ["arguments", "name"], "title": "FunctionCall", "type": "object"} For each function call return a json object with function name and arguments within XML tags as follows:
{"arguments": , "name": }
<|eot_id|><|start_header_id|>user<|end_header_id|>
{{prompt}}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
```
#### Example tool call assistant message
```
{"arguments": {"myParam": "myVal"}, "name": "myFunc"}
<|eot_id|><|start_header_id|>tool<|end_header_id|>
```
#### Example tool response message
```
{"name": "myFunc", "content": "myFunc output here (json, string, etc)"}
<|eot_id|><|start_header_id|>assistant<|end_header_id|>
```
---
## Download & run with [cnvrs](https://twitter.com/cnvrsai) on iPhone, iPad, and Mac!
[cnvrs](https://testflight.apple.com/join/sFWReS7K) is the best app for private, local AI on your device:
- create & save **Characters** with custom system prompts & temperature settings
- download and experiment with any **GGUF model** you can [find on HuggingFace](https://huggingface.co/models?library=gguf)!
* or, use an API key with the chat completions-compatible model provider of your choice -- ChatGPT, Claude, Gemini, DeepSeek, & more!
- make it your own with custom **Theme colors**
- powered by Metal ⚡️ & [Llama.cpp](https://github.com/ggerganov/llama.cpp), with **haptics** during response streaming!
- **try it out** yourself today, on [Testflight](https://testflight.apple.com/join/sFWReS7K)!
* if you **already have the app**, download DeepHermes3 Preview now!
*
- follow [cnvrs on twitter](https://twitter.com/cnvrsai) to stay up to date
---
## Original Model Evaluation
