QuantFactory/AI-Sweden-Llama-3-8B-Instruct-GGUF
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: QuantFactory/AI-Sweden-Llama-3-8B-Instruct-GGUF
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-21 11:41:13 +08:00
commit 800e83ed90
17 changed files with 169 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

49
.gitattributes vendored Normal file
View File

@@ -0,0 +1,49 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q5_0.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q5_1.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3-8B-Instruct.Q4_0.gguf filter=lfs diff=lfs merge=lfs -text

3
Llama-3-8B-Instruct.Q2_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:027c7bb20541b873dcf924b78ed68b1408ac14754c3d1d8c82cb03521e7696df
size 3179131136

3
Llama-3-8B-Instruct.Q3_K_L.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27397186a69b50cf71281a5b9630eea6d7275b313acb5192d904508b4a3eef1f
size 4321956096

3
Llama-3-8B-Instruct.Q3_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:85f3be4ee82a3a784ec3a5ae442e4c71fbf361177ea9950a386371f99fa0d5c1
size 4018917632

3
Llama-3-8B-Instruct.Q3_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:dbe2dd4f35478be6eb0efe88debd88e8bb381f579cebd7466150b435552c09b8
size 3664498944

3
Llama-3-8B-Instruct.Q4_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54531973f4bb8c1d4e551650c61c223f9d8780b782b2abf90e690c7e096c7867
size 4661211392

3
Llama-3-8B-Instruct.Q4_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:2c396b42bd6e9b2368df15992bd21bac911b847a9015a7ef6b113b49a1d46149
size 5130252544

3
Llama-3-8B-Instruct.Q4_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:79fa6a2e5f64b9d249d3f17fd49320c190b791d82dbb09c4c87ba0809549a554
size 4920733952

3
Llama-3-8B-Instruct.Q4_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e57b076a74d2b3cccde2f2e4c3017ab08357330789ada55213b51f2972dab690
size 4692668672

3
Llama-3-8B-Instruct.Q5_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:3ee37c010296b958a1249f5b9448b271e9d0a3a7c35b6956ebb297187649bbbd
size 5599293696

3
Llama-3-8B-Instruct.Q5_1.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:5e7925ebeea2449ebe7abc7f827c8f5c35c58e33bbc4aea479f40e1d017c430f
size 6068334848

3
Llama-3-8B-Instruct.Q5_K_M.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4802db9eb6a446758f8b17f0565fc0c8989df03a6d09e20ffa7d060e00391d36
size 5732987136

3
Llama-3-8B-Instruct.Q5_K_S.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:22b08d3c40541ccc059cf2c9c8a0c223db443b1f569282cbdd256e2a648bac63
size 5599293696

3
Llama-3-8B-Instruct.Q6_K.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:27a9c5e97612c7640db6f6e8c8d0741eee148087591cf17b85f8361ec3e37851
size 6596006144

3
Llama-3-8B-Instruct.Q8_0.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:944ba761cb4b40111dd808b979f11ddf5e5f25358e38d1a086a666f529adb273
size 8540770560

77
README.md Normal file
View File

@@ -0,0 +1,77 @@
---
license: apache-2.0
datasets: teknium/OpenHermes-2.5
base_model: AI-Sweden-Models/Llama-3-8B-instruct
pipeline_tag: text-generation
---
# QuantFactory/AI-Sweden-Llama-3-8B-Instruct-GGUF
This is quantized version of [AI-Sweden-Models/Llama-3-8B-instruct](https://huggingface.co/AI-Sweden-Models/Llama-3-8B-instruct) created suing llama.cpp
# Model Description
# Checkpoint 1
## Training setup
The training was perfomed on the [LUMI supercomputer](https://lumi-supercomputer.eu/) within the [DeployAI EU project](https://www.ai.se/en/project/deployai).
Based of the base model [AI-Sweden-Models/Llama-3-8B](https://huggingface.co/AI-Sweden-Models/Llama-3-8B).
## Dataset
A data recipe by: [42 Labs](https://huggingface.co/four-two-labs)
![](https://huggingface.co/AI-Sweden-Models/Llama-3-8B-instruct/resolve/main/42logo.png?download=true)
## How to use
```python
import transformers
import torch
model_id = "AI-Sweden-Models/Llama-3-8B-instruct"
pipeline = transformers.pipeline(
"text-generation",
model=model_id,
model_kwargs={"torch_dtype": torch.bfloat16},
device_map="auto",
)
messages = [
{"role": "system", "content": "Du är en hjälpsam assistant som svarar klokt och vänligt."},
{"role": "user", "content": "Hur gör man pannkakor? Och vad behöver man handla? Undrar också vad 5+6 är.."},
]
terminators = [
pipeline.tokenizer.eos_token_id,
pipeline.tokenizer.convert_tokens_to_ids("<|eot_id|>")
]
outputs = pipeline(
messages,
max_new_tokens=256,
eos_token_id=terminators,
do_sample=True,
temperature=0.6,
top_p=0.9,
)
print(outputs[0]["generated_text"][-1])
```
```python
>>> "För att göra pannkakor behöver du följande ingredienser:
- 1 kopp vetemjöl
- 1 tesked bakpulver
- 1/4 tesked salt
- 1 kopp mjölk
- 1 stort ägg
- 2 matskedar smält smör eller olja
För att börja, blanda vetemjölet, bakpulvret och saltet i en bunke. I en annan skål, vispa ihop mjölken, ägget och smöret eller oljan.
Tillsätt de våta ingredienserna till de torra ingredienserna och blanda tills det är väl blandat.
Låt smeten vila i cirka 10 minuter.
För att göra pannkakorna, värm en non-stick-panna eller stekpanna över medelvärme.
När den är varm, häll smeten på pannan och grädda tills kanterna börjar torka ut och toppen är fast.
Vänd pannkakan med en stekspade och grädda den andra sidan tills den är gyllenbrun.
Upprepa med resten av smeten.
När det gäller 5+6 är svaret 11."
```

1
configuration.json Normal file
View File

@@ -0,0 +1 @@
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}