indischepartij/MiaLatte-Indo-Mistral-7b
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: indischepartij/MiaLatte-Indo-Mistral-7b
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-05-27 12:46:22 +08:00
commit bfa6e631b4
17 changed files with 91504 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

35
.gitattributes vendored Normal file
View File

@@ -0,0 +1,35 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text

199
README.md Normal file
View File

@@ -0,0 +1,199 @@
---
language:
- id
- en
license: cc-by-nc-4.0
tags:
- merge
- mergekit
model-index:
- name: MiaLatte-Indo-Mistral-7b
results:
- task:
type: text-generation
name: Text Generation
dataset:
name: AI2 Reasoning Challenge (25-Shot)
type: ai2_arc
config: ARC-Challenge
split: test
args:
num_few_shot: 25
metrics:
- type: acc_norm
value: 66.55
name: normalized accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/MiaLatte-Indo-Mistral-7b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: HellaSwag (10-Shot)
type: hellaswag
split: validation
args:
num_few_shot: 10
metrics:
- type: acc_norm
value: 85.23
name: normalized accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/MiaLatte-Indo-Mistral-7b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: MMLU (5-Shot)
type: cais/mmlu
config: all
split: test
args:
num_few_shot: 5
metrics:
- type: acc
value: 63.93
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/MiaLatte-Indo-Mistral-7b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: TruthfulQA (0-shot)
type: truthful_qa
config: multiple_choice
split: validation
args:
num_few_shot: 0
metrics:
- type: mc2
value: 56.04
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/MiaLatte-Indo-Mistral-7b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: Winogrande (5-shot)
type: winogrande
config: winogrande_xl
split: validation
args:
num_few_shot: 5
metrics:
- type: acc
value: 80.35
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/MiaLatte-Indo-Mistral-7b
name: Open LLM Leaderboard
- task:
type: text-generation
name: Text Generation
dataset:
name: GSM8k (5-shot)
type: gsm8k
config: main
split: test
args:
num_few_shot: 5
metrics:
- type: acc
value: 55.04
name: accuracy
source:
url: https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard?query=indischepartij/MiaLatte-Indo-Mistral-7b
name: Open LLM Leaderboard
---
![image/png](https://cdn-uploads.huggingface.co/production/uploads/642b04e4ecec03b44649e318/Z4a8op_F7GOyd4b7RkRn6.png)
# MiaLatte-Indo-Mistral-7b
MiaLatte is a derivative model of [OpenMia](https://huggingface.co/indischepartij/OpenMia-Indo-Mistral-7b-v2), which is able to answer everyday questions specifically in Bahasa Indonesia (Indonesia Language).
some of GGUF: https://huggingface.co/indischepartij/MiaLatte-Indo-Mistral-7b-GGUF
# Examples
![image/png](https://cdn-uploads.huggingface.co/production/uploads/642b04e4ecec03b44649e318/L-ZbAtMnhMHC6P1r5JMTI.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/642b04e4ecec03b44649e318/YF3ueo-OFis7PcGwkKwb1.png)
![image/png](https://cdn-uploads.huggingface.co/production/uploads/642b04e4ecec03b44649e318/G26MN5W0TcKkLOj9tbSqW.png)
MiaLatte-Indo-Mistral-7b is a merge of the following models using MergeKit:
* [indischepartij/OpenMia-Indo-Mistral-7b-v2](https://huggingface.co/indischepartij/OpenMia-Indo-Mistral-7b-v2)
* [Obrolin/Kesehatan-7B-v0.1](https://huggingface.co/Obrolin/Kesehatan-7B-v0.1)
* [FelixChao/WestSeverus-7B-DPO-v2](https://huggingface.co/FelixChao/WestSeverus-7B-DPO-v2)
## 🪄 Open LLM Benchmark
![image/png](https://cdn-uploads.huggingface.co/production/uploads/642b04e4ecec03b44649e318/Akt0cmoFQtz-H8NX6j96D.png)
## 🧩 Configuration
```yaml
slices:
models:
- model: indischepartij/OpenMia-Indo-Mistral-7b-v2
parameters:
density: 0.50
weight: 0.35
- model: Obrolin/Kesehatan-7B-v0.1
parameters:
density: 0.50
weight: 0.35
- model: FelixChao/WestSeverus-7B-DPO-v2
parameters:
density: 0.50
weight: 0.30
merge_method: dare_ties
base_model: indischepartij/OpenMia-Indo-Mistral-7b-v2
parameters:
int8_mask: true
dtype: float16
```
## 💻 Usage
```python
!pip install -qU transformers accelerate
from transformers import AutoTokenizer
import transformers
import torch
model = "indischepartij/MiaLatte-Indo-Mistral-7b"
messages = [{"role": "user", "content": "Apa jenis skincare yang cocok untuk kulit berjerawat??"}]
tokenizer = AutoTokenizer.from_pretrained(model)
prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
pipeline = transformers.pipeline(
"text-generation",
model=model,
torch_dtype=torch.float16,
device_map="auto",
)
outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
print(outputs[0]["generated_text"])
```
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_indischepartij__MiaLatte-Indo-Mistral-7b)
| Metric |Value|
|---------------------------------|----:|
|Avg. |67.86|
|AI2 Reasoning Challenge (25-Shot)|66.55|
|HellaSwag (10-Shot) |85.23|
|MMLU (5-Shot) |63.93|
|TruthfulQA (0-shot) |56.04|
|Winogrande (5-shot) |80.35|
|GSM8k (5-shot) |55.04|

28
config.json Normal file
View File

@@ -0,0 +1,28 @@
{
"_name_or_path": "indischepartij/OpenMia-Indo-Mistral-7b-v2",
"architectures": [
"MistralForCausalLM"
],
"attention_dropout": 0.0,
"bos_token_id": 1,
"eos_token_id": 2,
"hidden_act": "silu",
"hidden_size": 4096,
"initializer_range": 0.02,
"intermediate_size": 14336,
"max_position_embeddings": 32768,
"model_type": "mistral",
"num_attention_heads": 32,
"num_hidden_layers": 32,
"num_key_value_heads": 8,
"pad_token_id": 2,
"rms_norm_eps": 1e-05,
"rope_theta": 10000.0,
"sliding_window": 4096,
"tie_word_embeddings": false,
"torch_dtype": "float16",
"transformers_version": "4.35.2",
"unsloth_version": "2024.1",
"use_cache": true,
"vocab_size": 32000
}

20
mergekit_config.yml Normal file
View File

@@ -0,0 +1,20 @@
slices:
models:
- model: indischepartij/OpenMia-Indo-Mistral-7b-v2
parameters:
density: 0.50
weight: 0.35
- model: Obrolin/Kesehatan-7B-v0.1
parameters:
density: 0.50
weight: 0.35
- model: FelixChao/WestSeverus-7B-DPO-v2
parameters:
density: 0.50
weight: 0.30
merge_method: dare_ties
base_model: indischepartij/OpenMia-Indo-Mistral-7b-v2
parameters:
int8_mask: true
dtype: float16

3
model-00001-of-00008.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:62403f752c1db53a30592a5126daf8e43396dccf7427844165f525b037d6de57
size 1946219000

3
model-00002-of-00008.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:d7175b60903651582a16fb79c2fbad104b1c0a8eaa4d0788dd240844e19e6e4d
size 1946243880

3
model-00003-of-00008.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:6137341ee944b8c2abc0e23a62a6ffc695fcc0d663517c7b860624e02cde20a8
size 1889587024

3
model-00004-of-00008.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:fae18984c8d7d33c23a5d5df386a034b6d5ce2e8df1bf2dc52e570c8e0f2ae68
size 1946243920

3
model-00005-of-00008.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:f4ddf40c96a9732b08a9da676fe980cbdd0e6aa4ba9d129ef4dca44d1aa41242
size 1979781416

3
model-00006-of-00008.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:9db8ddca8f4986db2dcec2121f0859822fe2c5913d2125322528f8fb02309868
size 1889628528

3
model-00007-of-00008.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:e44e7ab51aa3c916c70f4b868e5b6e2ad89cd81788a6581bb58078323e6f5c0b
size 1979781416

3
model-00008-of-00008.safetensors Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:10b7fee7d6b526023af597733b5cba69986248620f30359e1231ee9fe1ecf9ad
size 906012456

1
model.safetensors.index.json Normal file
View File

File diff suppressed because one or more lines are too long

30
special_tokens_map.json Normal file
View File

@@ -0,0 +1,30 @@
{
"bos_token": {
"content": "<s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "</s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"unk_token": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

91122
tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

BIN
tokenizer.model (Stored with Git LFS) Normal file
View File

Binary file not shown.

42
tokenizer_config.json Normal file
View File

@@ -0,0 +1,42 @@
{
"added_tokens_decoder": {
"0": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"1": {
"content": "<s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"2": {
"content": "</s>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"additional_special_tokens": [],
"bos_token": "<s>",
"clean_up_tokenization_spaces": false,
"eos_token": "</s>",
"legacy": true,
"model_max_length": 32768,
"pad_token": "<unk>",
"padding_side": "right",
"sp_model_kwargs": {},
"spaces_between_special_tokens": false,
"tokenizer_class": "LlamaTokenizer",
"unk_token": "<unk>",
"use_default_system_prompt": false,
"chat_template": "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST]' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token}}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}"
}