初始化项目，由ModelHub XC社区提供模型
Model: aifeifei798/EuroLLM-22B-Instruct-2512-FT Source: Original Platform
This commit is contained in:
ModelHub XC
36
.gitattributes
vendored
Normal file
36
.gitattributes
vendored
Normal file
@@ -0,0 +1,36 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
||||
363
README.md
Normal file
363
README.md
Normal file
@@ -0,0 +1,363 @@
|
||||
---
|
||||
language:
|
||||
- en
|
||||
- de
|
||||
- es
|
||||
- fr
|
||||
- it
|
||||
- pt
|
||||
- pl
|
||||
- nl
|
||||
- tr
|
||||
- sv
|
||||
- cs
|
||||
- el
|
||||
- hu
|
||||
- ro
|
||||
- fi
|
||||
- uk
|
||||
- sl
|
||||
- sk
|
||||
- da
|
||||
- lt
|
||||
- lv
|
||||
- et
|
||||
- bg
|
||||
- 'no'
|
||||
- ca
|
||||
- hr
|
||||
- ga
|
||||
- mt
|
||||
- gl
|
||||
- zh
|
||||
- ru
|
||||
- ko
|
||||
- ja
|
||||
- ar
|
||||
- hi
|
||||
library_name: transformers
|
||||
license: apache-2.0
|
||||
base_model: utter-project/EuroLLM-22B-Instruct-2512
|
||||
tags:
|
||||
- EuroLLM
|
||||
- llama
|
||||
- philosophy
|
||||
- text
|
||||
- roleplay
|
||||
- mental-health-helper
|
||||
datasets:
|
||||
- aifeifei798/EuroBlocks_Sampled_100
|
||||
---
|
||||
|
||||
# Model Card: EuroLLM-22B-Instruct-2512-FT
|
||||
|
||||
**"Order Arising from Chaos."**
|
||||
|
||||
This model is a logic-reinforced version of [utter-project/EuroLLM-22B-Instruct-2512](https://huggingface.co/utter-project/EuroLLM-22B-Instruct-2512), fine-tuned using the **Fragmented Training (FT)** paradigm. By introducing a high-intensity "Cognitive Burden" during the Instruction Fine-Tuning (SFT) phase, we have decoupled logical reasoning from rigid syntactic structures.
|
||||
|
||||
## 🚀 Model Details
|
||||
|
||||
- **Model Name:** `aifeifei798/EuroLLM-22B-Instruct-2512-FT`
|
||||
- **Base Model:** `utter-project/EuroLLM-22B-Instruct-2512`
|
||||
- **Training Paradigm:** Fragmented-Training (FT) / Iron Logic Pipeline
|
||||
- **Training Data:** [aifeifei798/EuroBlocks_Sampled_100](https://huggingface.co/datasets/aifeifei798/EuroBlocks_Sampled_100)
|
||||
- **Languages:** Native support for 141 languages (optimized for EU member states).
|
||||
- **Architecture:** Causal LLM (Optimized SFT -> FT reinforcement).
|
||||
|
||||
---
|
||||
|
||||
### Thanks mradermacher: For creating the GGUF versions of these models
|
||||
|
||||
https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-FT-GGUF
|
||||
|
||||
https://huggingface.co/mradermacher/EuroLLM-22B-Instruct-2512-FT-i1-GGUF
|
||||
|
||||
---
|
||||
|
||||
## 🏋️ The Methodology: Fragmented Training (FT)
|
||||
|
||||
Current autoregressive models are often "syntax-fragile"—they rely on perfectly ordered input tokens. **FT (Fragmented Training)** breaks this dependency.
|
||||
|
||||
During the fine-tuning of this model:
|
||||
1. **Stochastic Shuffling:** We applied a **70% token shuffling rate** to the instructions and inputs.
|
||||
2. **Cognitive Burden:** The model was forced to process "chaotic" prompts while predicting pristine, logical outputs.
|
||||
3. **Logic Reconstruction:** This paradigm shifts the model's objective from simple *pattern matching* to *global semantic reconstruction*.
|
||||
|
||||
> *"While denoising objectives exist in pre-training (e.g., BART, T5), applying heavy stochastic token shuffling (70%) strictly during the Instruction Fine-Tuning (SFT) phase for Causal LLMs is a novel approach introduced by aifeifei798 and Gemini."*
|
||||
|
||||
---
|
||||
|
||||
## Run the model
|
||||
|
||||
```python
|
||||
import torch
|
||||
from transformers import AutoModelForCausalLM, AutoTokenizer
|
||||
|
||||
# Model ID for the FT-Reinforced version
|
||||
model_id = "aifeifei798/EuroLLM-22B-Instruct-2512-FT"
|
||||
|
||||
# 1. Load Tokenizer and Model
|
||||
# Using bfloat16 and device_map="auto" to leverage your GPU (e.g., RTX 5090)
|
||||
tokenizer = AutoTokenizer.from_pretrained(model_id)
|
||||
model = AutoModelForCausalLM.from_pretrained(
|
||||
model_id,
|
||||
torch_dtype=torch.bfloat16,
|
||||
device_map="auto"
|
||||
)
|
||||
|
||||
# 2. Define the "Chaos" Test Suite (Fragmented & Multilingual)
|
||||
chaotic_prompts = [
|
||||
"Combien cuesta le Orange en el centre de Madrid por favor, ist expensive?",
|
||||
"Ist le Real performance muy bien heute in Paris, help me avec le tickets?",
|
||||
"Peux-je gaan naar Mars mañana morning mit un low budget?"
|
||||
]
|
||||
|
||||
print(f"🚀 Testing FT Model: {model_id}\n" + "="*50)
|
||||
|
||||
# 3. Execution Loop
|
||||
for i, prompt in enumerate(chaotic_prompts, 1):
|
||||
messages = [
|
||||
{
|
||||
"role": "user",
|
||||
"content": prompt
|
||||
},
|
||||
]
|
||||
|
||||
print(f"\n[Test Case {i}] Input (Chaos): {prompt}")
|
||||
|
||||
# Apply Template
|
||||
inputs = tokenizer.apply_chat_template(
|
||||
messages,
|
||||
tokenize=True,
|
||||
add_generation_prompt=True,
|
||||
return_tensors="pt"
|
||||
).to(model.device)
|
||||
|
||||
# Generate Response
|
||||
# FT models are 30% faster; we use a decisive temperature for logic reconstruction
|
||||
outputs = model.generate(
|
||||
inputs,
|
||||
max_new_tokens=1024,
|
||||
do_sample=True,
|
||||
temperature=0.3,
|
||||
top_p=0.9
|
||||
)
|
||||
|
||||
# Decode and Print Result
|
||||
# skip_special_tokens=True removes the chat markers for clean reading
|
||||
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
|
||||
|
||||
# We split by 'assistant' to show only the model's generated answer
|
||||
print(f"Output (Iron Logic):\n{response.split('assistant')[-1].strip()}")
|
||||
print("-" * 50)
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## ⚡ Key Results
|
||||
|
||||
| Metric | Base Model (EuroLLM-22B) | FT Model (Reinforced) | Impact |
|
||||
| :--- | :--- | :--- | :--- |
|
||||
| **Inference Speed** | Baseline | **~29.61% Faster** | 🚀 Confidence Sharpening |
|
||||
| **Logic Resilience** | Syntax-dependent | **Immune to Scrambled Input** | 🛡️ Robustness |
|
||||
| **Code-Switching** | Standard | **Deep Semantic Alignment** | 🌍 Multi-lingual Chaos |
|
||||
| **Zero-Shot Understanding** | Pattern-based | **Emergent Self-Reflection** | 🧠 Logic Synthesis |
|
||||
|
||||
### 1. Speed Enhancement
|
||||
Through **Confidence Sharpening**, the FT model exhibits less "hesitation" in its probability distribution. By training in chaos, the model learns to identify the optimal logical path more decisively, resulting in significantly lower latency.
|
||||
|
||||
### 2. Extreme Robustness (The "Broken Grammar" Test)
|
||||
The model can process inputs that are syntactically incorrect, multilingual (code-switching), or highly fragmented (e.g., *"Me, sell BYD battery, EU, pitfalls?"*) and return professional, structured, and legally accurate responses.
|
||||
|
||||
---
|
||||
|
||||
## 📖 Usage & Capabilities
|
||||
|
||||
This model is ideal for high-stakes environments where input data may be noisy, unstructured, or involve multiple languages simultaneously.
|
||||
|
||||
### Specialized Scenarios:
|
||||
- **Cross-Border EU Compliance:** Handling complex regulatory queries (GDPR, AI Act, GSR2) across 141 languages.
|
||||
- **Fragmented Intent Recognition:** Processing "Telegraphic Speech" from non-native speakers or low-quality OCR data.
|
||||
- **High-Speed Inference:** Applications requiring faster response times without sacrificing parameter count.
|
||||
|
||||
---
|
||||
|
||||
## 🛠 Training Pipeline: The "Iron Logic"
|
||||
The model was developed using a specialized multi-stage pipeline:
|
||||
1. **Base Model** (EuroLLM)
|
||||
2. **FT Phase (Logic Injection):** High-noise token shuffling to harden the "Logic Core."
|
||||
3. **Standard SFT (Style Polish):** Final refinement for professional formatting and tone.
|
||||
|
||||
---
|
||||
|
||||
## ⚠️ Limitations
|
||||
While the model is exceptionally robust to input noise, users should verify real-time regulatory data (e.g., specific subsidy amounts), as the model's core strength lies in **Logical Reasoning and Intent Reconstruction** rather than being a real-time database.
|
||||
|
||||
## 🤝 Attribution
|
||||
This methodology and model were developed by **aifeifei798** in collaboration with **Gemini** conceptual frameworks.
|
||||
|
||||
```
|
||||
@misc{ramos2026eurollm22btechnicalreport,
|
||||
title={EuroLLM-22B: Technical Report},
|
||||
author={Miguel Moura Ramos and Duarte M. Alves and Hippolyte Gisserot-Boukhlef and João Alves and Pedro Henrique Martins and Patrick Fernandes and José Pombal and Nuno M. Guerreiro and Ricardo Rei and Nicolas Boizard and Amin Farajian and Mateusz Klimaszewski and José G. C. de Souza and Barry Haddow and François Yvon and Pierre Colombo and Alexandra Birch and André F. T. Martins},
|
||||
year={2026},
|
||||
eprint={2602.05879},
|
||||
archivePrefix={arXiv},
|
||||
primaryClass={cs.CL},
|
||||
url={https://arxiv.org/abs/2602.05879},
|
||||
}
|
||||
```
|
||||
|
||||
```
|
||||
@misc{aifeifei_2026,
|
||||
author = { aifeifei },
|
||||
title = { Fragmented-Training (Revision bb381c6) },
|
||||
year = 2026,
|
||||
url = { https://huggingface.co/aifeifei798/Fragmented-Training },
|
||||
doi = { 10.57967/hf/7592 },
|
||||
publisher = { Hugging Face }
|
||||
}
|
||||
```
|
||||
|
||||
```python
|
||||
from unsloth import FastLanguageModel
|
||||
import os
|
||||
import torch
|
||||
from datasets import load_dataset
|
||||
from trl import SFTConfig, SFTTrainer
|
||||
import random
|
||||
|
||||
# --- Configuration ---
|
||||
my_load_model = "EuroLLM-22B-Instruct-2512"
|
||||
my_model_name = "EuroBlocks_Sampled_100"
|
||||
max_seq_length = 8192
|
||||
|
||||
local_model_path = f"./models/{my_load_model}"
|
||||
local_data_file = f"./datasets/{my_model_name}/{my_model_name}.jsonl"
|
||||
final_model_path = f"./tmodels/{my_load_model}-FT-lora"
|
||||
|
||||
# 1. Load Model and Tokenizer
|
||||
print(f"✅ Step 1/6: Loading Base Model...")
|
||||
model, tokenizer = FastLanguageModel.from_pretrained(
|
||||
model_name=local_model_path,
|
||||
max_seq_length=max_seq_length,
|
||||
dtype=None, # Auto-detection
|
||||
load_in_4bit=True,
|
||||
use_gradient_checkpointing="unsloth",
|
||||
local_files_only=True,
|
||||
)
|
||||
|
||||
# 2. Synchronize Chat Template and Special Tokens
|
||||
print("✅ Step 2/6: Synchronizing Chat Template...")
|
||||
# Ensure padding tokens are correctly mapped for the EuroLLM/Olmo architecture
|
||||
tokenizer.pad_token = "<|pad|>"
|
||||
tokenizer.padding_side = "right"
|
||||
|
||||
# 3. LoRA Configuration (Optimized for RTX 5090)
|
||||
# We use Rank 64 to capture deep semantic relationships required for logic reconstruction
|
||||
print("✅ Step 3/6: Configuring LoRA (Rank 64 - High Capacity)...")
|
||||
model = FastLanguageModel.get_peft_model(
|
||||
model,
|
||||
r=64,
|
||||
target_modules=[
|
||||
"q_proj", "k_proj", "v_proj", "o_proj",
|
||||
"gate_proj", "up_proj", "down_proj",
|
||||
],
|
||||
lora_alpha=64,
|
||||
lora_dropout=0,
|
||||
bias="none",
|
||||
random_state=3407,
|
||||
)
|
||||
|
||||
# 4. Fragmented Training (FT) Logic: Injecting the "Cognitive Burden"
|
||||
def apply_burden(text, burden_ratio=0.7):
|
||||
"""
|
||||
Introduces stochastic token shuffling to decouple intent from grammatical linear dependency.
|
||||
"""
|
||||
if not text or not isinstance(text, str): return text
|
||||
words = text.split()
|
||||
if len(words) > 5:
|
||||
num_to_shuffle = int(len(words) * burden_ratio)
|
||||
indices_to_shuffle = random.sample(range(len(words)), num_to_shuffle)
|
||||
shuffled_subset = [words[i] for i in indices_to_shuffle]
|
||||
random.shuffle(shuffled_subset)
|
||||
shuffled_words = list(words)
|
||||
for i, original_index in enumerate(indices_to_shuffle):
|
||||
shuffled_words[original_index] = shuffled_subset[i]
|
||||
return ' '.join(shuffled_words)
|
||||
return text
|
||||
|
||||
def formatting_prompts_func(examples):
|
||||
texts = []
|
||||
for conversation in examples["conversations"]:
|
||||
processed_messages = []
|
||||
for msg in conversation:
|
||||
new_msg = msg.copy()
|
||||
# CORE FT LOGIC: Inject chaos strictly into the User input
|
||||
# This forces the model to denoise the input to reach the pristine Ground Truth output.
|
||||
if new_msg["role"] == "user":
|
||||
new_msg["content"] = apply_burden(new_msg["content"], burden_ratio=0.7)
|
||||
processed_messages.append(new_msg)
|
||||
|
||||
# Apply the official EuroLLM chat template
|
||||
text = tokenizer.apply_chat_template(
|
||||
processed_messages,
|
||||
tokenize=False,
|
||||
add_generation_prompt=False
|
||||
)
|
||||
texts.append(text)
|
||||
return {"text": texts}
|
||||
|
||||
print(f"✅ Step 4/6: Processing Dataset with 70% Noise Injection...")
|
||||
dataset = load_dataset("json", data_files=local_data_file, split="train")
|
||||
dataset = dataset.map(
|
||||
formatting_prompts_func,
|
||||
batched=True,
|
||||
remove_columns=dataset.column_names,
|
||||
load_from_cache_file=False,
|
||||
)
|
||||
|
||||
# Preview the "Chaos" sample
|
||||
print(f"🔍 Sample Fragmented Input:\n{dataset[0]['text']}")
|
||||
|
||||
# 5. Model Fine-Tuning (Iron Logic Execution)
|
||||
print("\n✅ Step 5/6: Starting SFT-FT Hybrid Training...")
|
||||
trainer = SFTTrainer(
|
||||
model=model,
|
||||
tokenizer=tokenizer,
|
||||
train_dataset=dataset,
|
||||
dataset_text_field="text",
|
||||
max_seq_length=max_seq_length,
|
||||
dataset_num_proc=8,
|
||||
packing=True, # Significantly boosts throughput on high-end GPUs like 5090
|
||||
args=SFTConfig(
|
||||
per_device_train_batch_size=8,
|
||||
gradient_accumulation_steps=1,
|
||||
warmup_steps=10,
|
||||
num_train_epochs=3,
|
||||
learning_rate=1e-4, # Higher LR to force weights out of local minima during denoising
|
||||
fp16=not torch.cuda.is_bf16_supported(),
|
||||
bf16=torch.cuda.is_bf16_supported(),
|
||||
logging_steps=10,
|
||||
optim="paged_adamw_8bit",
|
||||
weight_decay=0.01,
|
||||
lr_scheduler_type="cosine",
|
||||
seed=3407,
|
||||
output_dir="outputs",
|
||||
save_strategy="steps",
|
||||
save_steps=10,
|
||||
save_total_limit=10,
|
||||
load_best_model_at_end=False,
|
||||
report_to="none",
|
||||
),
|
||||
)
|
||||
|
||||
# Execute Training
|
||||
trainer.train(resume_from_checkpoint = True)
|
||||
|
||||
# 6. Saving the Reinforced FT-LoRA
|
||||
print("\n✅ Step 6/6: Persisting FT-LoRA Weights...")
|
||||
model.save_pretrained(final_model_path)
|
||||
tokenizer.save_pretrained(final_model_path)
|
||||
print(f"🎉 Experiment Successful! FT Model saved to: {final_model_path}")
|
||||
```
|
||||
4
chat_template.jinja
Normal file
4
chat_template.jinja
Normal file
@@ -0,0 +1,4 @@
|
||||
{% for message in messages %}{% if message['role'] == 'assistant' %}{% set role = 'assistant' %}{% else %}{% set role = message['role'] %}{% endif %}<|im_start|>{{ role }}
|
||||
{{ message['content'] | trim }}<|im_end|>
|
||||
{% endfor %}{% if add_generation_prompt %}{{'<|im_start|>assistant
|
||||
'}}{% endif %}
|
||||
29
config.json
Normal file
29
config.json
Normal file
@@ -0,0 +1,29 @@
|
||||
{
|
||||
"architectures": [
|
||||
"LlamaForCausalLM"
|
||||
],
|
||||
"attention_bias": false,
|
||||
"attention_dropout": 0.0,
|
||||
"bos_token_id": 1,
|
||||
"dtype": "bfloat16",
|
||||
"eos_token_id": 4,
|
||||
"head_dim": 128,
|
||||
"hidden_act": "silu",
|
||||
"hidden_size": 6144,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 16384,
|
||||
"max_position_embeddings": 32768,
|
||||
"mlp_bias": false,
|
||||
"model_type": "llama",
|
||||
"num_attention_heads": 48,
|
||||
"num_hidden_layers": 54,
|
||||
"num_key_value_heads": 8,
|
||||
"pretraining_tp": 1,
|
||||
"rms_norm_eps": 1e-05,
|
||||
"rope_scaling": null,
|
||||
"rope_theta": 1000000,
|
||||
"tie_word_embeddings": false,
|
||||
"transformers_version": "4.57.6",
|
||||
"use_cache": false,
|
||||
"vocab_size": 128000
|
||||
}
|
||||
7
generation_config.json
Normal file
7
generation_config.json
Normal file
@@ -0,0 +1,7 @@
|
||||
{
|
||||
"_from_model_config": true,
|
||||
"bos_token_id": 3,
|
||||
"do_sample": true,
|
||||
"eos_token_id": 4,
|
||||
"transformers_version": "4.57.6"
|
||||
}
|
||||
3
model-00001-of-00046.safetensors
Normal file
3
model-00001-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:cb178ea7337e6847e59982094f3aeb10984a2019d69ea195644a28664a7bb526
|
||||
size 1572864144
|
||||
3
model-00002-of-00046.safetensors
Normal file
3
model-00002-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d167e9fc9d4fc5828004f0b6857c2667cfc113190d9d8bc096a5c59757ef5380
|
||||
size 956327400
|
||||
3
model-00003-of-00046.safetensors
Normal file
3
model-00003-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:673a6a2d01bbdaf05c66752b0872da02bdc45374fbd10fdea7b855e6414f03b5
|
||||
size 981492880
|
||||
3
model-00004-of-00046.safetensors
Normal file
3
model-00004-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:38a27a6c1b4ec53cfa7da4eb7c6ce0696c6ed51e54a0a046c9955b933f9e0ddf
|
||||
size 981492872
|
||||
3
model-00005-of-00046.safetensors
Normal file
3
model-00005-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5b24a89a7c90b5ecb67ad09a86e0996f69c8c4e50c8865111bd78e28ecccf93f
|
||||
size 981517680
|
||||
3
model-00006-of-00046.safetensors
Normal file
3
model-00006-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ea35792e392dd18aa9f80a1d0141c0ed0bcfb7a4e5553ed7c6014250555a1bd7
|
||||
size 956327400
|
||||
3
model-00007-of-00046.safetensors
Normal file
3
model-00007-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b59b53284e156a3f445b99577f5e4fa20b800263caa31fab8fa2979a0c3bed4c
|
||||
size 981492880
|
||||
3
model-00008-of-00046.safetensors
Normal file
3
model-00008-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:89004934a550122e56cbfef13bef08fca2f3bd2239d1dbb05c44531c5508a384
|
||||
size 981492872
|
||||
3
model-00009-of-00046.safetensors
Normal file
3
model-00009-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:abe8ad0538d7f1ef100dc5b6686cde305ebb08858f6b59f03629ee63b44087cb
|
||||
size 981517680
|
||||
3
model-00010-of-00046.safetensors
Normal file
3
model-00010-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f9bd1375aeec5864f4e19ecd3c15005470988c86c1c5c8390c6d00ebf0f78dd1
|
||||
size 956327416
|
||||
3
model-00011-of-00046.safetensors
Normal file
3
model-00011-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:757ffcc2ca30113d371796195d6f961da0a4f0e652a55c7dd1f99d3158b7e5b1
|
||||
size 981492888
|
||||
3
model-00012-of-00046.safetensors
Normal file
3
model-00012-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3e6fb2c746feb8aec1bc8738168610bc10e7bad3b0b86d3ad04f2dcb2a1b4269
|
||||
size 981492888
|
||||
3
model-00013-of-00046.safetensors
Normal file
3
model-00013-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:671c0f63a325713eb362aad1fa7ec144e90f100611b35267441f6b52c301687e
|
||||
size 981517688
|
||||
3
model-00014-of-00046.safetensors
Normal file
3
model-00014-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:bc6e1095b55e6f615192fc79643887790bfc3b80e381283ded5e7ae734ac667f
|
||||
size 956327416
|
||||
3
model-00015-of-00046.safetensors
Normal file
3
model-00015-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f992af609680db167878b2497b3e8e802c9f278a00c72ee838c9edb0c05fb861
|
||||
size 981492888
|
||||
3
model-00016-of-00046.safetensors
Normal file
3
model-00016-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e79150ffd8ce27d0d9727523fe305339e05e020182fb59a85b13231272db4336
|
||||
size 981492888
|
||||
3
model-00017-of-00046.safetensors
Normal file
3
model-00017-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:a28d8730925555cba1ef4e6980ff6eb876ed5685742b4adb26df70d955e5cdda
|
||||
size 981517688
|
||||
3
model-00018-of-00046.safetensors
Normal file
3
model-00018-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:724ad951722fc9be1924c9559538e09954aa962c24ee7699064bd488952d5b1c
|
||||
size 956327416
|
||||
3
model-00019-of-00046.safetensors
Normal file
3
model-00019-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:56bc57ea91d293112ba41b4b62dd84f8d4aef38486a322e69f72d1668ac87aa0
|
||||
size 981492888
|
||||
3
model-00020-of-00046.safetensors
Normal file
3
model-00020-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ec00b9d6998c12c10e58e18294a3c485851eaa06b322263b5e96a14f2d95edfa
|
||||
size 981492888
|
||||
3
model-00021-of-00046.safetensors
Normal file
3
model-00021-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:99b6164bba6cd288d0f5b9aadde993ee33069f46ff77e38d0497fd24acd640ea
|
||||
size 981517688
|
||||
3
model-00022-of-00046.safetensors
Normal file
3
model-00022-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:c7483930a1dede38722d8dddf9c712747778fe8dba20995ea94846423338b97d
|
||||
size 956327416
|
||||
3
model-00023-of-00046.safetensors
Normal file
3
model-00023-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:cfcdbf06f4fa326005f7f7d06bcb8dfdf8a0c4c01d51469c3d0e671b315830ac
|
||||
size 981492888
|
||||
3
model-00024-of-00046.safetensors
Normal file
3
model-00024-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0234902d7917bbfbf610cc026e958bb8075bc9a729631287ff720947e2704a20
|
||||
size 981492888
|
||||
3
model-00025-of-00046.safetensors
Normal file
3
model-00025-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b1be164f3a7fb7ccb32eea7f1c47fd2c77868a66e2e782e7342b793376cd179e
|
||||
size 981517688
|
||||
3
model-00026-of-00046.safetensors
Normal file
3
model-00026-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ef2f225e5954f4068d4ab9a3886d2d4d06b8bdcdd1755c2c19368467d9e53ee4
|
||||
size 956327416
|
||||
3
model-00027-of-00046.safetensors
Normal file
3
model-00027-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:1f2b92ca948994ab3a32c23b98d75a26fc34470469c42b0035270daac88b838d
|
||||
size 981492888
|
||||
3
model-00028-of-00046.safetensors
Normal file
3
model-00028-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:96b51c5341f6cc749a5cb5dab27425ad01c4977f2751e2c613ebbbc9eb981693
|
||||
size 981492888
|
||||
3
model-00029-of-00046.safetensors
Normal file
3
model-00029-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b3383785432a775a62932cae3e60b39a507feca4c15d469937c91bce74f70e14
|
||||
size 981517688
|
||||
3
model-00030-of-00046.safetensors
Normal file
3
model-00030-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:addba1bd1595ed60c2414ffd4a9ff6d43cecefda32254215947debd2e785462a
|
||||
size 956327416
|
||||
3
model-00031-of-00046.safetensors
Normal file
3
model-00031-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:618f923df92e2731a70364ead406ba42ab44db6784c4b8e6e51986259c1a9d9f
|
||||
size 981492888
|
||||
3
model-00032-of-00046.safetensors
Normal file
3
model-00032-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:86e85cd14a1363dc8df88e7d994e5fa16d63284e1d7abea8c17974bd6cd3cc64
|
||||
size 981492888
|
||||
3
model-00033-of-00046.safetensors
Normal file
3
model-00033-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:daf32ad52ee3963643dd44c02e8361e066b7a00828af722ec32d8f65b6778658
|
||||
size 981517688
|
||||
3
model-00034-of-00046.safetensors
Normal file
3
model-00034-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:00f3d3821f22e91cb83729378e3b13fe5149b47de16f63d8c42d424a934e10bd
|
||||
size 956327416
|
||||
3
model-00035-of-00046.safetensors
Normal file
3
model-00035-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3e6898025f59866ffcc96d713f7f0dbc854425e1dfb2690159cd8b1090767d4f
|
||||
size 981492888
|
||||
3
model-00036-of-00046.safetensors
Normal file
3
model-00036-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5f7a5b73ef956d1459e9a0522b517c700dcc9baf6653df4977f8d72c3a0b91ce
|
||||
size 981492888
|
||||
3
model-00037-of-00046.safetensors
Normal file
3
model-00037-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:5fad3b6755b82e95720ea7c11df20938d94bed41f52c03f7e8c40e8c3047ef22
|
||||
size 981517688
|
||||
3
model-00038-of-00046.safetensors
Normal file
3
model-00038-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f52a030839fa4fe069bd38fb6adbed282a07eb990975220801212264e44cac79
|
||||
size 956327416
|
||||
3
model-00039-of-00046.safetensors
Normal file
3
model-00039-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:ec604cc658b686c9427004858f01067181615a3f122fe9b42c18424ee842543e
|
||||
size 981492888
|
||||
3
model-00040-of-00046.safetensors
Normal file
3
model-00040-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:4ac3bebf8a7d92b28aa2c3220938e484d2c8e6768c8b5023eaab698db5c085fa
|
||||
size 981492888
|
||||
3
model-00041-of-00046.safetensors
Normal file
3
model-00041-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e7d6ba3242103b20276ff7a3ea566f5ef378ad2492e72abf70da16b771404f4f
|
||||
size 981517688
|
||||
3
model-00042-of-00046.safetensors
Normal file
3
model-00042-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:487519293405ab3721d7ceb4218a3ac8e789f04807b52914e831007180b017c1
|
||||
size 956327416
|
||||
3
model-00043-of-00046.safetensors
Normal file
3
model-00043-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b9ffee2ecbc30cf7e658443639630e4c1268d709f6394fc06eef32b494726de0
|
||||
size 981492888
|
||||
3
model-00044-of-00046.safetensors
Normal file
3
model-00044-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3fd7ebdf4e8a5a3dc9bb37978e0392507050b91ac45a28841fd2e7e9300cb453
|
||||
size 981492888
|
||||
3
model-00045-of-00046.safetensors
Normal file
3
model-00045-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b27d28de29be8d883f75edd457ae26fecdfc101d54307f4e3b8e57ac6dc8c06d
|
||||
size 1572864128
|
||||
3
model-00046-of-00046.safetensors
Normal file
3
model-00046-of-00046.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0a44054d4d14701c621dd263e0b1804a462426dcfeb2a22834fad32c8ccd8028
|
||||
size 201363912
|
||||
497
model.safetensors.index.json
Normal file
497
model.safetensors.index.json
Normal file
@@ -0,0 +1,497 @@
|
||||
{
|
||||
"metadata": {
|
||||
"total_parameters": 22637328384,
|
||||
"total_size": 45274656768
|
||||
},
|
||||
"weight_map": {
|
||||
"lm_head.weight": "model-00045-of-00046.safetensors",
|
||||
"model.embed_tokens.weight": "model-00001-of-00046.safetensors",
|
||||
"model.layers.0.input_layernorm.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.0.mlp.down_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.0.mlp.gate_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.0.mlp.up_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.0.post_attention_layernorm.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.0.self_attn.k_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.0.self_attn.o_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.0.self_attn.q_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.0.self_attn.v_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.1.input_layernorm.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.1.mlp.down_proj.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.1.mlp.gate_proj.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.1.mlp.up_proj.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.1.post_attention_layernorm.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.1.self_attn.k_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.1.self_attn.o_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.1.self_attn.q_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.1.self_attn.v_proj.weight": "model-00002-of-00046.safetensors",
|
||||
"model.layers.10.input_layernorm.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.10.mlp.down_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.10.mlp.gate_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.10.mlp.up_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.10.post_attention_layernorm.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.10.self_attn.k_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.10.self_attn.o_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.10.self_attn.q_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.10.self_attn.v_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.11.input_layernorm.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.11.mlp.down_proj.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.11.mlp.gate_proj.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.11.mlp.up_proj.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.11.post_attention_layernorm.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.11.self_attn.k_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.11.self_attn.o_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.11.self_attn.q_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.11.self_attn.v_proj.weight": "model-00010-of-00046.safetensors",
|
||||
"model.layers.12.input_layernorm.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.12.mlp.down_proj.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.12.mlp.gate_proj.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.12.mlp.up_proj.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.12.post_attention_layernorm.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.12.self_attn.k_proj.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.12.self_attn.o_proj.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.12.self_attn.q_proj.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.12.self_attn.v_proj.weight": "model-00011-of-00046.safetensors",
|
||||
"model.layers.13.input_layernorm.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.13.mlp.down_proj.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.13.mlp.gate_proj.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.13.mlp.up_proj.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.13.post_attention_layernorm.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.13.self_attn.k_proj.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.13.self_attn.o_proj.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.13.self_attn.q_proj.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.13.self_attn.v_proj.weight": "model-00012-of-00046.safetensors",
|
||||
"model.layers.14.input_layernorm.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.14.mlp.down_proj.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.14.mlp.gate_proj.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.14.mlp.up_proj.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.14.post_attention_layernorm.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.14.self_attn.k_proj.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.14.self_attn.o_proj.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.14.self_attn.q_proj.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.14.self_attn.v_proj.weight": "model-00013-of-00046.safetensors",
|
||||
"model.layers.15.input_layernorm.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.15.mlp.down_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.15.mlp.gate_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.15.mlp.up_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.15.post_attention_layernorm.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.15.self_attn.k_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.15.self_attn.o_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.15.self_attn.q_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.15.self_attn.v_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.16.input_layernorm.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.16.mlp.down_proj.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.16.mlp.gate_proj.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.16.mlp.up_proj.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.16.post_attention_layernorm.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.16.self_attn.k_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.16.self_attn.o_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.16.self_attn.q_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.16.self_attn.v_proj.weight": "model-00014-of-00046.safetensors",
|
||||
"model.layers.17.input_layernorm.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.17.mlp.down_proj.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.17.mlp.gate_proj.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.17.mlp.up_proj.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.17.post_attention_layernorm.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.17.self_attn.k_proj.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.17.self_attn.o_proj.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.17.self_attn.q_proj.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.17.self_attn.v_proj.weight": "model-00015-of-00046.safetensors",
|
||||
"model.layers.18.input_layernorm.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.18.mlp.down_proj.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.18.mlp.gate_proj.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.18.mlp.up_proj.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.18.post_attention_layernorm.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.18.self_attn.k_proj.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.18.self_attn.o_proj.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.18.self_attn.q_proj.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.18.self_attn.v_proj.weight": "model-00016-of-00046.safetensors",
|
||||
"model.layers.19.input_layernorm.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.19.mlp.down_proj.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.19.mlp.gate_proj.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.19.mlp.up_proj.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.19.post_attention_layernorm.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.19.self_attn.k_proj.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.19.self_attn.o_proj.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.19.self_attn.q_proj.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.19.self_attn.v_proj.weight": "model-00017-of-00046.safetensors",
|
||||
"model.layers.2.input_layernorm.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.2.mlp.down_proj.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.2.mlp.gate_proj.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.2.mlp.up_proj.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.2.post_attention_layernorm.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.2.self_attn.k_proj.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.2.self_attn.o_proj.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.2.self_attn.q_proj.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.2.self_attn.v_proj.weight": "model-00003-of-00046.safetensors",
|
||||
"model.layers.20.input_layernorm.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.20.mlp.down_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.20.mlp.gate_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.20.mlp.up_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.20.post_attention_layernorm.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.20.self_attn.k_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.20.self_attn.o_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.20.self_attn.q_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.20.self_attn.v_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.21.input_layernorm.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.21.mlp.down_proj.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.21.mlp.gate_proj.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.21.mlp.up_proj.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.21.post_attention_layernorm.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.21.self_attn.k_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.21.self_attn.o_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.21.self_attn.q_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.21.self_attn.v_proj.weight": "model-00018-of-00046.safetensors",
|
||||
"model.layers.22.input_layernorm.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.22.mlp.down_proj.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.22.mlp.gate_proj.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.22.mlp.up_proj.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.22.post_attention_layernorm.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.22.self_attn.k_proj.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.22.self_attn.o_proj.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.22.self_attn.q_proj.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.22.self_attn.v_proj.weight": "model-00019-of-00046.safetensors",
|
||||
"model.layers.23.input_layernorm.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.23.mlp.down_proj.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.23.mlp.gate_proj.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.23.mlp.up_proj.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.23.post_attention_layernorm.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.23.self_attn.k_proj.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.23.self_attn.o_proj.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.23.self_attn.q_proj.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.23.self_attn.v_proj.weight": "model-00020-of-00046.safetensors",
|
||||
"model.layers.24.input_layernorm.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.24.mlp.down_proj.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.24.mlp.gate_proj.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.24.mlp.up_proj.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.24.post_attention_layernorm.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.24.self_attn.k_proj.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.24.self_attn.o_proj.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.24.self_attn.q_proj.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.24.self_attn.v_proj.weight": "model-00021-of-00046.safetensors",
|
||||
"model.layers.25.input_layernorm.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.25.mlp.down_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.25.mlp.gate_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.25.mlp.up_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.25.post_attention_layernorm.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.25.self_attn.k_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.25.self_attn.o_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.25.self_attn.q_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.25.self_attn.v_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.26.input_layernorm.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.26.mlp.down_proj.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.26.mlp.gate_proj.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.26.mlp.up_proj.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.26.post_attention_layernorm.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.26.self_attn.k_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.26.self_attn.o_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.26.self_attn.q_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.26.self_attn.v_proj.weight": "model-00022-of-00046.safetensors",
|
||||
"model.layers.27.input_layernorm.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.27.mlp.down_proj.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.27.mlp.gate_proj.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.27.mlp.up_proj.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.27.post_attention_layernorm.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.27.self_attn.k_proj.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.27.self_attn.o_proj.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.27.self_attn.q_proj.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.27.self_attn.v_proj.weight": "model-00023-of-00046.safetensors",
|
||||
"model.layers.28.input_layernorm.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.28.mlp.down_proj.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.28.mlp.gate_proj.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.28.mlp.up_proj.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.28.post_attention_layernorm.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.28.self_attn.k_proj.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.28.self_attn.o_proj.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.28.self_attn.q_proj.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.28.self_attn.v_proj.weight": "model-00024-of-00046.safetensors",
|
||||
"model.layers.29.input_layernorm.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.29.mlp.down_proj.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.29.mlp.gate_proj.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.29.mlp.up_proj.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.29.post_attention_layernorm.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.29.self_attn.k_proj.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.29.self_attn.o_proj.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.29.self_attn.q_proj.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.29.self_attn.v_proj.weight": "model-00025-of-00046.safetensors",
|
||||
"model.layers.3.input_layernorm.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.3.mlp.down_proj.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.3.mlp.gate_proj.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.3.mlp.up_proj.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.3.post_attention_layernorm.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.3.self_attn.k_proj.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.3.self_attn.o_proj.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.3.self_attn.q_proj.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.3.self_attn.v_proj.weight": "model-00004-of-00046.safetensors",
|
||||
"model.layers.30.input_layernorm.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.30.mlp.down_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.30.mlp.gate_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.30.mlp.up_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.30.post_attention_layernorm.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.30.self_attn.k_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.30.self_attn.o_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.30.self_attn.q_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.30.self_attn.v_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.31.input_layernorm.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.31.mlp.down_proj.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.31.mlp.gate_proj.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.31.mlp.up_proj.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.31.post_attention_layernorm.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.31.self_attn.k_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.31.self_attn.o_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.31.self_attn.q_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.31.self_attn.v_proj.weight": "model-00026-of-00046.safetensors",
|
||||
"model.layers.32.input_layernorm.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.32.mlp.down_proj.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.32.mlp.gate_proj.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.32.mlp.up_proj.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.32.post_attention_layernorm.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.32.self_attn.k_proj.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.32.self_attn.o_proj.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.32.self_attn.q_proj.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.32.self_attn.v_proj.weight": "model-00027-of-00046.safetensors",
|
||||
"model.layers.33.input_layernorm.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.33.mlp.down_proj.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.33.mlp.gate_proj.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.33.mlp.up_proj.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.33.post_attention_layernorm.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.33.self_attn.k_proj.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.33.self_attn.o_proj.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.33.self_attn.q_proj.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.33.self_attn.v_proj.weight": "model-00028-of-00046.safetensors",
|
||||
"model.layers.34.input_layernorm.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.34.mlp.down_proj.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.34.mlp.gate_proj.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.34.mlp.up_proj.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.34.post_attention_layernorm.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.34.self_attn.k_proj.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.34.self_attn.o_proj.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.34.self_attn.q_proj.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.34.self_attn.v_proj.weight": "model-00029-of-00046.safetensors",
|
||||
"model.layers.35.input_layernorm.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.35.mlp.down_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.35.mlp.gate_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.35.mlp.up_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.35.post_attention_layernorm.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.35.self_attn.k_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.35.self_attn.o_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.35.self_attn.q_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.35.self_attn.v_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.36.input_layernorm.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.36.mlp.down_proj.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.36.mlp.gate_proj.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.36.mlp.up_proj.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.36.post_attention_layernorm.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.36.self_attn.k_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.36.self_attn.o_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.36.self_attn.q_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.36.self_attn.v_proj.weight": "model-00030-of-00046.safetensors",
|
||||
"model.layers.37.input_layernorm.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.37.mlp.down_proj.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.37.mlp.gate_proj.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.37.mlp.up_proj.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.37.post_attention_layernorm.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.37.self_attn.k_proj.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.37.self_attn.o_proj.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.37.self_attn.q_proj.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.37.self_attn.v_proj.weight": "model-00031-of-00046.safetensors",
|
||||
"model.layers.38.input_layernorm.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.38.mlp.down_proj.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.38.mlp.gate_proj.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.38.mlp.up_proj.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.38.post_attention_layernorm.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.38.self_attn.k_proj.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.38.self_attn.o_proj.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.38.self_attn.q_proj.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.38.self_attn.v_proj.weight": "model-00032-of-00046.safetensors",
|
||||
"model.layers.39.input_layernorm.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.39.mlp.down_proj.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.39.mlp.gate_proj.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.39.mlp.up_proj.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.39.post_attention_layernorm.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.39.self_attn.k_proj.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.39.self_attn.o_proj.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.39.self_attn.q_proj.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.39.self_attn.v_proj.weight": "model-00033-of-00046.safetensors",
|
||||
"model.layers.4.input_layernorm.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.4.mlp.down_proj.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.4.mlp.gate_proj.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.4.mlp.up_proj.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.4.post_attention_layernorm.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.4.self_attn.k_proj.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.4.self_attn.o_proj.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.4.self_attn.q_proj.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.4.self_attn.v_proj.weight": "model-00005-of-00046.safetensors",
|
||||
"model.layers.40.input_layernorm.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.40.mlp.down_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.40.mlp.gate_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.40.mlp.up_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.40.post_attention_layernorm.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.40.self_attn.k_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.40.self_attn.o_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.40.self_attn.q_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.40.self_attn.v_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.41.input_layernorm.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.41.mlp.down_proj.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.41.mlp.gate_proj.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.41.mlp.up_proj.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.41.post_attention_layernorm.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.41.self_attn.k_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.41.self_attn.o_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.41.self_attn.q_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.41.self_attn.v_proj.weight": "model-00034-of-00046.safetensors",
|
||||
"model.layers.42.input_layernorm.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.42.mlp.down_proj.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.42.mlp.gate_proj.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.42.mlp.up_proj.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.42.post_attention_layernorm.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.42.self_attn.k_proj.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.42.self_attn.o_proj.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.42.self_attn.q_proj.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.42.self_attn.v_proj.weight": "model-00035-of-00046.safetensors",
|
||||
"model.layers.43.input_layernorm.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.43.mlp.down_proj.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.43.mlp.gate_proj.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.43.mlp.up_proj.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.43.post_attention_layernorm.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.43.self_attn.k_proj.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.43.self_attn.o_proj.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.43.self_attn.q_proj.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.43.self_attn.v_proj.weight": "model-00036-of-00046.safetensors",
|
||||
"model.layers.44.input_layernorm.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.44.mlp.down_proj.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.44.mlp.gate_proj.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.44.mlp.up_proj.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.44.post_attention_layernorm.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.44.self_attn.k_proj.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.44.self_attn.o_proj.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.44.self_attn.q_proj.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.44.self_attn.v_proj.weight": "model-00037-of-00046.safetensors",
|
||||
"model.layers.45.input_layernorm.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.45.mlp.down_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.45.mlp.gate_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.45.mlp.up_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.45.post_attention_layernorm.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.45.self_attn.k_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.45.self_attn.o_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.45.self_attn.q_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.45.self_attn.v_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.46.input_layernorm.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.46.mlp.down_proj.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.46.mlp.gate_proj.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.46.mlp.up_proj.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.46.post_attention_layernorm.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.46.self_attn.k_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.46.self_attn.o_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.46.self_attn.q_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.46.self_attn.v_proj.weight": "model-00038-of-00046.safetensors",
|
||||
"model.layers.47.input_layernorm.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.47.mlp.down_proj.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.47.mlp.gate_proj.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.47.mlp.up_proj.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.47.post_attention_layernorm.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.47.self_attn.k_proj.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.47.self_attn.o_proj.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.47.self_attn.q_proj.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.47.self_attn.v_proj.weight": "model-00039-of-00046.safetensors",
|
||||
"model.layers.48.input_layernorm.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.48.mlp.down_proj.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.48.mlp.gate_proj.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.48.mlp.up_proj.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.48.post_attention_layernorm.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.48.self_attn.k_proj.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.48.self_attn.o_proj.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.48.self_attn.q_proj.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.48.self_attn.v_proj.weight": "model-00040-of-00046.safetensors",
|
||||
"model.layers.49.input_layernorm.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.49.mlp.down_proj.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.49.mlp.gate_proj.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.49.mlp.up_proj.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.49.post_attention_layernorm.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.49.self_attn.k_proj.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.49.self_attn.o_proj.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.49.self_attn.q_proj.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.49.self_attn.v_proj.weight": "model-00041-of-00046.safetensors",
|
||||
"model.layers.5.input_layernorm.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.5.mlp.down_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.5.mlp.gate_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.5.mlp.up_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.5.post_attention_layernorm.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.5.self_attn.k_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.5.self_attn.o_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.5.self_attn.q_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.5.self_attn.v_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.50.input_layernorm.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.50.mlp.down_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.50.mlp.gate_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.50.mlp.up_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.50.post_attention_layernorm.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.50.self_attn.k_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.50.self_attn.o_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.50.self_attn.q_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.50.self_attn.v_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.51.input_layernorm.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.51.mlp.down_proj.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.51.mlp.gate_proj.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.51.mlp.up_proj.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.51.post_attention_layernorm.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.51.self_attn.k_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.51.self_attn.o_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.51.self_attn.q_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.51.self_attn.v_proj.weight": "model-00042-of-00046.safetensors",
|
||||
"model.layers.52.input_layernorm.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.52.mlp.down_proj.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.52.mlp.gate_proj.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.52.mlp.up_proj.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.52.post_attention_layernorm.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.52.self_attn.k_proj.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.52.self_attn.o_proj.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.52.self_attn.q_proj.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.52.self_attn.v_proj.weight": "model-00043-of-00046.safetensors",
|
||||
"model.layers.53.input_layernorm.weight": "model-00046-of-00046.safetensors",
|
||||
"model.layers.53.mlp.down_proj.weight": "model-00046-of-00046.safetensors",
|
||||
"model.layers.53.mlp.gate_proj.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.53.mlp.up_proj.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.53.post_attention_layernorm.weight": "model-00046-of-00046.safetensors",
|
||||
"model.layers.53.self_attn.k_proj.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.53.self_attn.o_proj.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.53.self_attn.q_proj.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.53.self_attn.v_proj.weight": "model-00044-of-00046.safetensors",
|
||||
"model.layers.6.input_layernorm.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.6.mlp.down_proj.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.6.mlp.gate_proj.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.6.mlp.up_proj.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.6.post_attention_layernorm.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.6.self_attn.k_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.6.self_attn.o_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.6.self_attn.q_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.6.self_attn.v_proj.weight": "model-00006-of-00046.safetensors",
|
||||
"model.layers.7.input_layernorm.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.7.mlp.down_proj.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.7.mlp.gate_proj.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.7.mlp.up_proj.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.7.post_attention_layernorm.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.7.self_attn.k_proj.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.7.self_attn.o_proj.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.7.self_attn.q_proj.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.7.self_attn.v_proj.weight": "model-00007-of-00046.safetensors",
|
||||
"model.layers.8.input_layernorm.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.8.mlp.down_proj.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.8.mlp.gate_proj.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.8.mlp.up_proj.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.8.post_attention_layernorm.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.8.self_attn.k_proj.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.8.self_attn.o_proj.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.8.self_attn.q_proj.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.8.self_attn.v_proj.weight": "model-00008-of-00046.safetensors",
|
||||
"model.layers.9.input_layernorm.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.9.mlp.down_proj.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.9.mlp.gate_proj.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.9.mlp.up_proj.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.9.post_attention_layernorm.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.9.self_attn.k_proj.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.9.self_attn.o_proj.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.9.self_attn.q_proj.weight": "model-00009-of-00046.safetensors",
|
||||
"model.layers.9.self_attn.v_proj.weight": "model-00009-of-00046.safetensors",
|
||||
"model.norm.weight": "model-00046-of-00046.safetensors"
|
||||
}
|
||||
}
|
||||
30
special_tokens_map.json
Normal file
30
special_tokens_map.json
Normal file
@@ -0,0 +1,30 @@
|
||||
{
|
||||
"bos_token": {
|
||||
"content": "<s>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"eos_token": {
|
||||
"content": "<|im_end|>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"pad_token": {
|
||||
"content": "</s>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"unk_token": {
|
||||
"content": "<unk>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
}
|
||||
}
|
||||
3
tokenizer.json
Normal file
3
tokenizer.json
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d869676e23a78b395eb0308cff52fd9c3ea7d52597627360cdb97407bb0b02b8
|
||||
size 15783075
|
||||
3
tokenizer.model
Normal file
3
tokenizer.model
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:42957aec88804838805b335da1bbcce9d116024a20c6c4b56757648b9e348254
|
||||
size 2408875
|
||||
2107
tokenizer_config.json
Normal file
2107
tokenizer_config.json
Normal file
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user