初始化项目，由ModelHub XC社区提供模型
Model: positron-ai/microsoft_phi-4-ingest-best-gptq Source: Original Platform
This commit is contained in:
ModelHub XC
35
.gitattributes
vendored
Normal file
35
.gitattributes
vendored
Normal file
@@ -0,0 +1,35 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
9
CODE_OF_CONDUCT.md
Normal file
9
CODE_OF_CONDUCT.md
Normal file
@@ -0,0 +1,9 @@
|
||||
# Microsoft Open Source Code of Conduct
|
||||
|
||||
This project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/).
|
||||
|
||||
Resources:
|
||||
|
||||
- [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/)
|
||||
- [Microsoft Code of Conduct FAQ](https://opensource.microsoft.com/codeofconduct/faq/)
|
||||
- Contact [opencode@microsoft.com](mailto:opencode@microsoft.com) with questions or concerns
|
||||
22
LICENSE
Normal file
22
LICENSE
Normal file
@@ -0,0 +1,22 @@
|
||||
Microsoft.
|
||||
Copyright (c) Microsoft Corporation.
|
||||
|
||||
MIT License
|
||||
|
||||
Permission is hereby granted, free of charge, to any person obtaining a copy
|
||||
of this software and associated documentation files (the "Software"), to deal
|
||||
in the Software without restriction, including without limitation the rights
|
||||
to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
|
||||
copies of the Software, and to permit persons to whom the Software is
|
||||
furnished to do so, subject to the following conditions:
|
||||
|
||||
The above copyright notice and this permission notice shall be included in all
|
||||
copies or substantial portions of the Software.
|
||||
|
||||
THE SOFTWARE IS PROVIDED *AS IS*, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
|
||||
IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
|
||||
FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
|
||||
AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
|
||||
LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
|
||||
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
|
||||
SOFTWARE.
|
||||
84
README.md
Normal file
84
README.md
Normal file
@@ -0,0 +1,84 @@
|
||||
---
|
||||
base_model: microsoft/phi-4
|
||||
library_name: transformers
|
||||
license: mit
|
||||
pipeline_tag: text-generation
|
||||
tags:
|
||||
- positron-ai
|
||||
- quantized
|
||||
- gptq
|
||||
---
|
||||
|
||||
# Positron AI Quantized Build
|
||||
|
||||
This repository contains a Positron AI quantized build of microsoft/phi-4 for tron inference on Positron FPGA-serving infrastructure.
|
||||
|
||||
## Recommended Use
|
||||
|
||||
Use this artifact when you need a GPTQ 4-bit build of microsoft/phi-4 optimized for Positron's tron runtime. This build targets Positron's ingest-serving path, where runtime fidelity and FPGA deployability are prioritized over general-purpose GPU portability.
|
||||
|
||||
For general-purpose GPU inference, compare against the original model and other quantized formats before deployment.
|
||||
|
||||
## Artifact Summary
|
||||
|
||||
| Field | Value |
|
||||
|---|---|
|
||||
| Base model | microsoft/phi-4 |
|
||||
| Published artifact | microsoft_phi-4-ingest-best-gptq |
|
||||
| Quantization method | GPTQ |
|
||||
| Quantization format | gptq |
|
||||
| Source precision | n/a |
|
||||
| Target runtime | tron |
|
||||
| Hardware target | FPGA |
|
||||
| Release date | 2026-06-30 |
|
||||
| License | mit |
|
||||
|
||||
## Quantization Details
|
||||
|
||||
| Field | Value |
|
||||
|---|---|
|
||||
| Weight precision | 4-bit |
|
||||
| Activation precision | not quantized |
|
||||
| Bits | 4 |
|
||||
| Group size | 64 |
|
||||
| Symmetric quantization | true |
|
||||
| Activation ordering / desc_act | false |
|
||||
| Damp percent | 0.05 |
|
||||
| Calibration dataset | Universal mixed-domain set |
|
||||
| Calibration samples | 256 |
|
||||
| Calibration sequence length | 4096 |
|
||||
| MoE experts per token | n/a |
|
||||
| Quantization toolchain | GPTQModel 5.8.0, transformers 4.57.6, torch 2.9.1, CUDA 12.8 |
|
||||
|
||||
## Validation Results
|
||||
|
||||
| Metric | Result | Reference | Notes |
|
||||
|---|---|---|---|
|
||||
| Mean KL-divergence | 0.0183 | microsoft/phi-4 | Mean across the prompt suite |
|
||||
| P95 KL-divergence | 0.0753 | microsoft/phi-4 | Mean of per-prompt 95th-percentile token KL-divergence |
|
||||
| Top-1 agreement | 0.9523 | microsoft/phi-4 | Greedy top-1 token agreement |
|
||||
| Perplexity / NLL delta | +1.7% | microsoft/phi-4 | Same prompt suite as KL-divergence |
|
||||
| MMLU mean | pending | n/a | Evaluation pending |
|
||||
|
||||
KL-divergence measures token-distribution drift between this quantized artifact and the BF16 reference model; lower values indicate closer agreement. It was computed on Positron's tron FPGA-serving path, so treat it as a runtime-specific drift measurement rather than a GPU benchmark.
|
||||
|
||||
## Evaluation Methodology
|
||||
|
||||
| Field | Value |
|
||||
|---|---|
|
||||
| Evaluation date | 2026-06-30 |
|
||||
| Evaluation suite | Positron mixed-domain prompt suite |
|
||||
| Number of prompts | 12 |
|
||||
| Runtime | tron |
|
||||
| Device | FPGA |
|
||||
| Pass criteria | Measurement only (no fixed KL-divergence threshold) |
|
||||
|
||||
## Known Limitations
|
||||
|
||||
- KL-divergence was measured on a 12-prompt Positron validation suite; treat it as a runtime validation signal, not a broad benchmark.
|
||||
- Results are specific to the Positron tron FPGA-serving path and may differ from GPU-native inference.
|
||||
- MMLU evaluation is pending; results will be added when available.
|
||||
|
||||
## Provenance
|
||||
|
||||
This artifact was produced by Positron AI from microsoft/phi-4. The original model license and usage restrictions continue to apply.
|
||||
41
SECURITY.md
Normal file
41
SECURITY.md
Normal file
@@ -0,0 +1,41 @@
|
||||
<!-- BEGIN MICROSOFT SECURITY.MD V0.0.9 BLOCK -->
|
||||
|
||||
## Security
|
||||
|
||||
Microsoft takes the security of our software products and services seriously, which includes all source code repositories managed through our GitHub organizations, which include [Microsoft](https://github.com/Microsoft), [Azure](https://github.com/Azure), [DotNet](https://github.com/dotnet), [AspNet](https://github.com/aspnet) and [Xamarin](https://github.com/xamarin).
|
||||
|
||||
If you believe you have found a security vulnerability in any Microsoft-owned repository that meets [Microsoft's definition of a security vulnerability](https://aka.ms/security.md/definition), please report it to us as described below.
|
||||
|
||||
## Reporting Security Issues
|
||||
|
||||
**Please do not report security vulnerabilities through public GitHub issues.**
|
||||
|
||||
Instead, please report them to the Microsoft Security Response Center (MSRC) at [https://msrc.microsoft.com/create-report](https://aka.ms/security.md/msrc/create-report).
|
||||
|
||||
If you prefer to submit without logging in, send email to [secure@microsoft.com](mailto:secure@microsoft.com). If possible, encrypt your message with our PGP key; please download it from the [Microsoft Security Response Center PGP Key page](https://aka.ms/security.md/msrc/pgp).
|
||||
|
||||
You should receive a response within 24 hours. If for some reason you do not, please follow up via email to ensure we received your original message. Additional information can be found at [microsoft.com/msrc](https://www.microsoft.com/msrc).
|
||||
|
||||
Please include the requested information listed below (as much as you can provide) to help us better understand the nature and scope of the possible issue:
|
||||
|
||||
* Type of issue (e.g. buffer overflow, SQL injection, cross-site scripting, etc.)
|
||||
* Full paths of source file(s) related to the manifestation of the issue
|
||||
* The location of the affected source code (tag/branch/commit or direct URL)
|
||||
* Any special configuration required to reproduce the issue
|
||||
* Step-by-step instructions to reproduce the issue
|
||||
* Proof-of-concept or exploit code (if possible)
|
||||
* Impact of the issue, including how an attacker might exploit the issue
|
||||
|
||||
This information will help us triage your report more quickly.
|
||||
|
||||
If you are reporting for a bug bounty, more complete reports can contribute to a higher bounty award. Please visit our [Microsoft Bug Bounty Program](https://aka.ms/security.md/msrc/bounty) page for more details about our active programs.
|
||||
|
||||
## Preferred Languages
|
||||
|
||||
We prefer all communications to be in English.
|
||||
|
||||
## Policy
|
||||
|
||||
Microsoft follows the principle of [Coordinated Vulnerability Disclosure](https://aka.ms/security.md/cvd).
|
||||
|
||||
<!-- END MICROSOFT SECURITY.MD BLOCK -->
|
||||
98
added_tokens.json
Normal file
98
added_tokens.json
Normal file
@@ -0,0 +1,98 @@
|
||||
{
|
||||
"<|dummy_0|>": 100256,
|
||||
"<|endoftext|>": 100257,
|
||||
"<|fim_prefix|>": 100258,
|
||||
"<|fim_middle|>": 100259,
|
||||
"<|fim_suffix|>": 100260,
|
||||
"<|dummy_1|>": 100261,
|
||||
"<|dummy_2|>": 100262,
|
||||
"<|dummy_3|>": 100263,
|
||||
"<|im_start|>": 100264,
|
||||
"<|im_end|>": 100265,
|
||||
"<|im_sep|>": 100266,
|
||||
"<|dummy_4|>": 100267,
|
||||
"<|dummy_5|>": 100268,
|
||||
"<|dummy_6|>": 100269,
|
||||
"<|dummy_7|>": 100270,
|
||||
"<|dummy_8|>": 100271,
|
||||
"<|dummy_9|>": 100272,
|
||||
"<|dummy_10|>": 100273,
|
||||
"<|dummy_11|>": 100274,
|
||||
"<|dummy_12|>": 100275,
|
||||
"<|endofprompt|>": 100276,
|
||||
"<|dummy_13|>": 100277,
|
||||
"<|dummy_14|>": 100278,
|
||||
"<|dummy_15|>": 100279,
|
||||
"<|dummy_16|>": 100280,
|
||||
"<|dummy_17|>": 100281,
|
||||
"<|dummy_18|>": 100282,
|
||||
"<|dummy_19|>": 100283,
|
||||
"<|dummy_20|>": 100284,
|
||||
"<|dummy_21|>": 100285,
|
||||
"<|dummy_22|>": 100286,
|
||||
"<|dummy_23|>": 100287,
|
||||
"<|dummy_24|>": 100288,
|
||||
"<|dummy_25|>": 100289,
|
||||
"<|dummy_26|>": 100290,
|
||||
"<|dummy_27|>": 100291,
|
||||
"<|dummy_28|>": 100292,
|
||||
"<|dummy_29|>": 100293,
|
||||
"<|dummy_30|>": 100294,
|
||||
"<|dummy_31|>": 100295,
|
||||
"<|dummy_32|>": 100296,
|
||||
"<|dummy_33|>": 100297,
|
||||
"<|dummy_34|>": 100298,
|
||||
"<|dummy_35|>": 100299,
|
||||
"<|dummy_36|>": 100300,
|
||||
"<|dummy_37|>": 100301,
|
||||
"<|dummy_38|>": 100302,
|
||||
"<|dummy_39|>": 100303,
|
||||
"<|dummy_40|>": 100304,
|
||||
"<|dummy_41|>": 100305,
|
||||
"<|dummy_42|>": 100306,
|
||||
"<|dummy_43|>": 100307,
|
||||
"<|dummy_44|>": 100308,
|
||||
"<|dummy_45|>": 100309,
|
||||
"<|dummy_46|>": 100310,
|
||||
"<|dummy_47|>": 100311,
|
||||
"<|dummy_48|>": 100312,
|
||||
"<|dummy_49|>": 100313,
|
||||
"<|dummy_50|>": 100314,
|
||||
"<|dummy_51|>": 100315,
|
||||
"<|dummy_52|>": 100316,
|
||||
"<|dummy_53|>": 100317,
|
||||
"<|dummy_54|>": 100318,
|
||||
"<|dummy_55|>": 100319,
|
||||
"<|dummy_56|>": 100320,
|
||||
"<|dummy_57|>": 100321,
|
||||
"<|dummy_58|>": 100322,
|
||||
"<|dummy_59|>": 100323,
|
||||
"<|dummy_60|>": 100324,
|
||||
"<|dummy_61|>": 100325,
|
||||
"<|dummy_62|>": 100326,
|
||||
"<|dummy_63|>": 100327,
|
||||
"<|dummy_64|>": 100328,
|
||||
"<|dummy_65|>": 100329,
|
||||
"<|dummy_66|>": 100330,
|
||||
"<|dummy_67|>": 100331,
|
||||
"<|dummy_68|>": 100332,
|
||||
"<|dummy_69|>": 100333,
|
||||
"<|dummy_70|>": 100334,
|
||||
"<|dummy_71|>": 100335,
|
||||
"<|dummy_72|>": 100336,
|
||||
"<|dummy_73|>": 100337,
|
||||
"<|dummy_74|>": 100338,
|
||||
"<|dummy_75|>": 100339,
|
||||
"<|dummy_76|>": 100340,
|
||||
"<|dummy_77|>": 100341,
|
||||
"<|dummy_78|>": 100342,
|
||||
"<|dummy_79|>": 100343,
|
||||
"<|dummy_80|>": 100344,
|
||||
"<|dummy_81|>": 100345,
|
||||
"<|dummy_82|>": 100346,
|
||||
"<|dummy_83|>": 100347,
|
||||
"<|dummy_84|>": 100348,
|
||||
"<|dummy_85|>": 100349,
|
||||
"<|dummy_86|>": 100350,
|
||||
"<|dummy_87|>": 100351
|
||||
}
|
||||
1
chat_template.jinja
Normal file
1
chat_template.jinja
Normal file
@@ -0,0 +1 @@
|
||||
{% for message in messages %}{% if (message['role'] == 'system') %}{{'<|im_start|>system<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'user') %}{{'<|im_start|>user<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'assistant') %}{{'<|im_start|>assistant<|im_sep|>' + message['content'] + '<|im_end|>'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant<|im_sep|>' }}{% endif %}
|
||||
1
chat_template.json
Normal file
1
chat_template.json
Normal file
@@ -0,0 +1 @@
|
||||
{"chat_template": "{% for message in messages %}{% if (message['role'] == 'system') %}{{'<|im_start|>system<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'user') %}{{'<|im_start|>user<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'assistant') %}{{'<|im_start|>assistant<|im_sep|>' + message['content'] + '<|im_end|>'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant<|im_sep|>' }}{% endif %}"}
|
||||
81
config.json
Normal file
81
config.json
Normal file
@@ -0,0 +1,81 @@
|
||||
{
|
||||
"architectures": [
|
||||
"Phi3ForCausalLM"
|
||||
],
|
||||
"attention_bias": false,
|
||||
"attention_dropout": 0.0,
|
||||
"bos_token_id": 100257,
|
||||
"embd_pdrop": 0.0,
|
||||
"eos_token_id": 100265,
|
||||
"hidden_act": "silu",
|
||||
"hidden_size": 5120,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 17920,
|
||||
"max_position_embeddings": 16384,
|
||||
"model_type": "phi3",
|
||||
"num_attention_heads": 40,
|
||||
"num_hidden_layers": 40,
|
||||
"num_key_value_heads": 10,
|
||||
"original_max_position_embeddings": 16384,
|
||||
"pad_token_id": 100349,
|
||||
"partial_rotary_factor": 1.0,
|
||||
"quantization_config": {
|
||||
"bits": 4,
|
||||
"checkpoint_format": "gptq",
|
||||
"desc_act": false,
|
||||
"format": "gptq",
|
||||
"group_size": 64,
|
||||
"lm_head": false,
|
||||
"meta": {
|
||||
"act_group_aware": true,
|
||||
"auto_forward_data_parallel": false,
|
||||
"damp_auto_increment": 0.01,
|
||||
"damp_percent": 0.05,
|
||||
"emit_timing_v2": true,
|
||||
"failsafe": {
|
||||
"smooth": null,
|
||||
"strategy": "rtn",
|
||||
"threshold": "0.5%"
|
||||
},
|
||||
"gc_mode": "interval",
|
||||
"gptaq": null,
|
||||
"hessian": {
|
||||
"chunk_bytes": null,
|
||||
"chunk_size": null,
|
||||
"staging_dtype": "float32"
|
||||
},
|
||||
"mock_quantization": false,
|
||||
"mse": 0.0,
|
||||
"offload_to_disk": false,
|
||||
"offload_to_disk_path": null,
|
||||
"pack_impl": "cpu",
|
||||
"quantizer": [
|
||||
"gptqmodel:5.8.0"
|
||||
],
|
||||
"scales_dtype": "bfloat16",
|
||||
"static_groups": false,
|
||||
"true_sequential": true,
|
||||
"uri": "https://github.com/modelcloud/gptqmodel",
|
||||
"vram_strategy": "exclusive",
|
||||
"wait_for_submodule_finalizers": false
|
||||
},
|
||||
"pack_dtype": "int32",
|
||||
"quant_method": "gptq",
|
||||
"sym": true
|
||||
},
|
||||
"resid_pdrop": 0.0,
|
||||
"rms_norm_eps": 1e-05,
|
||||
"rope_parameters": {
|
||||
"partial_rotary_factor": 1.0,
|
||||
"rope_theta": 250000,
|
||||
"rope_type": "default"
|
||||
},
|
||||
"rope_theta": 250000,
|
||||
"sliding_window": null,
|
||||
"tie_word_embeddings": false,
|
||||
"transformers_version": "4.57.6",
|
||||
"use_cache": true,
|
||||
"vocab_size": 100352,
|
||||
"head_dim": 128,
|
||||
"torch_dtype": "bfloat16"
|
||||
}
|
||||
159
data_summary_card.md
Normal file
159
data_summary_card.md
Normal file
@@ -0,0 +1,159 @@
|
||||
|
||||
|
||||
# Data Summary for microsoft_phi-4
|
||||
|
||||
|
||||
|
||||
|
||||
|
||||
## 1. General information
|
||||
|
||||
**1.0.1 Version of the Summary:** 1.0
|
||||
|
||||
|
||||
|
||||
**1.0.2 Last update:** 24-Nov-2025
|
||||
|
||||
|
||||
|
||||
## 1.1 Model Developer Identification
|
||||
|
||||
**1.1.1 Model Developer name and contact details:** Microsoft Corporation at One Microsoft Way, Redmond, WA 98052. Tel: 425-882-8080
|
||||
|
||||
|
||||
|
||||
## 1.2 Model Identification
|
||||
|
||||
**1.2.1 Versioned model name(s):** phi-4
|
||||
|
||||
|
||||
|
||||
**1.2.2 Model release date:** 12-Dec-2024
|
||||
|
||||
|
||||
|
||||
## 1.3 Overall training data size and characteristics
|
||||
|
||||
### 1.3.1 Size of dataset and characteristics
|
||||
|
||||
**1.3.1.A Text training data size:** 1 billion to 10 trillion tokens
|
||||
|
||||
|
||||
|
||||
**1.3.1.B Text training data content:** Training data is an extension of the data used for Phi-3 and includes a wide variety of sources from:
|
||||
|
||||
|
||||
|
||||
1. Publicly available documents filtered rigorously for quality, selected high-quality educational data, and code.
|
||||
|
||||
2. Newly created synthetic, “textbook-like” data for the purpose of teaching math, coding, common sense reasoning, general knowledge of the world (science, daily activities, theory of mind, etc.).
|
||||
|
||||
3. Acquired academic books and Q&A datasets.
|
||||
|
||||
4. High quality chat format supervised data covering various topics to reflect human preferences on different aspects such as instruct-following, truthfulness, honesty and helpfulness.
|
||||
|
||||
5. Multilingual data constitutes about 8% of our overall data.
|
||||
|
||||
|
||||
|
||||
**1.3.1.C Image training data size:** Not applicable. Images are not part of the training
|
||||
|
||||
|
||||
|
||||
**1.3.1.D Image training data content:** Not applicable
|
||||
|
||||
|
||||
|
||||
**1.3.1.E Audio training data size:** Not applicable. Audio data is not part of the training data
|
||||
|
||||
|
||||
|
||||
**1.3.1.F Audio training data content:** Not applicable
|
||||
|
||||
|
||||
|
||||
**1.3.1.G Video training data size:** Not applicable. Video data is not part of the training data
|
||||
|
||||
|
||||
|
||||
**1.3.1.H Video training data content:** Not applicable
|
||||
|
||||
|
||||
|
||||
**1.3.1.I Other training data size:** Not applicable
|
||||
|
||||
|
||||
|
||||
**1.3.1.J Other training data content:** Not applicable
|
||||
|
||||
|
||||
|
||||
**1.3.2 Latest date of data acquisition/collection for model training:** 30-Jun-2024
|
||||
|
||||
|
||||
|
||||
**1.3.3 Is data collection ongoing to update the model with new data collection after deployment?** No
|
||||
|
||||
|
||||
|
||||
**1.3.4 Date the training dataset was first used to train the model:** 10/01/2024
|
||||
|
||||
|
||||
|
||||
**1.3.5 Rationale or purpose of data selection:** Datasets were selected to maximize high-quality reasoning and problem-solving capabilities. The mixture emphasizes synthetic, curriculum-structured data and rigorously filtered organic sources such as academic papers, licensed books, code, and Q&A to improve STEM reasoning, coding, and general knowledge while reducing noise and contamination. Targeted acquisitions and multilingual content complement synthetic data to balance reasoning strength with factual coverage
|
||||
|
||||
|
||||
|
||||
## 2. List of data sources
|
||||
|
||||
### 2.1 Publicly available datasets
|
||||
|
||||
**2.1.1 Have you used publicly available datasets to train the model?** Yes
|
||||
|
||||
|
||||
|
||||
## 2.2 Private non-publicly available datasets obtained from third parties
|
||||
|
||||
### 2.2.1 Datasets commercially licensed by rights holders or their representatives
|
||||
|
||||
**2.2.1.A Have you concluded transactional commercial licensing agreement(s) with rights holder(s) or with their representatives?** Yes
|
||||
|
||||
|
||||
|
||||
### 2.2.2 Private datasets obtained from other third-parties
|
||||
|
||||
**2.2.2.A Have you obtained private datasets from third parties that are not licensed as described in Section 2.2.1, such as data obtained from providers of private databases, or data intermediaries?** This information cannot be provided due to unavailability of the underlying data (e.g., loss, corruption, or other access limitations)
|
||||
|
||||
|
||||
|
||||
## 2.3 Personal Information
|
||||
|
||||
**2.3.1 Was personal data used to train the model?** Microsoft follows all relevant laws and regulations pertaining to personal information
|
||||
|
||||
|
||||
|
||||
## 2.4 Synthetic data
|
||||
|
||||
**2.4.1 Was any synthetic AI-generated data used to train the model?** Yes
|
||||
|
||||
|
||||
|
||||
## 3. Data processing aspects
|
||||
|
||||
### 3.1 Respect of reservation of rights from text and data mining exception or limitation
|
||||
|
||||
**3.1.1 Does this dataset include any data protected by copyright, trademark, or patent?** Microsoft follows all required regulations and laws for processing data protected by copyright, trademark, or patent
|
||||
|
||||
|
||||
|
||||
## 3.2 Other information
|
||||
|
||||
**3.2.1 Does the dataset include information about consumer groups without revealing individual consumer identities?** Microsoft follows all required regulations and laws for protecting consumer identities
|
||||
|
||||
|
||||
|
||||
**3.2.2 Was the dataset cleaned or modified before model training?** Yes
|
||||
|
||||
|
||||
|
||||
|
||||
8
generation_config.json
Normal file
8
generation_config.json
Normal file
@@ -0,0 +1,8 @@
|
||||
{
|
||||
"_from_model_config": true,
|
||||
"bos_token_id": 100257,
|
||||
"do_sample": true,
|
||||
"eos_token_id": 100265,
|
||||
"pad_token_id": 100349,
|
||||
"transformers_version": "4.57.6"
|
||||
}
|
||||
100001
merges.txt
Normal file
100001
merges.txt
Normal file
File diff suppressed because it is too large
Load Diff
3
model-00001-of-00003.safetensors
Normal file
3
model-00001-of-00003.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:e8a912b6899cfdac58d2342838d5df4a1f7f7fc05d86f654b55e01e71e83e485
|
||||
size 4277536176
|
||||
3
model-00002-of-00003.safetensors
Normal file
3
model-00002-of-00003.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6c640d455ddee6bbad6affc7b49dc493b8b4ecab6aec16444797420ac62ef866
|
||||
size 4254055968
|
||||
3
model-00003-of-00003.safetensors
Normal file
3
model-00003-of-00003.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:38c44e472d9f74856ccdd99d4d88254ad58b10a739ab3ce81c804850339327ab
|
||||
size 878077672
|
||||
730
model.safetensors.index.json
Normal file
730
model.safetensors.index.json
Normal file
@@ -0,0 +1,730 @@
|
||||
{
|
||||
"metadata": {
|
||||
"total_size": 9409669816
|
||||
},
|
||||
"weight_map": {
|
||||
"lm_head.weight": "model-00001-of-00003.safetensors",
|
||||
"model.embed_tokens.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.0.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.1.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.10.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.11.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.13.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.13.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.14.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.14.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.15.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.15.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.16.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.16.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.17.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.17.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.18.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.18.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.19.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.19.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.2.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.20.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.20.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.21.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.21.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.22.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.22.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.23.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.23.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.24.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.24.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.25.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.25.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.26.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.26.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.27.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.27.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.28.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.28.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.29.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.29.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.3.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.30.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.30.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.31.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.31.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.32.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.32.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.33.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.33.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.34.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.34.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.35.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.35.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.36.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.36.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.37.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.37.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.38.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.38.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.39.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.39.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.4.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.5.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.6.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.7.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.8.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.input_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.mlp.down_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.mlp.down_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.mlp.down_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.mlp.down_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.mlp.gate_up_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.mlp.gate_up_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.mlp.gate_up_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.mlp.gate_up_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.post_attention_layernorm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.self_attn.o_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.self_attn.o_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.self_attn.o_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.self_attn.o_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.self_attn.qkv_proj.g_idx": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.self_attn.qkv_proj.qweight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.self_attn.qkv_proj.qzeros": "model-00001-of-00003.safetensors",
|
||||
"model.layers.9.self_attn.qkv_proj.scales": "model-00001-of-00003.safetensors",
|
||||
"model.norm.weight": "model-00001-of-00003.safetensors",
|
||||
"model.layers.12.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.12.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.13.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.14.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.15.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.16.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.17.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.18.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.19.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.20.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.21.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.22.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.23.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.24.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.25.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.26.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.27.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.28.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.29.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.30.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.31.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.32.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.33.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.mlp.down_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.mlp.down_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.mlp.down_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.mlp.down_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.mlp.gate_up_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.mlp.gate_up_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.34.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.mlp.gate_up_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.mlp.gate_up_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.self_attn.o_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.self_attn.o_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.self_attn.o_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.self_attn.o_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.self_attn.qkv_proj.g_idx": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.self_attn.qkv_proj.qweight": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.self_attn.qkv_proj.qzeros": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.self_attn.qkv_proj.scales": "model-00002-of-00003.safetensors",
|
||||
"model.layers.35.mlp.down_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.35.mlp.down_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.35.mlp.down_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.35.mlp.down_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.35.mlp.gate_up_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.35.mlp.gate_up_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.mlp.down_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.mlp.down_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.mlp.down_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.mlp.down_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.mlp.gate_up_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.mlp.gate_up_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.mlp.gate_up_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.mlp.gate_up_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.self_attn.o_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.self_attn.o_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.self_attn.o_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.self_attn.o_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.self_attn.qkv_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.self_attn.qkv_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.self_attn.qkv_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.36.self_attn.qkv_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.mlp.down_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.mlp.down_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.mlp.down_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.mlp.down_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.mlp.gate_up_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.mlp.gate_up_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.mlp.gate_up_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.mlp.gate_up_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.self_attn.o_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.self_attn.o_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.self_attn.o_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.self_attn.o_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.self_attn.qkv_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.self_attn.qkv_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.self_attn.qkv_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.37.self_attn.qkv_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.mlp.down_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.mlp.down_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.mlp.down_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.mlp.down_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.mlp.gate_up_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.mlp.gate_up_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.mlp.gate_up_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.mlp.gate_up_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.self_attn.o_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.self_attn.o_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.self_attn.o_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.self_attn.o_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.self_attn.qkv_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.self_attn.qkv_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.self_attn.qkv_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.38.self_attn.qkv_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.mlp.down_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.mlp.down_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.mlp.down_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.mlp.down_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.mlp.gate_up_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.mlp.gate_up_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.mlp.gate_up_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.mlp.gate_up_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.self_attn.o_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.self_attn.o_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.self_attn.o_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.self_attn.o_proj.scales": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.self_attn.qkv_proj.g_idx": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.self_attn.qkv_proj.qweight": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.self_attn.qkv_proj.qzeros": "model-00003-of-00003.safetensors",
|
||||
"model.layers.39.self_attn.qkv_proj.scales": "model-00003-of-00003.safetensors"
|
||||
}
|
||||
}
|
||||
161
quant_log.csv
Normal file
161
quant_log.csv
Normal file
@@ -0,0 +1,161 @@
|
||||
layer,module,loss,samples,damp,time,fallback
|
||||
0,self_attn.qkv_proj,0.0000009184,992218,0.05000,2.143,
|
||||
0,self_attn.o_proj,0.0000000032,992218,0.05000,1.495,
|
||||
0,mlp.gate_up_proj,0.0000008453,992218,0.05000,3.089,
|
||||
0,mlp.down_proj,0.0000000094,992218,0.05000,7.501,
|
||||
1,self_attn.qkv_proj,0.0000013641,992218,0.05000,2.445,
|
||||
1,self_attn.o_proj,0.0000000074,992218,0.05000,1.827,
|
||||
1,mlp.gate_up_proj,0.0000021024,992218,0.05000,1.348,
|
||||
1,mlp.down_proj,0.0000000924,992218,0.05000,4.503,
|
||||
2,self_attn.qkv_proj,0.0000037294,992218,0.05000,2.307,
|
||||
2,self_attn.o_proj,0.0000000092,992218,0.05000,2.003,
|
||||
2,mlp.gate_up_proj,0.0000036846,992218,0.05000,3.768,
|
||||
2,mlp.down_proj,0.0000000561,992218,0.05000,5.567,
|
||||
3,self_attn.qkv_proj,0.0000067082,992218,0.05000,1.816,
|
||||
3,self_attn.o_proj,0.0000000119,992218,0.05000,1.504,
|
||||
3,mlp.gate_up_proj,0.0000053215,992218,0.05000,2.948,
|
||||
3,mlp.down_proj,0.0000000833,992218,0.05000,6.634,
|
||||
4,self_attn.qkv_proj,0.0000058158,992218,0.05000,1.746,
|
||||
4,self_attn.o_proj,0.0000000259,992218,0.05000,1.404,
|
||||
4,mlp.gate_up_proj,0.0000066750,992218,0.05000,2.447,
|
||||
4,mlp.down_proj,0.0000001236,992218,0.05000,7.829,
|
||||
5,self_attn.qkv_proj,0.0000069001,992218,0.05000,1.394,
|
||||
5,self_attn.o_proj,0.0000000337,992218,0.05000,1.478,
|
||||
5,mlp.gate_up_proj,0.0000082101,992218,0.05000,2.655,
|
||||
5,mlp.down_proj,0.0000001666,992218,0.05000,8.150,
|
||||
6,self_attn.qkv_proj,0.0000084689,992218,0.05000,1.351,
|
||||
6,self_attn.o_proj,0.0000000480,992218,0.05000,1.886,
|
||||
6,mlp.gate_up_proj,0.0000101026,992218,0.05000,2.269,
|
||||
6,mlp.down_proj,0.0000002321,992218,0.05000,7.805,
|
||||
7,self_attn.qkv_proj,0.0000101390,992218,0.05000,1.816,
|
||||
7,self_attn.o_proj,0.0000000665,992218,0.05000,1.365,
|
||||
7,mlp.gate_up_proj,0.0000126047,992218,0.05000,2.968,
|
||||
7,mlp.down_proj,0.0000003220,992218,0.05000,6.979,
|
||||
8,self_attn.qkv_proj,0.0000111209,992218,0.05000,1.924,
|
||||
8,self_attn.o_proj,0.0000000956,992218,0.05000,1.435,
|
||||
8,mlp.gate_up_proj,0.0000154533,992218,0.05000,3.264,
|
||||
8,mlp.down_proj,0.0000004294,992218,0.05000,7.960,
|
||||
9,self_attn.qkv_proj,0.0000097167,992218,0.05000,1.613,
|
||||
9,self_attn.o_proj,0.0000001348,992218,0.05000,1.383,
|
||||
9,mlp.gate_up_proj,0.0000177228,992218,0.05000,3.390,
|
||||
9,mlp.down_proj,0.0000005869,992218,0.05000,9.572,
|
||||
10,self_attn.qkv_proj,0.0000113507,992218,0.05000,2.073,
|
||||
10,self_attn.o_proj,0.0000002005,992218,0.05000,1.560,
|
||||
10,mlp.gate_up_proj,0.0000200172,992218,0.05000,3.499,
|
||||
10,mlp.down_proj,0.0000007630,992218,0.05000,9.191,
|
||||
11,self_attn.qkv_proj,0.0000120969,992218,0.05000,1.342,
|
||||
11,self_attn.o_proj,0.0000003198,992218,0.05000,1.619,
|
||||
11,mlp.gate_up_proj,0.0000222836,992218,0.05000,1.340,
|
||||
11,mlp.down_proj,0.0000009907,992218,0.05000,4.760,
|
||||
12,self_attn.qkv_proj,0.0000129862,992218,0.05000,1.353,
|
||||
12,self_attn.o_proj,0.0000003674,992218,0.05000,1.816,
|
||||
12,mlp.gate_up_proj,0.0000243992,992218,0.05000,1.338,
|
||||
12,mlp.down_proj,0.0000011092,992218,0.05000,5.066,
|
||||
13,self_attn.qkv_proj,0.0000132786,992218,0.05000,1.413,
|
||||
13,self_attn.o_proj,0.0000004223,992218,0.05000,1.454,
|
||||
13,mlp.gate_up_proj,0.0000257040,992218,0.05000,1.354,
|
||||
13,mlp.down_proj,0.0000012567,992218,0.05000,4.849,
|
||||
14,self_attn.qkv_proj,0.0000150138,992218,0.05000,1.401,
|
||||
14,self_attn.o_proj,0.0000005403,992218,0.05000,1.334,
|
||||
14,mlp.gate_up_proj,0.0000274366,992218,0.05000,1.336,
|
||||
14,mlp.down_proj,0.0000014074,992218,0.05000,4.830,
|
||||
15,self_attn.qkv_proj,0.0000159121,992218,0.05000,1.349,
|
||||
15,self_attn.o_proj,0.0000005911,992218,0.05000,1.321,
|
||||
15,mlp.gate_up_proj,0.0000272861,992218,0.05000,1.343,
|
||||
15,mlp.down_proj,0.0000015937,992218,0.05000,4.759,
|
||||
16,self_attn.qkv_proj,0.0000141310,992218,0.05000,1.366,
|
||||
16,self_attn.o_proj,0.0000008577,992218,0.05000,1.385,
|
||||
16,mlp.gate_up_proj,0.0000278053,992218,0.05000,1.336,
|
||||
16,mlp.down_proj,0.0000017636,992218,0.05000,4.976,
|
||||
17,self_attn.qkv_proj,0.0000176385,992218,0.05000,1.344,
|
||||
17,self_attn.o_proj,0.0000007980,992218,0.05000,1.552,
|
||||
17,mlp.gate_up_proj,0.0000310646,992218,0.05000,1.352,
|
||||
17,mlp.down_proj,0.0000021514,992218,0.05000,4.818,
|
||||
18,self_attn.qkv_proj,0.0000169438,992218,0.05000,1.340,
|
||||
18,self_attn.o_proj,0.0000009638,992218,0.05000,1.552,
|
||||
18,mlp.gate_up_proj,0.0000330784,992218,0.05000,2.217,
|
||||
18,mlp.down_proj,0.0000025698,992218,0.05000,4.817,
|
||||
19,self_attn.qkv_proj,0.0000169148,992218,0.05000,1.335,
|
||||
19,self_attn.o_proj,0.0000010705,992218,0.05000,1.449,
|
||||
19,mlp.gate_up_proj,0.0000365124,992218,0.05000,3.485,
|
||||
19,mlp.down_proj,0.0000030199,992218,0.05000,4.783,
|
||||
20,self_attn.qkv_proj,0.0000171111,992218,0.05000,1.337,
|
||||
20,self_attn.o_proj,0.0000011377,992218,0.05000,1.311,
|
||||
20,mlp.gate_up_proj,0.0000400209,992218,0.05000,4.078,
|
||||
20,mlp.down_proj,0.0000038180,992218,0.05000,4.974,
|
||||
21,self_attn.qkv_proj,0.0000172933,992218,0.05000,1.343,
|
||||
21,self_attn.o_proj,0.0000012064,992218,0.05000,1.333,
|
||||
21,mlp.gate_up_proj,0.0000431357,992218,0.05000,4.656,
|
||||
21,mlp.down_proj,0.0000045065,992218,0.05000,10.994,
|
||||
22,self_attn.qkv_proj,0.0000180120,992218,0.05000,1.321,
|
||||
22,self_attn.o_proj,0.0000014954,992218,0.05000,1.331,
|
||||
22,mlp.gate_up_proj,0.0000463120,992218,0.05000,6.109,
|
||||
22,mlp.down_proj,0.0000055441,992218,0.05000,11.220,
|
||||
23,self_attn.qkv_proj,0.0000178485,992218,0.05000,1.344,
|
||||
23,self_attn.o_proj,0.0000014500,992218,0.05000,1.295,
|
||||
23,mlp.gate_up_proj,0.0000508546,992218,0.05000,4.633,
|
||||
23,mlp.down_proj,0.0000067336,992218,0.05000,12.042,
|
||||
24,self_attn.qkv_proj,0.0000200238,992218,0.05000,1.334,
|
||||
24,self_attn.o_proj,0.0000016790,992218,0.05000,1.309,
|
||||
24,mlp.gate_up_proj,0.0000578565,992218,0.05000,5.397,
|
||||
24,mlp.down_proj,0.0000081911,992218,0.05000,12.669,
|
||||
25,self_attn.qkv_proj,0.0000182419,992218,0.05000,1.360,
|
||||
25,self_attn.o_proj,0.0000019057,992218,0.05000,1.334,
|
||||
25,mlp.gate_up_proj,0.0000638860,992218,0.05000,1.684,
|
||||
25,mlp.down_proj,0.0000103048,992218,0.05000,10.920,
|
||||
26,self_attn.qkv_proj,0.0000202286,992218,0.05000,1.324,
|
||||
26,self_attn.o_proj,0.0000024291,992218,0.05000,1.320,
|
||||
26,mlp.gate_up_proj,0.0000711978,992218,0.05000,2.228,
|
||||
26,mlp.down_proj,0.0000125089,992218,0.05000,10.399,
|
||||
27,self_attn.qkv_proj,0.0000215121,992218,0.05000,1.366,
|
||||
27,self_attn.o_proj,0.0000027974,992218,0.05000,1.294,
|
||||
27,mlp.gate_up_proj,0.0000772002,992218,0.05000,2.860,
|
||||
27,mlp.down_proj,0.0000147565,992218,0.05000,10.329,
|
||||
28,self_attn.qkv_proj,0.0000234504,992218,0.05000,1.340,
|
||||
28,self_attn.o_proj,0.0000028221,992218,0.05000,1.310,
|
||||
28,mlp.gate_up_proj,0.0000854535,992218,0.05000,4.184,
|
||||
28,mlp.down_proj,0.0000176720,992218,0.05000,10.838,
|
||||
29,self_attn.qkv_proj,0.0000247925,992218,0.05000,1.336,
|
||||
29,self_attn.o_proj,0.0000021450,992218,0.05000,1.330,
|
||||
29,mlp.gate_up_proj,0.0000947418,992218,0.05000,5.115,
|
||||
29,mlp.down_proj,0.0000206649,992218,0.05000,11.778,
|
||||
30,self_attn.qkv_proj,0.0000266888,992218,0.05000,1.336,
|
||||
30,self_attn.o_proj,0.0000029204,992218,0.05000,1.316,
|
||||
30,mlp.gate_up_proj,0.0001047200,992218,0.05000,3.118,
|
||||
30,mlp.down_proj,0.0000244171,992218,0.05000,12.611,
|
||||
31,self_attn.qkv_proj,0.0000275343,992218,0.05000,1.358,
|
||||
31,self_attn.o_proj,0.0000027327,992218,0.05000,1.297,
|
||||
31,mlp.gate_up_proj,0.0001151791,992218,0.05000,3.100,
|
||||
31,mlp.down_proj,0.0000282525,992218,0.05000,102.930,
|
||||
32,self_attn.qkv_proj,0.0000327074,992218,0.05000,1.329,
|
||||
32,self_attn.o_proj,0.0000043709,992218,0.05000,1.313,
|
||||
32,mlp.gate_up_proj,0.0001268540,992218,0.05000,3.228,
|
||||
32,mlp.down_proj,0.0000333801,992218,0.05000,9.621,
|
||||
33,self_attn.qkv_proj,0.0000321192,992218,0.05000,1.336,
|
||||
33,self_attn.o_proj,0.0000026990,992218,0.05000,1.332,
|
||||
33,mlp.gate_up_proj,0.0001382529,992218,0.05000,4.766,
|
||||
33,mlp.down_proj,0.0000365827,992218,0.05000,10.087,
|
||||
34,self_attn.qkv_proj,0.0000334335,992218,0.05000,1.323,
|
||||
34,self_attn.o_proj,0.0000046766,992218,0.05000,1.317,
|
||||
34,mlp.gate_up_proj,0.0001489316,992218,0.05000,3.957,
|
||||
34,mlp.down_proj,0.0000417792,992218,0.05000,6.058,
|
||||
35,self_attn.qkv_proj,0.0000340755,992218,0.05000,1.345,
|
||||
35,self_attn.o_proj,0.0000062327,992218,0.05000,1.313,
|
||||
35,mlp.gate_up_proj,0.0001593752,992218,0.05000,5.209,
|
||||
35,mlp.down_proj,0.0000476060,992218,0.05000,4.823,
|
||||
36,self_attn.qkv_proj,0.0000340020,992218,0.05000,1.332,
|
||||
36,self_attn.o_proj,0.0000052558,992218,0.05000,1.309,
|
||||
36,mlp.gate_up_proj,0.0001698007,992218,0.05000,5.109,
|
||||
36,mlp.down_proj,0.0000533070,992218,0.05000,10.565,
|
||||
37,self_attn.qkv_proj,0.0000332706,992218,0.05000,1.340,
|
||||
37,self_attn.o_proj,0.0000055578,992218,0.05000,1.332,
|
||||
37,mlp.gate_up_proj,0.0001784837,992218,0.05000,4.542,
|
||||
37,mlp.down_proj,0.0000617646,992218,0.05000,6.609,
|
||||
38,self_attn.qkv_proj,0.0000310467,992218,0.05000,1.324,
|
||||
38,self_attn.o_proj,0.0000055578,992218,0.05000,1.316,
|
||||
38,mlp.gate_up_proj,0.0001784861,992218,0.05000,1.339,
|
||||
38,mlp.down_proj,0.0000735546,992218,0.05000,4.848,
|
||||
39,self_attn.qkv_proj,0.0000194624,992218,0.05000,1.334,
|
||||
39,self_attn.o_proj,0.0000031177,992218,0.05000,1.300,
|
||||
39,mlp.gate_up_proj,0.0001758974,992218,0.05000,1.353,
|
||||
39,mlp.down_proj,0.0000558769,992218,0.05000,4.816,
|
||||
|
44
quantize_config.json
Normal file
44
quantize_config.json
Normal file
@@ -0,0 +1,44 @@
|
||||
{
|
||||
"bits": 4,
|
||||
"group_size": 64,
|
||||
"desc_act": false,
|
||||
"lm_head": false,
|
||||
"quant_method": "gptq",
|
||||
"checkpoint_format": "gptq",
|
||||
"pack_dtype": "int32",
|
||||
"meta": {
|
||||
"quantizer": [
|
||||
"gptqmodel:5.8.0"
|
||||
],
|
||||
"uri": "https://github.com/modelcloud/gptqmodel",
|
||||
"damp_percent": 0.05,
|
||||
"damp_auto_increment": 0.01,
|
||||
"static_groups": false,
|
||||
"true_sequential": true,
|
||||
"mse": 0.0,
|
||||
"gptaq": null,
|
||||
"act_group_aware": true,
|
||||
"failsafe": {
|
||||
"strategy": "rtn",
|
||||
"threshold": "0.5%",
|
||||
"smooth": null
|
||||
},
|
||||
"scales_dtype": "bfloat16",
|
||||
"offload_to_disk": false,
|
||||
"offload_to_disk_path": null,
|
||||
"pack_impl": "cpu",
|
||||
"mock_quantization": false,
|
||||
"emit_timing_v2": true,
|
||||
"gc_mode": "interval",
|
||||
"wait_for_submodule_finalizers": false,
|
||||
"auto_forward_data_parallel": false,
|
||||
"hessian": {
|
||||
"chunk_size": null,
|
||||
"chunk_bytes": null,
|
||||
"staging_dtype": "float32"
|
||||
},
|
||||
"vram_strategy": "exclusive"
|
||||
},
|
||||
"sym": true,
|
||||
"format": "gptq"
|
||||
}
|
||||
18
special_tokens_map.json
Normal file
18
special_tokens_map.json
Normal file
@@ -0,0 +1,18 @@
|
||||
{
|
||||
"bos_token": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false
|
||||
},
|
||||
"eos_token": {
|
||||
"content": "<|im_end|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false
|
||||
},
|
||||
"pad_token": "<|dummy_85|>",
|
||||
"unk_token": "<|endoftext|>"
|
||||
}
|
||||
501264
tokenizer.json
Normal file
501264
tokenizer.json
Normal file
File diff suppressed because it is too large
Load Diff
783
tokenizer_config.json
Normal file
783
tokenizer_config.json
Normal file
@@ -0,0 +1,783 @@
|
||||
{
|
||||
"add_prefix_space": false,
|
||||
"added_tokens_decoder": {
|
||||
"100256": {
|
||||
"content": "<|dummy_0|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100257": {
|
||||
"content": "<|endoftext|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100258": {
|
||||
"content": "<|fim_prefix|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100259": {
|
||||
"content": "<|fim_middle|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100260": {
|
||||
"content": "<|fim_suffix|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100261": {
|
||||
"content": "<|dummy_1|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100262": {
|
||||
"content": "<|dummy_2|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100263": {
|
||||
"content": "<|dummy_3|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100264": {
|
||||
"content": "<|im_start|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100265": {
|
||||
"content": "<|im_end|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100266": {
|
||||
"content": "<|im_sep|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100267": {
|
||||
"content": "<|dummy_4|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100268": {
|
||||
"content": "<|dummy_5|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100269": {
|
||||
"content": "<|dummy_6|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100270": {
|
||||
"content": "<|dummy_7|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100271": {
|
||||
"content": "<|dummy_8|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100272": {
|
||||
"content": "<|dummy_9|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100273": {
|
||||
"content": "<|dummy_10|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100274": {
|
||||
"content": "<|dummy_11|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100275": {
|
||||
"content": "<|dummy_12|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100276": {
|
||||
"content": "<|endofprompt|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100277": {
|
||||
"content": "<|dummy_13|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100278": {
|
||||
"content": "<|dummy_14|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100279": {
|
||||
"content": "<|dummy_15|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100280": {
|
||||
"content": "<|dummy_16|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100281": {
|
||||
"content": "<|dummy_17|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100282": {
|
||||
"content": "<|dummy_18|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100283": {
|
||||
"content": "<|dummy_19|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100284": {
|
||||
"content": "<|dummy_20|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100285": {
|
||||
"content": "<|dummy_21|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100286": {
|
||||
"content": "<|dummy_22|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100287": {
|
||||
"content": "<|dummy_23|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100288": {
|
||||
"content": "<|dummy_24|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100289": {
|
||||
"content": "<|dummy_25|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100290": {
|
||||
"content": "<|dummy_26|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100291": {
|
||||
"content": "<|dummy_27|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100292": {
|
||||
"content": "<|dummy_28|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100293": {
|
||||
"content": "<|dummy_29|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100294": {
|
||||
"content": "<|dummy_30|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100295": {
|
||||
"content": "<|dummy_31|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100296": {
|
||||
"content": "<|dummy_32|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100297": {
|
||||
"content": "<|dummy_33|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100298": {
|
||||
"content": "<|dummy_34|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100299": {
|
||||
"content": "<|dummy_35|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100300": {
|
||||
"content": "<|dummy_36|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100301": {
|
||||
"content": "<|dummy_37|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100302": {
|
||||
"content": "<|dummy_38|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100303": {
|
||||
"content": "<|dummy_39|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100304": {
|
||||
"content": "<|dummy_40|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100305": {
|
||||
"content": "<|dummy_41|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100306": {
|
||||
"content": "<|dummy_42|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100307": {
|
||||
"content": "<|dummy_43|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100308": {
|
||||
"content": "<|dummy_44|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100309": {
|
||||
"content": "<|dummy_45|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100310": {
|
||||
"content": "<|dummy_46|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100311": {
|
||||
"content": "<|dummy_47|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100312": {
|
||||
"content": "<|dummy_48|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100313": {
|
||||
"content": "<|dummy_49|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100314": {
|
||||
"content": "<|dummy_50|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100315": {
|
||||
"content": "<|dummy_51|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100316": {
|
||||
"content": "<|dummy_52|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100317": {
|
||||
"content": "<|dummy_53|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100318": {
|
||||
"content": "<|dummy_54|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100319": {
|
||||
"content": "<|dummy_55|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100320": {
|
||||
"content": "<|dummy_56|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100321": {
|
||||
"content": "<|dummy_57|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100322": {
|
||||
"content": "<|dummy_58|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100323": {
|
||||
"content": "<|dummy_59|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100324": {
|
||||
"content": "<|dummy_60|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100325": {
|
||||
"content": "<|dummy_61|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100326": {
|
||||
"content": "<|dummy_62|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100327": {
|
||||
"content": "<|dummy_63|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100328": {
|
||||
"content": "<|dummy_64|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100329": {
|
||||
"content": "<|dummy_65|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100330": {
|
||||
"content": "<|dummy_66|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100331": {
|
||||
"content": "<|dummy_67|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100332": {
|
||||
"content": "<|dummy_68|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100333": {
|
||||
"content": "<|dummy_69|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100334": {
|
||||
"content": "<|dummy_70|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100335": {
|
||||
"content": "<|dummy_71|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100336": {
|
||||
"content": "<|dummy_72|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100337": {
|
||||
"content": "<|dummy_73|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100338": {
|
||||
"content": "<|dummy_74|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100339": {
|
||||
"content": "<|dummy_75|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100340": {
|
||||
"content": "<|dummy_76|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100341": {
|
||||
"content": "<|dummy_77|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100342": {
|
||||
"content": "<|dummy_78|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100343": {
|
||||
"content": "<|dummy_79|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100344": {
|
||||
"content": "<|dummy_80|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100345": {
|
||||
"content": "<|dummy_81|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100346": {
|
||||
"content": "<|dummy_82|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100347": {
|
||||
"content": "<|dummy_83|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100348": {
|
||||
"content": "<|dummy_84|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100349": {
|
||||
"content": "<|dummy_85|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100350": {
|
||||
"content": "<|dummy_86|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
},
|
||||
"100351": {
|
||||
"content": "<|dummy_87|>",
|
||||
"lstrip": true,
|
||||
"normalized": false,
|
||||
"rstrip": true,
|
||||
"single_word": false,
|
||||
"special": true
|
||||
}
|
||||
},
|
||||
"bos_token": "<|endoftext|>",
|
||||
"clean_up_tokenization_spaces": false,
|
||||
"eos_token": "<|im_end|>",
|
||||
"extra_special_tokens": {},
|
||||
"model_max_length": 16384,
|
||||
"pad_token": "<|dummy_85|>",
|
||||
"tokenizer_class": "GPT2TokenizerFast",
|
||||
"unk_token": "<|endoftext|>",
|
||||
"_commit_hash": null,
|
||||
"chat_template": "{% for message in messages %}{% if (message['role'] == 'system') %}{{'<|im_start|>system<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'user') %}{{'<|im_start|>user<|im_sep|>' + message['content'] + '<|im_end|>'}}{% elif (message['role'] == 'assistant') %}{{'<|im_start|>assistant<|im_sep|>' + message['content'] + '<|im_end|>'}}{% endif %}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant<|im_sep|>' }}{% endif %}"
|
||||
}
|
||||
1
vocab.json
Normal file
1
vocab.json
Normal file
File diff suppressed because one or more lines are too long
Reference in New Issue
Block a user