初始化项目，由ModelHub XC社区提供模型
Model: nagolinc/nodelve_gemma_2_9b Source: Original Platform
This commit is contained in:
ModelHub XC
47
.gitattributes
vendored
Normal file
47
.gitattributes
vendored
Normal file
@@ -0,0 +1,47 @@
|
||||
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||
*.model filter=lfs diff=lfs merge=lfs -text
|
||||
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||
tokenizer.json filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-IQ3_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-F16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-IQ3_XXS-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-IQ4_NL-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-IQ4_XS-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-Q4_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-Q4_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-Q5_K_M-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-Q5_K_S-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-Q6_K-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
nodelve_gemma_2_9b-Q8_0-imat.gguf filter=lfs diff=lfs merge=lfs -text
|
||||
199
README.md
Normal file
199
README.md
Normal file
@@ -0,0 +1,199 @@
|
||||
---
|
||||
library_name: transformers
|
||||
tags: []
|
||||
---
|
||||
|
||||
# Model Card for Model ID
|
||||
|
||||
<!-- Provide a quick summary of what the model is/does. -->
|
||||
|
||||
|
||||
|
||||
## Model Details
|
||||
|
||||
### Model Description
|
||||
|
||||
<!-- Provide a longer summary of what this model is. -->
|
||||
|
||||
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
|
||||
|
||||
- **Developed by:** [More Information Needed]
|
||||
- **Funded by [optional]:** [More Information Needed]
|
||||
- **Shared by [optional]:** [More Information Needed]
|
||||
- **Model type:** [More Information Needed]
|
||||
- **Language(s) (NLP):** [More Information Needed]
|
||||
- **License:** [More Information Needed]
|
||||
- **Finetuned from model [optional]:** [More Information Needed]
|
||||
|
||||
### Model Sources [optional]
|
||||
|
||||
<!-- Provide the basic links for the model. -->
|
||||
|
||||
- **Repository:** [More Information Needed]
|
||||
- **Paper [optional]:** [More Information Needed]
|
||||
- **Demo [optional]:** [More Information Needed]
|
||||
|
||||
## Uses
|
||||
|
||||
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
||||
|
||||
### Direct Use
|
||||
|
||||
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Downstream Use [optional]
|
||||
|
||||
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Out-of-Scope Use
|
||||
|
||||
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Bias, Risks, and Limitations
|
||||
|
||||
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Recommendations
|
||||
|
||||
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
||||
|
||||
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
|
||||
|
||||
## How to Get Started with the Model
|
||||
|
||||
Use the code below to get started with the model.
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Training Details
|
||||
|
||||
### Training Data
|
||||
|
||||
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Training Procedure
|
||||
|
||||
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
||||
|
||||
#### Preprocessing [optional]
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
|
||||
#### Training Hyperparameters
|
||||
|
||||
- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
|
||||
|
||||
#### Speeds, Sizes, Times [optional]
|
||||
|
||||
<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Evaluation
|
||||
|
||||
<!-- This section describes the evaluation protocols and provides the results. -->
|
||||
|
||||
### Testing Data, Factors & Metrics
|
||||
|
||||
#### Testing Data
|
||||
|
||||
<!-- This should link to a Dataset Card if possible. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Factors
|
||||
|
||||
<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Metrics
|
||||
|
||||
<!-- These are the evaluation metrics being used, ideally with a description of why. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Results
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Summary
|
||||
|
||||
|
||||
|
||||
## Model Examination [optional]
|
||||
|
||||
<!-- Relevant interpretability work for the model goes here -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Environmental Impact
|
||||
|
||||
<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
|
||||
|
||||
Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
|
||||
|
||||
- **Hardware Type:** [More Information Needed]
|
||||
- **Hours used:** [More Information Needed]
|
||||
- **Cloud Provider:** [More Information Needed]
|
||||
- **Compute Region:** [More Information Needed]
|
||||
- **Carbon Emitted:** [More Information Needed]
|
||||
|
||||
## Technical Specifications [optional]
|
||||
|
||||
### Model Architecture and Objective
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
### Compute Infrastructure
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Hardware
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
#### Software
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Citation [optional]
|
||||
|
||||
<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
|
||||
|
||||
**BibTeX:**
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
**APA:**
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Glossary [optional]
|
||||
|
||||
<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## More Information [optional]
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Model Card Authors [optional]
|
||||
|
||||
[More Information Needed]
|
||||
|
||||
## Model Card Contact
|
||||
|
||||
[More Information Needed]
|
||||
34
config.json
Normal file
34
config.json
Normal file
@@ -0,0 +1,34 @@
|
||||
{
|
||||
"_name_or_path": "modified_gemma_2_9b",
|
||||
"architectures": [
|
||||
"Gemma2ForCausalLM"
|
||||
],
|
||||
"attention_bias": false,
|
||||
"attention_dropout": 0.0,
|
||||
"attn_logit_softcapping": 50.0,
|
||||
"bos_token_id": 2,
|
||||
"cache_implementation": "hybrid",
|
||||
"eos_token_id": 1,
|
||||
"final_logit_softcapping": 30.0,
|
||||
"head_dim": 256,
|
||||
"hidden_act": "gelu_pytorch_tanh",
|
||||
"hidden_activation": "gelu_pytorch_tanh",
|
||||
"hidden_size": 3584,
|
||||
"initializer_range": 0.02,
|
||||
"intermediate_size": 14336,
|
||||
"max_position_embeddings": 8192,
|
||||
"model_type": "gemma2",
|
||||
"num_attention_heads": 16,
|
||||
"num_hidden_layers": 42,
|
||||
"num_key_value_heads": 8,
|
||||
"pad_token_id": 0,
|
||||
"query_pre_attn_scalar": 256,
|
||||
"rms_norm_eps": 1e-06,
|
||||
"rope_theta": 10000.0,
|
||||
"sliding_window": 4096,
|
||||
"sliding_window_size": 4096,
|
||||
"torch_dtype": "float32",
|
||||
"transformers_version": "4.42.4",
|
||||
"use_cache": true,
|
||||
"vocab_size": 256000
|
||||
}
|
||||
8
generation_config.json
Normal file
8
generation_config.json
Normal file
@@ -0,0 +1,8 @@
|
||||
{
|
||||
"_from_model_config": true,
|
||||
"bos_token_id": 2,
|
||||
"cache_implementation": "hybrid",
|
||||
"eos_token_id": 1,
|
||||
"pad_token_id": 0,
|
||||
"transformers_version": "4.42.4"
|
||||
}
|
||||
3
model-00001-of-00008.safetensors
Normal file
3
model-00001-of-00008.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8f6e3c406e83ee9389788f2b78c579377d5ce7006b4e1f0cd47dc34791e4c9dd
|
||||
size 4844480456
|
||||
3
model-00002-of-00008.safetensors
Normal file
3
model-00002-of-00008.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:7d7f6c5e13845827b9fea6a8142efc1cfee792182fa2aedd1d563984dcfd14b1
|
||||
size 4962213464
|
||||
3
model-00003-of-00008.safetensors
Normal file
3
model-00003-of-00008.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8b5e1242706c0cf590523212cdc7f9b49ae3ecb4da25896f66454684f8171322
|
||||
size 4962271312
|
||||
3
model-00004-of-00008.safetensors
Normal file
3
model-00004-of-00008.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:b4e2ebc5d23d21dca49c87ace72b31a2696cbbacdcde29361cf22da9e76c4a4b
|
||||
size 4932853744
|
||||
3
model-00005-of-00008.safetensors
Normal file
3
model-00005-of-00008.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:edd07c54aff7cf2e486c16b63a580a458d932b4a419e3a8f645a2335f2e49ed4
|
||||
size 4962213528
|
||||
3
model-00006-of-00008.safetensors
Normal file
3
model-00006-of-00008.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:2b0ff036e842e95bd1f1790fd0b16731fd18b72394e177be2f00862f6acc9615
|
||||
size 4962213528
|
||||
3
model-00007-of-00008.safetensors
Normal file
3
model-00007-of-00008.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:f565c9e6dfe4863b41f52485793aa7fd8a58fa8740bdcade5ca6832b124dc640
|
||||
size 4962271328
|
||||
3
model-00008-of-00008.safetensors
Normal file
3
model-00008-of-00008.safetensors
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8be3ebd71f02ea2d1f515a0b1f0e515e4fc576abdb1f96712db600ba6cb145fc
|
||||
size 2378360680
|
||||
471
model.safetensors.index.json
Normal file
471
model.safetensors.index.json
Normal file
@@ -0,0 +1,471 @@
|
||||
{
|
||||
"metadata": {
|
||||
"total_size": 36966823936
|
||||
},
|
||||
"weight_map": {
|
||||
"model.embed_tokens.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.input_layernorm.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.mlp.down_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.mlp.up_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.post_attention_layernorm.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.post_feedforward_layernorm.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.pre_feedforward_layernorm.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.0.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.1.input_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.1.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.1.mlp.gate_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.1.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.1.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.1.post_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.1.pre_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.1.self_attn.k_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.1.self_attn.o_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.1.self_attn.q_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.1.self_attn.v_proj.weight": "model-00001-of-00008.safetensors",
|
||||
"model.layers.10.input_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.post_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.pre_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.10.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.input_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.post_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.pre_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.11.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.input_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.post_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.pre_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.12.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.input_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.post_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.pre_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.13.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.14.input_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.post_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.pre_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.14.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.input_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.post_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.pre_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.15.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.input_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.post_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.pre_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.16.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.input_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.post_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.pre_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.17.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.input_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.post_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.pre_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.18.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.input_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.mlp.down_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.mlp.gate_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.mlp.up_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.post_attention_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.post_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.pre_feedforward_layernorm.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.19.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.2.input_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.post_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.pre_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.2.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.20.input_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.20.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.20.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.20.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.20.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.20.post_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.20.pre_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.20.self_attn.k_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.20.self_attn.o_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.20.self_attn.q_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.20.self_attn.v_proj.weight": "model-00004-of-00008.safetensors",
|
||||
"model.layers.21.input_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.post_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.pre_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.21.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.input_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.post_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.pre_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.22.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.input_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.post_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.pre_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.23.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.input_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.post_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.pre_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.24.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.input_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.mlp.down_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.mlp.up_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.post_attention_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.post_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.pre_feedforward_layernorm.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.25.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.26.input_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.26.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.26.mlp.gate_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.26.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.26.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.26.post_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.26.pre_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.26.self_attn.k_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.26.self_attn.o_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.26.self_attn.q_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.26.self_attn.v_proj.weight": "model-00005-of-00008.safetensors",
|
||||
"model.layers.27.input_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.post_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.pre_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.27.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.input_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.post_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.pre_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.28.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.input_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.post_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.pre_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.29.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.3.input_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.post_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.pre_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.3.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.30.input_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.post_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.pre_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.30.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.input_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.mlp.down_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.post_attention_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.post_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.pre_feedforward_layernorm.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.31.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.32.input_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.32.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.32.mlp.gate_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.32.mlp.up_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.32.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.32.post_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.32.pre_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.32.self_attn.k_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.32.self_attn.o_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.32.self_attn.q_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.32.self_attn.v_proj.weight": "model-00006-of-00008.safetensors",
|
||||
"model.layers.33.input_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.post_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.pre_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.33.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.input_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.post_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.pre_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.34.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.input_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.post_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.pre_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.35.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.input_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.post_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.pre_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.36.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.input_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.post_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.pre_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.37.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.input_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.mlp.down_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.mlp.gate_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.mlp.up_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.post_attention_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.post_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.pre_feedforward_layernorm.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.self_attn.k_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.self_attn.o_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.self_attn.q_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.38.self_attn.v_proj.weight": "model-00007-of-00008.safetensors",
|
||||
"model.layers.39.input_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.post_feedforward_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.pre_feedforward_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.39.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.4.input_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.post_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.pre_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.4.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.40.input_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.post_feedforward_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.pre_feedforward_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.40.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.input_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.mlp.down_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.mlp.gate_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.mlp.up_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.post_attention_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.post_feedforward_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.pre_feedforward_layernorm.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.self_attn.k_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.self_attn.o_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.self_attn.q_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.41.self_attn.v_proj.weight": "model-00008-of-00008.safetensors",
|
||||
"model.layers.5.input_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.post_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.pre_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.5.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.input_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.mlp.down_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.post_attention_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.post_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.pre_feedforward_layernorm.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.6.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.7.input_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.7.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.7.mlp.gate_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.7.mlp.up_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.7.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.7.post_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.7.pre_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.7.self_attn.k_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.7.self_attn.o_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.7.self_attn.q_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.7.self_attn.v_proj.weight": "model-00002-of-00008.safetensors",
|
||||
"model.layers.8.input_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.post_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.pre_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.8.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.input_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.mlp.down_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.mlp.gate_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.mlp.up_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.post_attention_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.post_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.pre_feedforward_layernorm.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.self_attn.k_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.self_attn.o_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.self_attn.q_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.layers.9.self_attn.v_proj.weight": "model-00003-of-00008.safetensors",
|
||||
"model.norm.weight": "model-00008-of-00008.safetensors"
|
||||
}
|
||||
}
|
||||
3
nodelve_gemma_2_9b-F16.gguf
Normal file
3
nodelve_gemma_2_9b-F16.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0fd7bbe3d97d69849f1eddeb81a582ba1f4a8e92d968b033ac04c1e111d2b9e1
|
||||
size 18490680064
|
||||
3
nodelve_gemma_2_9b-IQ3_M-imat.gguf
Normal file
3
nodelve_gemma_2_9b-IQ3_M-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:8136130e8d64ecfc04ce692a2eab8d225ce3399332459d9c22e086f5de1639da
|
||||
size 4494615584
|
||||
3
nodelve_gemma_2_9b-IQ3_XXS-imat.gguf
Normal file
3
nodelve_gemma_2_9b-IQ3_XXS-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:6e086924acee111a4adffde0cb87c327e30029bf2d6668fdc7a19f0f835ca43d
|
||||
size 3796739104
|
||||
3
nodelve_gemma_2_9b-IQ4_NL-imat.gguf
Normal file
3
nodelve_gemma_2_9b-IQ4_NL-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:0fe79d7e783703562f4dbad0f736f49a9aeec0b0cf7cc89252cc0e6fd6f0d87b
|
||||
size 5443142688
|
||||
3
nodelve_gemma_2_9b-IQ4_XS-imat.gguf
Normal file
3
nodelve_gemma_2_9b-IQ4_XS-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3a85e7e54e52560605c469313d2a0cf75364d6266b1ec2901c5e9306630c1360
|
||||
size 5183030304
|
||||
3
nodelve_gemma_2_9b-Q4_K_M-imat.gguf
Normal file
3
nodelve_gemma_2_9b-Q4_K_M-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:d5cc0eb5743eb7d4f55abf1a03ccc7b7557536073b057a7f407c5587c3dec3f6
|
||||
size 5761057824
|
||||
3
nodelve_gemma_2_9b-Q4_K_S-imat.gguf
Normal file
3
nodelve_gemma_2_9b-Q4_K_S-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:19174a584432d4edc888294aba171cdd1af9b187ef9a49916fcfd9d3abcee199
|
||||
size 5478925344
|
||||
3
nodelve_gemma_2_9b-Q5_K_M-imat.gguf
Normal file
3
nodelve_gemma_2_9b-Q5_K_M-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:37e005b6d5bbcb0a6e755ba30d49b8f414edc277b7a4060d8e2b9745bfe02804
|
||||
size 6647366688
|
||||
3
nodelve_gemma_2_9b-Q5_K_S-imat.gguf
Normal file
3
nodelve_gemma_2_9b-Q5_K_S-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:cc098cfe36d72ee6b05de40ae008c78e95b7d619697f0f400581aab8d242801d
|
||||
size 6483592224
|
||||
3
nodelve_gemma_2_9b-Q6_K-imat.gguf
Normal file
3
nodelve_gemma_2_9b-Q6_K-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:89441c6a2504ad39ff7e85710224e790fdf25bd19856833808216904b7055b6e
|
||||
size 7589069856
|
||||
3
nodelve_gemma_2_9b-Q8_0-imat.gguf
Normal file
3
nodelve_gemma_2_9b-Q8_0-imat.gguf
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:9c84589e092a67170df458a8aa8f19a0f6480fa110662caab919951f360f9890
|
||||
size 9827148832
|
||||
34
special_tokens_map.json
Normal file
34
special_tokens_map.json
Normal file
@@ -0,0 +1,34 @@
|
||||
{
|
||||
"additional_special_tokens": [
|
||||
"<start_of_turn>",
|
||||
"<end_of_turn>"
|
||||
],
|
||||
"bos_token": {
|
||||
"content": "<bos>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"eos_token": {
|
||||
"content": "<eos>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"pad_token": {
|
||||
"content": "<pad>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
},
|
||||
"unk_token": {
|
||||
"content": "<unk>",
|
||||
"lstrip": false,
|
||||
"normalized": false,
|
||||
"rstrip": false,
|
||||
"single_word": false
|
||||
}
|
||||
}
|
||||
3
tokenizer.json
Normal file
3
tokenizer.json
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:3f289bc05132635a8bc7aca7aa21255efd5e18f3710f43e3cdb96bcd41be4922
|
||||
size 17525357
|
||||
3
tokenizer.model
Normal file
3
tokenizer.model
Normal file
@@ -0,0 +1,3 @@
|
||||
version https://git-lfs.github.com/spec/v1
|
||||
oid sha256:61a7b147390c64585d6c3543dd6fc636906c9af3865a5548f27f31aee1d4c8e2
|
||||
size 4241003
|
||||
2013
tokenizer_config.json
Normal file
2013
tokenizer_config.json
Normal file
File diff suppressed because it is too large
Load Diff
Reference in New Issue
Block a user