初始化项目,由ModelHub XC社区提供模型
Model: afrideva/tau-0.5B-instruct-GGUF Source: Original Platform
This commit is contained in:
42
.gitattributes
vendored
Normal file
42
.gitattributes
vendored
Normal file
@@ -0,0 +1,42 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
tau-0.5b-instruct.fp16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
tau-0.5b-instruct.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
tau-0.5b-instruct.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
tau-0.5b-instruct.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
tau-0.5b-instruct.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
tau-0.5b-instruct.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
tau-0.5b-instruct.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
77
README.md
Normal file
77
README.md
Normal file
@@ -0,0 +1,77 @@
|
|||||||
|
---
|
||||||
|
base_model: M4-ai/tau-0.5B-instruct
|
||||||
|
inference: false
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
license: other
|
||||||
|
model_creator: M4-ai
|
||||||
|
model_name: tau-0.5B-instruct
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
quantized_by: afrideva
|
||||||
|
tags:
|
||||||
|
- gguf
|
||||||
|
- ggml
|
||||||
|
- quantized
|
||||||
|
- q2_k
|
||||||
|
- q3_k_m
|
||||||
|
- q4_k_m
|
||||||
|
- q5_k_m
|
||||||
|
- q6_k
|
||||||
|
- q8_0
|
||||||
|
---
|
||||||
|
# M4-ai/tau-0.5B-instruct-GGUF
|
||||||
|
|
||||||
|
Quantized GGUF model files for [tau-0.5B-instruct](https://huggingface.co/M4-ai/tau-0.5B-instruct) from [M4-ai](https://huggingface.co/M4-ai)
|
||||||
|
|
||||||
|
|
||||||
|
| Name | Quant method | Size |
|
||||||
|
| ---- | ---- | ---- |
|
||||||
|
| [tau-0.5b-instruct.fp16.gguf](https://huggingface.co/afrideva/tau-0.5B-instruct-GGUF/resolve/main/tau-0.5b-instruct.fp16.gguf) | fp16 | 1.25 GB |
|
||||||
|
| [tau-0.5b-instruct.q2_k.gguf](https://huggingface.co/afrideva/tau-0.5B-instruct-GGUF/resolve/main/tau-0.5b-instruct.q2_k.gguf) | q2_k | 298.41 MB |
|
||||||
|
| [tau-0.5b-instruct.q3_k_m.gguf](https://huggingface.co/afrideva/tau-0.5B-instruct-GGUF/resolve/main/tau-0.5b-instruct.q3_k_m.gguf) | q3_k_m | 349.88 MB |
|
||||||
|
| [tau-0.5b-instruct.q4_k_m.gguf](https://huggingface.co/afrideva/tau-0.5B-instruct-GGUF/resolve/main/tau-0.5b-instruct.q4_k_m.gguf) | q4_k_m | 407.16 MB |
|
||||||
|
| [tau-0.5b-instruct.q5_k_m.gguf](https://huggingface.co/afrideva/tau-0.5B-instruct-GGUF/resolve/main/tau-0.5b-instruct.q5_k_m.gguf) | q5_k_m | 459.24 MB |
|
||||||
|
| [tau-0.5b-instruct.q6_k.gguf](https://huggingface.co/afrideva/tau-0.5B-instruct-GGUF/resolve/main/tau-0.5b-instruct.q6_k.gguf) | q6_k | 514.58 MB |
|
||||||
|
| [tau-0.5b-instruct.q8_0.gguf](https://huggingface.co/afrideva/tau-0.5B-instruct-GGUF/resolve/main/tau-0.5b-instruct.q8_0.gguf) | q8_0 | 664.60 MB |
|
||||||
|
|
||||||
|
|
||||||
|
|
||||||
|
## Original Model Card:
|
||||||
|
# tau-instruct-0.5B
|
||||||
|
|
||||||
|
## Model Details
|
||||||
|
- **Model Name:** tau-instruct-0.5B
|
||||||
|
- **Base Model:** tau-0.5B
|
||||||
|
- **Model Size:** 0.5B parameters
|
||||||
|
- **Model Type:** Instruction-following Language Model
|
||||||
|
- **Training Data**: About 16,000 entries generated by GPT-4.
|
||||||
|
|
||||||
|
## Model Use
|
||||||
|
tau-instruct-0.5B is an instruction-following language model designed to follow user instructions and provide assistance across a wide range of tasks, including but not limited to:
|
||||||
|
- Question answering
|
||||||
|
- Text generation and completion
|
||||||
|
- Mathematical problem solving
|
||||||
|
- Code understanding, generation, and explanation
|
||||||
|
- Reasoning and analysis
|
||||||
|
- Trivia and general knowledge
|
||||||
|
|
||||||
|
The model's ability to follow instructions, combined with its knowledge in various domains, makes it suitable for applications such as virtual assistants, educational tools, and research aids.
|
||||||
|
|
||||||
|
## Performance and Limitations
|
||||||
|
Preliminary evaluations indicate that tau-instruct-0.5B exhibits improved performance in following instructions compared to its base model, tau-0.5B. However, the model may still have limitations and biases inherited from its base model and the fine-tuning dataset.
|
||||||
|
|
||||||
|
Users should be aware that the model's performance may vary depending on the complexity and clarity of the provided instructions. It is essential to evaluate the model's outputs critically and provide feedback to support ongoing improvements.
|
||||||
|
|
||||||
|
## Environmental Impact
|
||||||
|
The fine-tuning process for tau-instruct-0.5B required additional computational resources, contributing to the model's overall environmental impact. Efforts were made to optimize the fine-tuning process and minimize the carbon footprint.
|
||||||
|
|
||||||
|
## Ethical Considerations
|
||||||
|
tau-instruct-0.5B has the potential to be used in a wide range of applications, some of which may have ethical implications. Users should ensure that the model is used responsibly and does not cause harm or discriminate against individuals or groups.
|
||||||
|
|
||||||
|
As with any AI system, it is crucial to consider the potential biases and limitations of the model when deploying it in real-world applications.
|
||||||
|
|
||||||
|
## Usage Rights
|
||||||
|
Make sure to read Qwen's license before using this model. The fine-tuned model, tau-instruct-0.5B, is subject to the same usage rights as its base model, tau-0.5B.
|
||||||
|
|
||||||
|
## Evaluation
|
||||||
|
Coming soon.
|
||||||
3
tau-0.5b-instruct.fp16.gguf
Normal file
3
tau-0.5b-instruct.fp16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:999a9bc48a5e13366020b24535fe058acd5c3517e12911548130ad0f4fed4dbd
|
||||||
|
size 1245333248
|
||||||
3
tau-0.5b-instruct.q2_k.gguf
Normal file
3
tau-0.5b-instruct.q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:685f59b769b9a8a540f97c7d7556a702f5c17b74c8fe61f0268e754aebc250c2
|
||||||
|
size 298412832
|
||||||
3
tau-0.5b-instruct.q3_k_m.gguf
Normal file
3
tau-0.5b-instruct.q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:49d0d65fd5e29105f83952783fee561c375b0dfe06af298cedc2089b93003deb
|
||||||
|
size 349882144
|
||||||
3
tau-0.5b-instruct.q4_k_m.gguf
Normal file
3
tau-0.5b-instruct.q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f77ddc9f2795b62c3346ef2f7e7d6a056cbc40314a747f6430c42fde5f9b7945
|
||||||
|
size 407155488
|
||||||
3
tau-0.5b-instruct.q5_k_m.gguf
Normal file
3
tau-0.5b-instruct.q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:04fbdc66253f96d5569dc40633a52ebd06f7e682a9ed7bca938eadc6ef261841
|
||||||
|
size 459240224
|
||||||
3
tau-0.5b-instruct.q6_k.gguf
Normal file
3
tau-0.5b-instruct.q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:dae5dea9d4051b31d8c0bafbb0873a1a3f9f9bdcf363850616c8d215876ebec7
|
||||||
|
size 514580256
|
||||||
3
tau-0.5b-instruct.q8_0.gguf
Normal file
3
tau-0.5b-instruct.q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:868b535c31a93c03843b321c9361ab8cb22f61803e97e377319ddafd6f2208ff
|
||||||
|
size 664602400
|
||||||
Reference in New Issue
Block a user