初始化项目，由ModelHub XC社区提供模型

Model: kaitchup/Meta-Llama-3.1-8B-Instruct-autoround-gptq-4bit-asym
Source: Original Platform

README.md

@@ -0,0 +1,23 @@
+---
+language:
+- en
+library_name: transformers
+license: cc-by-4.0
+tags:
+- auto-gptq
+- AutoRound
+---
+
+
+## Model Details
+
+This is [meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) quantized with AutoRound (asymmetric quantization) and serialized with the GPTQ format in 4-bit. The model has been created, tested, and evaluated by The Kaitchup.
+
+Details on quantization process, evaluation, and how to use the model here:
+[The Best Quantization Methods to Run Llama 3.1 on Your GPU](https://kaitchup.substack.com/p/the-best-quantization-methods-to)
+
+
+- **Developed by:** [The Kaitchup](https://kaitchup.substack.com/)
+- **Language(s) (NLP):** English
+- **License:** cc-by-4.0
+