From 2b84852057f2a87e344811e8a778a835547efdbc Mon Sep 17 00:00:00 2001 From: ModelHub XC Date: Sun, 7 Jun 2026 04:52:12 +0800 Subject: [PATCH] =?UTF-8?q?=E5=88=9D=E5=A7=8B=E5=8C=96=E9=A1=B9=E7=9B=AE?= =?UTF-8?q?=EF=BC=8C=E7=94=B1ModelHub=20XC=E7=A4=BE=E5=8C=BA=E6=8F=90?= =?UTF-8?q?=E4=BE=9B=E6=A8=A1=E5=9E=8B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Model: prithivMLmods/Llama-3.2-8B-GGUF-200K Source: Original Platform --- .gitattributes | 38 +++++++++++++++++ Llama-3.2-8B.F16.gguf | 3 ++ README.md | 97 +++++++++++++++++++++++++++++++++++++++++++ config.json | 3 ++ configuration.json | 1 + 5 files changed, 142 insertions(+) create mode 100644 .gitattributes create mode 100644 Llama-3.2-8B.F16.gguf create mode 100644 README.md create mode 100644 config.json create mode 100644 configuration.json diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..2150dee --- /dev/null +++ b/.gitattributes @@ -0,0 +1,38 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +unsloth.F16.gguf filter=lfs diff=lfs merge=lfs -text +Llama-3.2-8B.F16.gguf filter=lfs diff=lfs merge=lfs -text +lama-3.2-8B.F16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Llama-3.2-8B.F16.gguf b/Llama-3.2-8B.F16.gguf new file mode 100644 index 0000000..4cdc8ba --- /dev/null +++ b/Llama-3.2-8B.F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7eda4e9c248ca71677a3d15b07a14e092e7d8d74c8540bc0499592fa21f2fcc8 +size 16068891008 diff --git a/README.md b/README.md new file mode 100644 index 0000000..7337cac --- /dev/null +++ b/README.md @@ -0,0 +1,97 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-bnb-4bit +language: +- en +license: creativeml-openrail-m +tags: +- text-generation-inference +- transformers +- unsloth +- llama +- gguf +- 200K +datasets: +- HuggingFaceH4/ultrachat_200k +pipeline_tag: text-generation +--- + +# Llama-3.2-8B-GGUF-200K + +| Attribute | Description | +|-------------------------|--------------------------------------------------------------------------------------| +| **Developed by** | prithivMLmods | +| **License** | Apache-2.0 | +| **Finetuned from model**| unsloth/meta-llama-3.1-8b-bnb-4bit | + +# Run with Ollama 🦙 + +### Download and Install Ollama + +To get started, download Ollama from [https://ollama.com/download](https://ollama.com/download) and install it on your Windows or Mac system. + +### Run Your Own Model in Minutes + +### Steps to Run GGUF Models: + +#### 1. Create the Model File + - Name your model file appropriately, for example, `metallama200`. + +#### 2. Add the Template Command + - Include a `FROM` line with the base model file. For instance: + + ```bash + FROM Llama-3.2-8B-GGUF-200K + ``` + + - Make sure the model file is in the same directory as your script. + +#### 3. Create and Patch the Model + - Use the following command in your terminal to create and patch your model: + + ```bash + ollama create metallama200 -f ./metallama200 + ``` + + - Upon success, a confirmation message will appear. + + - To verify that the model was created successfully, run: + + ```bash + ollama list + ``` + + Ensure that `metallama200` appears in the list of models. + +--- + +## Running the Model + +To run the model, use: + +```bash +ollama run metallama200 +``` + +### Sample Usage + +In the command prompt, run: + +```bash +D:\>ollama run metallama200 +``` + +Example interaction: + +```plaintext +>>> write a mini passage about space x +Space X, the private aerospace company founded by Elon Musk, is revolutionizing the field of space exploration. +With its ambitious goals to make humanity a multi-planetary species and establish a sustainable human presence in +the cosmos, Space X has become a leading player in the industry. The company's spacecraft, like the Falcon 9, have +demonstrated remarkable capabilities, allowing for the transport of crews and cargo into space with unprecedented +efficiency. As technology continues to advance, the possibility of establishing permanent colonies on Mars becomes +increasingly feasible, thanks in part to the success of reusable rockets that can launch multiple times without +sustaining significant damage. The journey towards becoming a multi-planetary species is underway, and Space X +plays a pivotal role in pushing the boundaries of human exploration and settlement. +``` + +--- \ No newline at end of file diff --git a/config.json b/config.json new file mode 100644 index 0000000..a4ba21b --- /dev/null +++ b/config.json @@ -0,0 +1,3 @@ +{ + "model_type": "llama" +} \ No newline at end of file diff --git a/configuration.json b/configuration.json new file mode 100644 index 0000000..bbeeda1 --- /dev/null +++ b/configuration.json @@ -0,0 +1 @@ +{"framework": "pytorch", "task": "text-generation", "allow_remote": true} \ No newline at end of file