commit 2b84852057f2a87e344811e8a778a835547efdbc Author: ModelHub XC Date: Sun Jun 7 04:52:12 2026 +0800 初始化项目，由ModelHub XC社区提供模型 Model: prithivMLmods/Llama-3.2-8B-GGUF-200K Source: Original Platform diff --git a/.gitattributes b/.gitattributes new file mode 100644 index 0000000..2150dee --- /dev/null +++ b/.gitattributes @@ -0,0 +1,38 @@ +*.7z filter=lfs diff=lfs merge=lfs -text +*.arrow filter=lfs diff=lfs merge=lfs -text +*.bin filter=lfs diff=lfs merge=lfs -text +*.bz2 filter=lfs diff=lfs merge=lfs -text +*.ckpt filter=lfs diff=lfs merge=lfs -text +*.ftz filter=lfs diff=lfs merge=lfs -text +*.gz filter=lfs diff=lfs merge=lfs -text +*.h5 filter=lfs diff=lfs merge=lfs -text +*.joblib filter=lfs diff=lfs merge=lfs -text +*.lfs.* filter=lfs diff=lfs merge=lfs -text +*.mlmodel filter=lfs diff=lfs merge=lfs -text +*.model filter=lfs diff=lfs merge=lfs -text +*.msgpack filter=lfs diff=lfs merge=lfs -text +*.npy filter=lfs diff=lfs merge=lfs -text +*.npz filter=lfs diff=lfs merge=lfs -text +*.onnx filter=lfs diff=lfs merge=lfs -text +*.ot filter=lfs diff=lfs merge=lfs -text +*.parquet filter=lfs diff=lfs merge=lfs -text +*.pb filter=lfs diff=lfs merge=lfs -text +*.pickle filter=lfs diff=lfs merge=lfs -text +*.pkl filter=lfs diff=lfs merge=lfs -text +*.pt filter=lfs diff=lfs merge=lfs -text +*.pth filter=lfs diff=lfs merge=lfs -text +*.rar filter=lfs diff=lfs merge=lfs -text +*.safetensors filter=lfs diff=lfs merge=lfs -text +saved_model/**/* filter=lfs diff=lfs merge=lfs -text +*.tar.* filter=lfs diff=lfs merge=lfs -text +*.tar filter=lfs diff=lfs merge=lfs -text +*.tflite filter=lfs diff=lfs merge=lfs -text +*.tgz filter=lfs diff=lfs merge=lfs -text +*.wasm filter=lfs diff=lfs merge=lfs -text +*.xz filter=lfs diff=lfs merge=lfs -text +*.zip filter=lfs diff=lfs merge=lfs -text +*.zst filter=lfs diff=lfs merge=lfs -text +*tfevents* filter=lfs diff=lfs merge=lfs -text +unsloth.F16.gguf filter=lfs diff=lfs merge=lfs -text +Llama-3.2-8B.F16.gguf filter=lfs diff=lfs merge=lfs -text +lama-3.2-8B.F16.gguf filter=lfs diff=lfs merge=lfs -text diff --git a/Llama-3.2-8B.F16.gguf b/Llama-3.2-8B.F16.gguf new file mode 100644 index 0000000..4cdc8ba --- /dev/null +++ b/Llama-3.2-8B.F16.gguf @@ -0,0 +1,3 @@ +version https://git-lfs.github.com/spec/v1 +oid sha256:7eda4e9c248ca71677a3d15b07a14e092e7d8d74c8540bc0499592fa21f2fcc8 +size 16068891008 diff --git a/README.md b/README.md new file mode 100644 index 0000000..7337cac --- /dev/null +++ b/README.md @@ -0,0 +1,97 @@ +--- +base_model: unsloth/meta-llama-3.1-8b-bnb-4bit +language: +- en +license: creativeml-openrail-m +tags: +- text-generation-inference +- transformers +- unsloth +- llama +- gguf +- 200K +datasets: +- HuggingFaceH4/ultrachat_200k +pipeline_tag: text-generation +--- + +# Llama-3.2-8B-GGUF-200K + +| Attribute | Description | +|-------------------------|--------------------------------------------------------------------------------------| +| **Developed by** | prithivMLmods | +| **License** | Apache-2.0 | +| **Finetuned from model**| unsloth/meta-llama-3.1-8b-bnb-4bit | + +# Run with Ollama 🦙 + +### Download and Install Ollama + +To get started, download Ollama from [https://ollama.com/download](https://ollama.com/download) and install it on your Windows or Mac system. + +### Run Your Own Model in Minutes + +### Steps to Run GGUF Models: + +#### 1. Create the Model File + - Name your model file appropriately, for example, `metallama200`. + +#### 2. Add the Template Command + - Include a `FROM` line with the base model file. For instance: + + ```bash + FROM Llama-3.2-8B-GGUF-200K + ``` + + - Make sure the model file is in the same directory as your script. + +#### 3. Create and Patch the Model + - Use the following command in your terminal to create and patch your model: + + ```bash + ollama create metallama200 -f ./metallama200 + ``` + + - Upon success, a confirmation message will appear. + + - To verify that the model was created successfully, run: + + ```bash + ollama list + ``` + + Ensure that `metallama200` appears in the list of models. + +--- + +## Running the Model + +To run the model, use: + +```bash +ollama run metallama200 +``` + +### Sample Usage + +In the command prompt, run: + +```bash +D:\>ollama run metallama200 +``` + +Example interaction: + +```plaintext +>>> write a mini passage about space x +Space X, the private aerospace company founded by Elon Musk, is revolutionizing the field of space exploration. +With its ambitious goals to make humanity a multi-planetary species and establish a sustainable human presence in +the cosmos, Space X has become a leading player in the industry. The company's spacecraft, like the Falcon 9, have +demonstrated remarkable capabilities, allowing for the transport of crews and cargo into space with unprecedented +efficiency. As technology continues to advance, the possibility of establishing permanent colonies on Mars becomes +increasingly feasible, thanks in part to the success of reusable rockets that can launch multiple times without +sustaining significant damage. The journey towards becoming a multi-planetary species is underway, and Space X +plays a pivotal role in pushing the boundaries of human exploration and settlement. +``` + +--- \ No newline at end of file diff --git a/config.json b/config.json new file mode 100644 index 0000000..a4ba21b --- /dev/null +++ b/config.json @@ -0,0 +1,3 @@ +{ + "model_type": "llama" +} \ No newline at end of file diff --git a/configuration.json b/configuration.json new file mode 100644 index 0000000..bbeeda1 --- /dev/null +++ b/configuration.json @@ -0,0 +1 @@ +{"framework": "pytorch", "task": "text-generation", "allow_remote": true} \ No newline at end of file