初始化项目,由ModelHub XC社区提供模型
Model: prithivMLmods/Marco-o1-GGUF Source: Original Platform
This commit is contained in:
48
.gitattributes
vendored
Normal file
48
.gitattributes
vendored
Normal file
@@ -0,0 +1,48 @@
|
|||||||
|
*.7z filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.arrow filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bin filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ftz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.gz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.h5 filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.joblib filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.model filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npy filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.npz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.onnx filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.ot filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.parquet filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pb filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pickle filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pkl filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pt filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.pth filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.rar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
||||||
|
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tar filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tflite filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.tgz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.wasm filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.xz filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zip filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*.zst filter=lfs diff=lfs merge=lfs -text
|
||||||
|
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-f16.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q3_k_l.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q3_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q4_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q5_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q5_k_s.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q6_k.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
|
marco-o1-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
||||||
89
README.md
Normal file
89
README.md
Normal file
@@ -0,0 +1,89 @@
|
|||||||
|
---
|
||||||
|
license: creativeml-openrail-m
|
||||||
|
language:
|
||||||
|
- en
|
||||||
|
base_model:
|
||||||
|
- AIDC-AI/Marco-o1
|
||||||
|
pipeline_tag: text-generation
|
||||||
|
library_name: transformers
|
||||||
|
tags:
|
||||||
|
- Llama-Cpp
|
||||||
|
- Marco-o1
|
||||||
|
- 8-bit
|
||||||
|
- f16
|
||||||
|
- CoT
|
||||||
|
- NLU
|
||||||
|
- Tree-Algorithm
|
||||||
|
- LRM
|
||||||
|
- multilingual
|
||||||
|
- Monte Carlo Tree Search
|
||||||
|
- MCTS
|
||||||
|
---
|
||||||
|
# MarcoPolo / Marco-o1-GGUF Modelfile
|
||||||
|
|
||||||
|
The **Marco-o1** model is designed to excel not only in structured disciplines like **mathematics**, **physics**, and **coding**, which traditionally benefit from reinforcement learning (RL), but also in addressing **open-ended problems** that require creativity, reasoning, and nuanced understanding. This unique capability positions it as a versatile tool for tasks demanding both precision and innovation.
|
||||||
|
|
||||||
|
| File Name [ Updated Files ] | Size | Description | Upload Status |
|
||||||
|
|-------------------------|------------|-----------------------------------------|----------------|
|
||||||
|
| `.gitattributes` | 2.25 kB | Git attributes configuration file | Uploaded |
|
||||||
|
| `README.md` | 5.23 kB | Updated README | Uploaded |
|
||||||
|
| `config.json` | 29 Bytes | Configuration file | Uploaded |
|
||||||
|
| `marco-o1-f16.gguf` | 15.2 GB | MARCO-O1 model (F16 precision) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q2_k.gguf` | 3.02 GB | MARCO-O1 model (Q2_K quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q3_k_l.gguf` | 4.09 GB | MARCO-O1 model (Q3_K_L quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q3_k_m.gguf` | 3.81 GB | MARCO-O1 model (Q3_K_M quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q3_k_s.gguf` | 3.49 GB | MARCO-O1 model (Q3_K_S quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q4_0.gguf` | 4.43 GB | MARCO-O1 model (Q4_0 quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q4_k_m.gguf` | 4.68 GB | MARCO-O1 model (Q4_K_M quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q4_k_s.gguf` | 4.46 GB | MARCO-O1 model (Q4_K_S quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q5_0.gguf` | 5.32 GB | MARCO-O1 model (Q5_0 quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q5_k_m.gguf` | 5.44 GB | MARCO-O1 model (Q5_K_M quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q5_k_s.gguf` | 5.32 GB | MARCO-O1 model (Q5_K_S quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q6_k.gguf` | 6.25 GB | MARCO-O1 model (Q6_K quantization) | Uploaded (LFS) |
|
||||||
|
| `marco-o1-q8_0.gguf` | 8.1 GB | MARCO-O1 model (Q8_0 quantization) | Uploaded (LFS) |
|
||||||
|
|
||||||
|
### Key Features:
|
||||||
|
1. **Structured Problem Solving**: Strong performance in tasks with definitive answers, such as calculations, algorithm design, and logical problem-solving.
|
||||||
|
2. **Open-Ended Resolutions**: Exceptional capability to generate thoughtful, nuanced responses for abstract or subjective queries, making it ideal for discussions, ideation, and explorative problem-solving.
|
||||||
|
3. **Reinforcement Learning Optimization**: Utilizes RL for improving accuracy in structured tasks while employing sophisticated datasets to enhance performance in creative or subjective domains.
|
||||||
|
|
||||||
|
### Intended Applications:
|
||||||
|
- **Academic Assistance**: Solve complex mathematical or scientific problems and explain concepts with clarity.
|
||||||
|
- **Creative Ideation**: Generate innovative ideas, solutions, or approaches to open-ended challenges.
|
||||||
|
- **Coding and Debugging**: Provide reliable coding solutions, optimizations, and error debugging in various programming languages.
|
||||||
|
- **Discussion and Debate**: Engage in meaningful conversations on subjective or philosophical topics, offering well-reasoned perspectives.
|
||||||
|
|
||||||
|
The **Marco-o1** model seamlessly blends analytical rigor with creative adaptability, making it an exceptional choice for a wide range of applications in education, research, and beyond.
|
||||||
|
|
||||||
|
# Run Ollama [ Marco-o1 ]
|
||||||
|
|
||||||
|
Ollama is a powerful tool that simplifies running machine learning models, allowing you to manage GGUF models effortlessly. This guide outlines the steps to download, install, and run your models quickly. To get started, download Ollama from [https://ollama.com/download](https://ollama.com/download) and install it on your Windows or Mac system. Once installed, creating a GGUF model involves a few straightforward steps.
|
||||||
|
|
||||||
|
First, create a model file and name it appropriately, such as `metallama`. Inside this file, include a `FROM` line to specify the base model you want to use. For instance, you can use `FROM Llama-3.2-1B.F16.gguf`. Ensure the specified model file is in the same directory as your script. Next, open your terminal and run the command `ollama create metallama -f ./metallama` to create and patch your model. After the process completes, you can confirm the successful creation of the model by running `ollama list` and ensuring `metallama` appears in the list.
|
||||||
|
|
||||||
|
To run your newly created model, use the command `ollama run metallama` in your terminal. You can then interact with the model directly. For example, asking the model to "write a mini passage about Space X" might generate a response highlighting Space X's revolutionary role in aerospace, its reusable rockets, and its vision for establishing colonies on Mars.
|
||||||
|
|
||||||
|

|
||||||
|
|
||||||
|
### Sample Usage
|
||||||
|
|
||||||
|
In the command prompt, you can execute:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
D:\>ollama run metallama
|
||||||
|
```
|
||||||
|
|
||||||
|
You can interact with the model like this:
|
||||||
|
|
||||||
|
```plaintext
|
||||||
|
>>> write a mini passage about space x
|
||||||
|
Space X, the private aerospace company founded by Elon Musk, is revolutionizing the field of space exploration.
|
||||||
|
With its ambitious goals to make humanity a multi-planetary species and establish a sustainable human presence in
|
||||||
|
the cosmos, Space X has become a leading player in the industry. The company's spacecraft, like the Falcon 9, have
|
||||||
|
demonstrated remarkable capabilities, allowing for the transport of crews and cargo into space with unprecedented
|
||||||
|
efficiency. As technology continues to advance, the possibility of establishing permanent colonies on Mars becomes
|
||||||
|
increasingly feasible, thanks in part to the success of reusable rockets that can launch multiple times without
|
||||||
|
sustaining significant damage. The journey towards becoming a multi-planetary species is underway, and Space X
|
||||||
|
plays a pivotal role in pushing the boundaries of human exploration and settlement.
|
||||||
|
```
|
||||||
|
With these easy steps, Ollama enables you to download, install, and operate custom or pre-trained models seamlessly. Whether you're exploring Llama’s capabilities or working on custom GGUF models, Ollama offers an efficient and user-friendly solution to achieve your machine learning objectives.
|
||||||
3
config.json
Normal file
3
config.json
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
{
|
||||||
|
"model_type": "qwen2"
|
||||||
|
}
|
||||||
1
configuration.json
Normal file
1
configuration.json
Normal file
@@ -0,0 +1 @@
|
|||||||
|
{"framework": "pytorch", "task": "text-generation", "allow_remote": true}
|
||||||
3
marco-o1-f16.gguf
Normal file
3
marco-o1-f16.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:623986e1af605e82352cf89cef987109d18f4ad632b57a676000d7514e4d119c
|
||||||
|
size 15237851264
|
||||||
3
marco-o1-q2_k.gguf
Normal file
3
marco-o1-q2_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:812f33665f102adc66f68c08c1e0887659b1d712ac55c0e732e3cbd7b6cea570
|
||||||
|
size 3015938208
|
||||||
3
marco-o1-q3_k_l.gguf
Normal file
3
marco-o1-q3_k_l.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:7c1a6d643fb275887f28ef8bfab3b30f85a50651a9e4542dd34c3fe91ad5e3dd
|
||||||
|
size 4088457376
|
||||||
3
marco-o1-q3_k_m.gguf
Normal file
3
marco-o1-q3_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:88bddb82c0b059d7b2889183e5129bc126231d0cb0deda854b3c06b6f228af35
|
||||||
|
size 3808389280
|
||||||
3
marco-o1-q3_k_s.gguf
Normal file
3
marco-o1-q3_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:cf842578578c19cd278214519161f0dc59e8998f5356f7b5e96f3fcf55ee2c02
|
||||||
|
size 3492366496
|
||||||
3
marco-o1-q4_0.gguf
Normal file
3
marco-o1-q4_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:472b1a7d68fa8f84a802cf4ad5a878aeaaef905b06b1a06be3d0d82fa6f56933
|
||||||
|
size 4431388832
|
||||||
3
marco-o1-q4_k_m.gguf
Normal file
3
marco-o1-q4_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:f62d20661c85504943d11a71b4a79654aaad26af11a9e1c16886dce9ce570e33
|
||||||
|
size 4683071616
|
||||||
3
marco-o1-q4_k_s.gguf
Normal file
3
marco-o1-q4_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8c45ec9e64608ae99ac4fdf7746cd18eb7ccfb9b8b495e85c1d68dad34700713
|
||||||
|
size 4457767072
|
||||||
3
marco-o1-q5_0.gguf
Normal file
3
marco-o1-q5_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:58e02c7bc670edda152333816abbf05dc61deed443ef795cb609533beb6501df
|
||||||
|
size 5315174560
|
||||||
3
marco-o1-q5_k_m.gguf
Normal file
3
marco-o1-q5_k_m.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:ceefe783b8cb4c338e817dafb838782d84219291bcf7f9289588f7c2aab0cb71
|
||||||
|
size 5444829312
|
||||||
3
marco-o1-q5_k_s.gguf
Normal file
3
marco-o1-q5_k_s.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:e957d04adbe2580337ccf258d041e8d9dd967b99a45c93f383fa7b51b3e98cf9
|
||||||
|
size 5315174560
|
||||||
3
marco-o1-q6_k.gguf
Normal file
3
marco-o1-q6_k.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:3d167b8f6eafdf7f67c9fb52b276cdef9c34f26ba8f861d650c9bc3ebb8be973
|
||||||
|
size 6254196896
|
||||||
3
marco-o1-q8_0.gguf
Normal file
3
marco-o1-q8_0.gguf
Normal file
@@ -0,0 +1,3 @@
|
|||||||
|
version https://git-lfs.github.com/spec/v1
|
||||||
|
oid sha256:8e8f1ae7336dc85feafaaa6e62ab7cfab6fd6b0775772714f5ab55da90424b18
|
||||||
|
size 8098523264
|
||||||
Reference in New Issue
Block a user