初始化项目，由ModelHub XC社区提供模型

Model: MaziyarPanahi/Topxtral-4x7B-v0.1
Source: Original Platform

.gitattributes

@@ -0,0 +1,35 @@
+*.7z filter=lfs diff=lfs merge=lfs -text
+*.arrow filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.bz2 filter=lfs diff=lfs merge=lfs -text
+*.ckpt filter=lfs diff=lfs merge=lfs -text
+*.ftz filter=lfs diff=lfs merge=lfs -text
+*.gz filter=lfs diff=lfs merge=lfs -text
+*.h5 filter=lfs diff=lfs merge=lfs -text
+*.joblib filter=lfs diff=lfs merge=lfs -text
+*.lfs.* filter=lfs diff=lfs merge=lfs -text
+*.mlmodel filter=lfs diff=lfs merge=lfs -text
+*.model filter=lfs diff=lfs merge=lfs -text
+*.msgpack filter=lfs diff=lfs merge=lfs -text
+*.npy filter=lfs diff=lfs merge=lfs -text
+*.npz filter=lfs diff=lfs merge=lfs -text
+*.onnx filter=lfs diff=lfs merge=lfs -text
+*.ot filter=lfs diff=lfs merge=lfs -text
+*.parquet filter=lfs diff=lfs merge=lfs -text
+*.pb filter=lfs diff=lfs merge=lfs -text
+*.pickle filter=lfs diff=lfs merge=lfs -text
+*.pkl filter=lfs diff=lfs merge=lfs -text
+*.pt filter=lfs diff=lfs merge=lfs -text
+*.pth filter=lfs diff=lfs merge=lfs -text
+*.rar filter=lfs diff=lfs merge=lfs -text
+*.safetensors filter=lfs diff=lfs merge=lfs -text
+saved_model/**/* filter=lfs diff=lfs merge=lfs -text
+*.tar.* filter=lfs diff=lfs merge=lfs -text
+*.tar filter=lfs diff=lfs merge=lfs -text
+*.tflite filter=lfs diff=lfs merge=lfs -text
+*.tgz filter=lfs diff=lfs merge=lfs -text
+*.wasm filter=lfs diff=lfs merge=lfs -text
+*.xz filter=lfs diff=lfs merge=lfs -text
+*.zip filter=lfs diff=lfs merge=lfs -text
+*.zst filter=lfs diff=lfs merge=lfs -text
+*tfevents* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,106 @@
+---
+license: apache-2.0
+library_name: transformers
+pipeline_tag: text-generation
+tags:
+- merge
+- moe
+---
+
+
+
+## Examples
+
+describe about pros and cons of docker system.
+
+```
+Answer:
+Docker, a containerization platform, offers numerous advantages and potential drawbacks. Here's an overview of both aspects:
+
+Pros (Advantages):
+1. Isolation: Docker containers isolate applications from each other and their host systems, ensuring stability and preventing conflicts between dependencies.
+2. Portability: Applications packaged within Docker images can run consistently across different environments, including development, testing, and production.
+3. Resource Efficiency: Containers share the host OS kernel, reducing resource usage compared to traditional virtual machines.
+4. Rapid Development & Deployment: Developers can quickly build, test, and deploy applications using pre-configured Docker images.
+5. Version Control: Docker images enable versioning, allowing developers to track changes and roll back to previous versions if needed.
+6. Scalability: Containerized applications can be easily scaled horizontally by adding more instances.
+7. Simplified Dependency Management: Docker simplifies managing application dependencies since they come bundled with the image.
+
+Cons (Disadvantages):
+1. Learning Curve: Understanding Docker concepts and mastering its tools may require time for those new to containerization technology.
+2. Complexity: Managing multiple containers and orchestrating them can become complex, especially in large-scale deployments.
+3. Security Concerns: While containers offer isolation, vulnerabilities in base images or misconfigurations could lead to security risks.
+4. Storage Overhead: Although less than VMs, Docker still requires some storage overhead due to image layers and container metadata.
+5. Potential Compatibility Issues: Some applications might have compatibility issues when running inside containers, particularly if they rely on low-level system resources.
+
+In summary, Docker provides significant benefits for modern software development and deployment but also comes with certain challenges. The choice to adopt it depends on one's specific needs and context.</s>
+```
+
+
+Hi, I need to get from New York to Los Angeles. Can you help me with that?
+```
+{
+ "arguments": {"origin": "New York", "destination": "Los Angeles"},
+ "name": "get_directions"
+}</s>
+```
+
+
+
+There are three killers in a room. Someone enters the room and kills one of them. Nobody leaves the room. How many killers are left in the room? Explain your reasoning step by step.
+
+```
+There are three killers in a room. Someone enters the room and kills one of them. Nobody leaves the room. How many killers are left in the room? Explain your reasoning step by step. [/INST]
+1. Initially, there are three killers in the room.
+2. A new person enters the room and commits an act of killing one of the three killers.
+3. After this event, we need to determine how many killers remain in the room. The original number of killers was reduced by 1 due to the newcomer's action.
+4. So, the final count is three (initial killers) - 1 (killed by the newcomer) = two killers remaining in the room.</s>
+```
+Wrong! Should be 3!
+
+
+Mark is faster than Mary , Mary is faster than Joe. Is Joe faster than Mark? Let's think step by step
+
+```
+To determine if one person is faster than another based on the given information, we need to compare the relative speeds of each pair mentioned: Mark and Mary, and Mary and Joe.
+
+1. We know that "Mark is faster than Mary." This means when they race, Mark reaches the finish line before Mary does.
+2. The second statement tells us "Mary is faster than Joe." Here, it implies that in a race between them, Mary finishes ahead of Joe.
+
+Now, let's consider the question about whether "Joe is faster than Mark." Based on the provided comparisons, we have established the following order:
+- Mark > Mary (in terms of speed)
+- Mary > Joe (in terms of speed)
+
+Since the sequence shows Mark being faster than both Mary and Joe, there is no scenario where Joe would be faster than Mark according to the given information.
+```
+
+If I lay 2 wet shirts out in the sun flat on the ground to dry and it takes 5 hours until they are dry, how long would it take to dry 4 shirts of the same type that way simultanously? 
+
+```
+The time needed for drying clothes is not only determined by the number of shirts but also their surface area exposed to the sunlight. Since you're keeping the shirts flat, the additional shirts won't increase the total surface area exposed to the sun much. However, as there will be more fabric absorbing moisture, it might take a bit longer than simply dividing the original time by two.
+
+To estimate the new drying time, we can assume an inverse proportional relationship between the number of shirts and the drying time. This means if the number of shirts doubles, the time required approximately halves (but not exactly). So, with four shirts instead of two, the drying time could be around:
+
+```
+(5 hours) * (1 / sqrt(2)) ~ 3.5 hours
+```
+
+Please note this is just an approximation, and actual results may vary depending on factors like humidity, airflow, and the intensity of the sunlight.</s>
+```
+Answer should be: it will be the same.
+
+
+explain step by step 25-4*2+3=?
+```
+To solve the expression 25-4*2+3, follow these steps:
+
+1. Perform multiplication first: 4 * 2 = 8
+  The updated expression is now 25 - 8 + 3
+
+2. Next, perform subtraction: 25 - 8 = 17
+  The new expression becomes 17 + 3
+
+3. Finally, add the remaining numbers: 17 + 3 = 20
+
+So, the result of the given expression is 20.</s>
+```

config.json

@@ -0,0 +1,30 @@
+{
+  "_name_or_path": "CultriX/NeuralTrix-7B-dpo",
+  "architectures": [
+    "MixtralForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 32768,
+  "model_type": "mixtral",
+  "num_attention_heads": 32,
+  "num_experts_per_tok": 2,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 8,
+  "num_local_experts": 3,
+  "output_router_logits": false,
+  "rms_norm_eps": 1e-05,
+  "rope_theta": 10000.0,
+  "router_aux_loss_coef": 0.001,
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.37.2",
+  "use_cache": true,
+  "vocab_size": 32000
+}

model-00001-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0cfe9dbbe0ff1af3b367823f8f1780bf396ddac68f547d820f9a998a75a9bebc
+size 9970032552

model-00002-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f485b7794deebc6ca1f79fce62e5fa0f54d47c71816a3b351fb5c3f7420d7f2d
+size 9999376528

model-00003-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d8018be9b97b3a08efaa02a3a09d9e7f63d40fc7c631e978c5dbb28a2b3ab316
+size 9982599112

model-00004-of-00004.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:106b1b2b8a7e9188a90b99d07de3f04d2c6cd7738c90420832c3e0ca01fdf108
+size 7080885208

special_tokens_map.json

@@ -0,0 +1,24 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": "<s>",
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,42 @@
+{
+  "add_bos_token": true,
+  "add_eos_token": false,
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [],
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "legacy": true,
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<s>",
+  "sp_model_kwargs": {},
+  "spaces_between_special_tokens": false,
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}