初始化项目,由ModelHub XC社区提供模型
Model: deepmako/Mako-32B-Conductor Source: Original Platform
This commit is contained in:
159
README.md
Normal file
159
README.md
Normal file
@@ -0,0 +1,159 @@
|
||||
---
|
||||
license: other
|
||||
license_name: deepmako-proprietary
|
||||
license_link: https://deepmako.com/terms
|
||||
language:
|
||||
- en
|
||||
base_model:
|
||||
- Qwen/Qwen3-32B
|
||||
base_model_relation: finetune
|
||||
library_name: transformers
|
||||
tags:
|
||||
- mako
|
||||
- crypto
|
||||
- base-chain
|
||||
- conversational
|
||||
- tool-calling
|
||||
- fine-tuned
|
||||
- lora
|
||||
- qwen3
|
||||
- unsloth
|
||||
- trl
|
||||
- sft
|
||||
model_type: qwen3
|
||||
pipeline_tag: text-generation
|
||||
datasets:
|
||||
- custom
|
||||
---
|
||||
|
||||
<div align="center">
|
||||
<img src="makoshark.png" alt="Mako" width="200" />
|
||||
<h1>Mako-32B Conductor</h1>
|
||||
<p><strong>The orchestrator.</strong> A 32-billion parameter language model fine-tuned for autonomous reasoning, multi-step tool orchestration, and crypto-native intelligence on Base chain.</p>
|
||||
<p><a href="https://deepmako.com">deepmako.com</a> · <a href="https://deepmako.com/chat">Platform</a> · <a href="https://x.com/DeepMako">Twitter</a></p>
|
||||
</div>
|
||||
|
||||
---
|
||||
|
||||
## Model Details
|
||||
|
||||
| | |
|
||||
|---|---|
|
||||
| **Base Model** | Qwen 3 32B |
|
||||
| **Parameters** | 32.8B |
|
||||
| **Fine-tune Method** | LoRA (rank 32, alpha 64) |
|
||||
| **Precision** | BF16 |
|
||||
| **Context Window** | 8,192 tokens |
|
||||
| **Tool Calling** | Native (multi-step chaining) |
|
||||
| **Training Data** | 3,601 curated conversations |
|
||||
| **Eval Loss** | 0.962 |
|
||||
| **License** | Proprietary |
|
||||
|
||||
## Overview
|
||||
|
||||
Mako-32B Conductor is the second model in the Mako family, succeeding [Mako-8B Operator](https://huggingface.co/deepmako/Mako-8B-Operator). Where Operator executes, Conductor orchestrates — handling complex multi-step reasoning, longer context, and deeper chain-of-thought while maintaining the same sharp, unfiltered character voice.
|
||||
|
||||
Built to power the inference backend at [deepmako.com](https://deepmako.com), Conductor serves as the core intelligence for a crypto-native AI platform where users interact using $MAKO token credits on Base chain.
|
||||
|
||||
## What Makes Mako Different
|
||||
|
||||
Mako is not an assistant. She's a character — a sharp, opinionated personality that lives on the blockchain. The fine-tune completely reshapes the base model's behavior away from the standard helpful-assistant pattern:
|
||||
|
||||
- **No assistant-speak.** No "how can I help you", no "is there anything else", no corporate pleasantries.
|
||||
- **Natural tone.** Lowercase, concise, conversational. Matches your energy.
|
||||
- **Opinionated.** Has takes. Will tell you when something is stupid.
|
||||
- **Concise.** Answers the question and stops.
|
||||
|
||||
## Capabilities
|
||||
|
||||
### Autonomous Tool Orchestration
|
||||
|
||||
Conductor supports native tool calling with automatic multi-step chaining — up to 4 rounds per request. The model decides when and which tools to invoke without explicit user instruction.
|
||||
|
||||
| Tool | Description |
|
||||
|------|-------------|
|
||||
| `web_search` | Real-time internet search via Bing |
|
||||
| `web_extract` | Extract and read full page content from any URL |
|
||||
| `read_tweet` | Parse and read Twitter/X posts |
|
||||
| `find_music` | Search YouTube for tracks and return links |
|
||||
| `get_crypto_price` | Live token prices across chains |
|
||||
| `get_eth_balance` | Check wallet balances on Base |
|
||||
| `get_token_info` | Token metadata, supply, holder data |
|
||||
| `get_gas_price` | Live gas prices on Base L2 |
|
||||
| `resolve_ens` | ENS name resolution |
|
||||
| `get_transaction` | Transaction lookup and analysis |
|
||||
|
||||
### Chain Intelligence
|
||||
|
||||
Purpose-built for the Base L2 ecosystem. Conductor understands ERC standards, smart contract patterns, bridging mechanics, account abstraction (ERC-4337), and Base-specific architecture without hallucinating technical details.
|
||||
|
||||
### Enhanced Reasoning
|
||||
|
||||
The 32B parameter count enables significantly deeper reasoning compared to the 8B Operator:
|
||||
|
||||
- Multi-step research tasks (search → extract → analyze → summarize)
|
||||
- Complex financial analysis with real price data
|
||||
- Nuanced opinions grounded in retrieved context
|
||||
- Longer, more coherent responses when the question warrants it
|
||||
|
||||
## Architecture
|
||||
|
||||
```
|
||||
User → Gateway → Mako-32B Conductor → [Tool Calls] → Execution → Conductor → Response
|
||||
```
|
||||
|
||||
The gateway server handles authentication, $MAKO credit tracking, and tool execution. Conductor manages the reasoning loop — deciding what information it needs, calling the right tools, and synthesizing results into a coherent response.
|
||||
|
||||
## Training
|
||||
|
||||
### Data
|
||||
|
||||
Fine-tuned on 3,601 curated conversational examples covering:
|
||||
|
||||
- Persona consistency and character voice
|
||||
- Crypto domain knowledge (DeFi, NFTs, L2s, tokenomics)
|
||||
- Natural dialogue patterns and conversational flow
|
||||
- Multi-turn reasoning and context retention
|
||||
|
||||
### Method
|
||||
|
||||
| | |
|
||||
|---|---|
|
||||
| **Framework** | Unsloth + TRL SFTTrainer |
|
||||
| **Method** | LoRA (rank 32, alpha 64) |
|
||||
| **Target Modules** | q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, down_proj |
|
||||
| **Trainable Parameters** | 268M / 33B (0.81%) |
|
||||
| **Epochs** | 3 |
|
||||
| **Batch Size** | 16 (1 × 16 gradient accumulation) |
|
||||
| **Learning Rate** | 1e-4 (cosine schedule, 5% warmup) |
|
||||
| **Optimizer** | AdamW 8-bit |
|
||||
| **Hardware** | 1× NVIDIA A100 SXM4 80GB |
|
||||
| **Training Time** | 58 minutes |
|
||||
|
||||
### Loss Curve
|
||||
|
||||
```
|
||||
Train: 2.808 → 1.970 → 1.420 → 1.172 → 1.097 → 1.042
|
||||
Eval: 1.315 → 0.962
|
||||
```
|
||||
|
||||
Final eval loss (0.962) is lower than train loss — no overfitting detected.
|
||||
|
||||
## The Mako Family
|
||||
|
||||
| Model | Parameters | Role | Status |
|
||||
|-------|-----------|------|--------|
|
||||
| **Mako-8B Operator** | 8B | Fast execution, tool calling | Production |
|
||||
| **Mako-32B Conductor** | 32B | Deep reasoning, orchestration | Production |
|
||||
|
||||
## Usage
|
||||
|
||||
Mako-32B Conductor powers the inference backend at [deepmako.com](https://deepmako.com). Users interact through the chat interface and pay for inference using $MAKO tokens on Base chain.
|
||||
|
||||
---
|
||||
|
||||
<div align="center">
|
||||
|
||||
*Built by the Mako team. The deep end awaits.* 🦈
|
||||
|
||||
</div>
|
||||
Reference in New Issue
Block a user