初始化项目,由ModelHub XC社区提供模型

Model: divahno/cx-SmolLM2-360M-Q8_0
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-09-20 00:50:29 +08:00
commit 16057e7b7c
13 changed files with 245365 additions and 0 deletions

37
.gitattributes vendored Normal file
View File

@@ -0,0 +1,37 @@
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
cx-SmolLM2-360M-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
smollm2-cx-q4km.gguf filter=lfs diff=lfs merge=lfs -text

85
README.md Normal file
View File

@@ -0,0 +1,85 @@
---
license: apache-2.0
base_model: HuggingFaceTB/SmolLM2-360M-Instruct
tags:
- llama-cpp
- gguf
- cx-analytics
- fine-tuned
- lora
model_type: llama
quantized_by: llama.cpp
pipeline_tag: text-generation
---
# CX SmolLM2-360M Q8_0 GGUF
Fine-tuned [SmolLM2-360M-Instruct](https://huggingface.co/HuggingFaceTB/SmolLM2-360M-Instruct) for **CX (Customer Experience) analytics insights** — part of the Action-XM AI Guide system.
## Model Details
| Property | Value |
|----------|-------|
| Base model | HuggingFaceTB/SmolLM2-360M-Instruct |
| Architecture | LlamaForCausalLM |
| Parameters | 360M |
| Quantization | Q8_0 (GGUF) |
| File size | 369 MB |
| Context length | 8192 tokens |
| Training framework | MLX-LM (Apple Silicon) |
## Training
- **Method**: LoRA (r=16, alpha=32, targets: q/k/v/o projections)
- **Dataset**: 9,828 synthetic CX analytics examples (ChatML format)
- **Iterations**: 1,000
- **Learning rate**: 2e-5
- **Batch size**: 2
- **LoRA layers**: 16 (of 32)
- **Peak memory**: 3.2 GB
- **Hardware**: Apple Silicon (MLX)
### Training Data
Synthetic CX insight pairs generated via Claude Sonnet 4.6, covering:
- Funnel analysis and drop-off diagnosis
- Rage click / dead click interpretation
- Session replay pattern analysis
- Core Web Vitals optimization
- Scroll depth and engagement insights
- Heatmap and click pattern analysis
- Quick-back / bounce diagnosis
- Segment comparison and cohort analysis
Quality-gated: each example passed JSON structure, length, hallucination, and actionability checks.
## Usage
### llama.cpp
```bash
llama-cli -m cx-SmolLM2-360M-Q8_0.gguf -n 256 --temp 0.7 --chat-template chatml
```
### Python (llama-cpp-python)
```python
from llama_cpp import Llama
llm = Llama(model_path="cx-SmolLM2-360M-Q8_0.gguf", n_ctx=2048)
response = llm.create_chat_completion(messages=[
{"role": "system", "content": "You are a CX analytics assistant."},
{"role": "user", "content": "Cart abandonment is 71%. Average payment page duration is 12s. Insights?"},
])
print(response["choices"][0]["message"]["content"])
```
## Performance
On Apple Silicon (M1 Pro):
- Prompt processing: ~579 tokens/sec
- Generation: ~164 tokens/sec
## License
Apache 2.0 (same as base model)

31
config.json Normal file
View File

@@ -0,0 +1,31 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 1,
"eos_token_id": 2,
"hidden_act": "silu",
"hidden_size": 960,
"initializer_range": 0.02,
"intermediate_size": 2560,
"is_llama_config": true,
"max_position_embeddings": 8192,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 15,
"num_hidden_layers": 32,
"num_key_value_heads": 5,
"pad_token_id": 2,
"pretraining_tp": 1,
"rms_norm_eps": 1e-05,
"rope_interleaved": false,
"rope_scaling": null,
"rope_theta": 100000,
"tie_word_embeddings": true,
"transformers.js_config": {},
"transformers_version": "4.57.6",
"use_cache": true,
"vocab_size": 49152
}

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:54523d2360f30ea5408f5137e4571aa4a2a3046aa24e426f26209e89a6ecb939
size 386404928

6
onnx/chat_template.jinja Normal file
View File

@@ -0,0 +1,6 @@
{% for message in messages %}{% if loop.first and messages[0]['role'] != 'system' %}{{ '<|im_start|>system
You are a helpful AI assistant named SmolLM, trained by Hugging Face<|im_end|>
' }}{% endif %}{{'<|im_start|>' + message['role'] + '
' + message['content'] + '<|im_end|>' + '
'}}{% endfor %}{% if add_generation_prompt %}{{ '<|im_start|>assistant
' }}{% endif %}

31
onnx/config.json Normal file
View File

@@ -0,0 +1,31 @@
{
"architectures": [
"LlamaForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"bos_token_id": 1,
"eos_token_id": 2,
"hidden_act": "silu",
"hidden_size": 960,
"initializer_range": 0.02,
"intermediate_size": 2560,
"is_llama_config": true,
"max_position_embeddings": 8192,
"mlp_bias": false,
"model_type": "llama",
"num_attention_heads": 15,
"num_hidden_layers": 32,
"num_key_value_heads": 5,
"pad_token_id": 2,
"pretraining_tp": 1,
"rms_norm_eps": 1e-05,
"rope_interleaved": false,
"rope_scaling": null,
"rope_theta": 100000,
"tie_word_embeddings": true,
"transformers.js_config": {},
"transformers_version": "4.57.6",
"use_cache": true,
"vocab_size": 49152
}

View File

@@ -0,0 +1,7 @@
{
"_from_model_config": true,
"bos_token_id": 1,
"eos_token_id": 2,
"pad_token_id": 2,
"transformers_version": "4.57.6"
}

3
onnx/model.onnx Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:322637197f206d044c758d5f66f66e603a6c4cf7fa8dd909001773b422f758c9
size 1637335453

3
onnx/model_q4.onnx Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:59a9e7a706925de1a0be8333d24d44874e2574cc7a05603d9fb69f39bfaa924d
size 417404344

View File

@@ -0,0 +1,30 @@
{
"bos_token": {
"content": "<|im_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "<|im_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<|im_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"unk_token": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

244974
onnx/tokenizer.json Normal file

File diff suppressed because it is too large Load Diff

152
onnx/tokenizer_config.json Normal file
View File

@@ -0,0 +1,152 @@
{
"add_prefix_space": false,
"added_tokens_decoder": {
"0": {
"content": "<|endoftext|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"1": {
"content": "<|im_start|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"2": {
"content": "<|im_end|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"3": {
"content": "<repo_name>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"4": {
"content": "<reponame>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"5": {
"content": "<file_sep>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"6": {
"content": "<filename>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"7": {
"content": "<gh_stars>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"8": {
"content": "<issue_start>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"9": {
"content": "<issue_comment>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"10": {
"content": "<issue_closed>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"11": {
"content": "<jupyter_start>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"12": {
"content": "<jupyter_text>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"13": {
"content": "<jupyter_code>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"14": {
"content": "<jupyter_output>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"15": {
"content": "<jupyter_script>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
},
"16": {
"content": "<empty_output>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false,
"special": true
}
},
"backend": "tokenizers",
"bos_token": "<|im_start|>",
"clean_up_tokenization_spaces": false,
"eos_token": "<|im_end|>",
"extra_special_tokens": {},
"is_local": true,
"model_max_length": 8192,
"pad_token": "<|im_end|>",
"tokenizer_class": "PreTrainedTokenizerFast",
"unk_token": "<|endoftext|>",
"vocab_size": 49152
}

3
smollm2-cx-q4km.gguf Normal file
View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:25487c0ee1aa228b912dd914f93478ff49465d7f1b9ecfb4b996e3bd2fbb8f4e
size 270590528