初始化项目,由ModelHub XC社区提供模型

Model: srs6901/Vikras-MixP
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-04-12 18:44:00 +08:00
commit 7a7da18513
86 changed files with 1091656 additions and 0 deletions

View File

@@ -0,0 +1,49 @@
---
license: gemma
library_name: transformers
pipeline_tag: text-generation
base_model: google/gemma-3-1b-pt
---
# Vikra-HCT-YeAM-PhiMma-1B
Gemma-3-1b-pt + Microsoft_phi-2
HCT architecture release. YeAM (Yet Another Merge) implementation invariant.
## What it is
A compact 1B-class model produced via HCT-compatible merging.
The checkpoint is published in standard Hugging Face format (safetensors + index).
## YeAM summary
YeAM performs a controlled merge in a real 4D geometric formulation with ray-intersection alignment in parameter space.
It also supports targeted knowledge injection (distillation-style) into a chosen model while remaining HF-compatible.
## Usage (Transformers)
```python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch
m = "/path/to/Vikra-HCT-YeAM-PhiMma-1B"
tok = AutoTokenizer.from_pretrained(m, use_fast=False)
model = AutoModelForCausalLM.from_pretrained(
m,
torch_dtype=torch.bfloat16,
device_map="cuda",
).eval()
inputs = tok("Hello!", return_tensors="pt").to(model.device)
out = model.generate(**inputs, max_new_tokens=128)
print(tok.decode(out[0], skip_special_tokens=True))
```
## GGUF
Convert and quantize with llama.cpp (example):
```bash
python3 /path/to/llama.cpp/convert_hf_to_gguf.py /path/to/model --outtype bf16 --outfile model.bf16.gguf
/path/to/llama.cpp/build/bin/llama-quantize model.bf16.gguf model.Q6_K.gguf Q6_K
```

View File

@@ -0,0 +1,3 @@
{
"<image_soft_token>": 262144
}

View File

@@ -0,0 +1,37 @@
{
"architectures": [
"Gemma3ForCausalLM"
],
"attention_bias": false,
"attention_dropout": 0.0,
"attn_logit_softcapping": null,
"bos_token_id": 2,
"cache_implementation": "hybrid",
"eos_token_id": [
1,
106
],
"final_logit_softcapping": null,
"head_dim": 256,
"hidden_activation": "gelu_pytorch_tanh",
"hidden_size": 1152,
"initializer_range": 0.02,
"intermediate_size": 6912,
"max_position_embeddings": 32768,
"model_type": "gemma3_text",
"num_attention_heads": 4,
"num_hidden_layers": 26,
"num_key_value_heads": 1,
"pad_token_id": 0,
"query_pre_attn_scalar": 256,
"rms_norm_eps": 1e-06,
"rope_local_base_freq": 10000,
"rope_scaling": null,
"rope_theta": 1000000,
"sliding_window": 512,
"sliding_window_pattern": 6,
"torch_dtype": "bfloat16",
"transformers_version": "4.50.0.dev0",
"use_cache": true,
"vocab_size": 262144
}

View File

@@ -0,0 +1,13 @@
{
"bos_token_id": 2,
"cache_implementation": "hybrid",
"do_sample": true,
"eos_token_id": [
1,
106
],
"pad_token_id": 0,
"top_k": 64,
"top_p": 0.95,
"transformers_version": "4.50.0.dev0"
}

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:cd10088d6f4ea7bd681d61f3ae77b02e6202587e0817b5d91dad2e949bf248b7
size 1081244120

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:15d8aa3dfd280419d37ea5b3e79ea12aabf419cf96cbc11b17c8f4c9bb5a4aaa
size 918566568

File diff suppressed because one or more lines are too long

View File

@@ -0,0 +1,33 @@
{
"boi_token": "<start_of_image>",
"bos_token": {
"content": "<bos>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"eoi_token": "<end_of_image>",
"eos_token": {
"content": "<eos>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"image_token": "<image_soft_token>",
"pad_token": {
"content": "<pad>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"unk_token": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:4667f2089529e8e7657cfb6d1c19910ae71ff5f28aa7ab2ff2763330affad795
size 33384568

View File

@@ -0,0 +1,3 @@
version https://git-lfs.github.com/spec/v1
oid sha256:1299c11d7cf632ef3b4e11937501358ada021bbdf7c47638d13c0ee982f2e79c
size 4689074

File diff suppressed because it is too large Load Diff