arcee-ai/Llama-3-OpenBioLLM-JSL-8B-SLERP
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity
Files
main
Llama-3-OpenBioLLM-JSL-8B-S…/README.md
ModelHub XC bd78492f07 初始化项目，由ModelHub XC社区提供模型 
Model: arcee-ai/Llama-3-OpenBioLLM-JSL-8B-SLERP
Source: Original Platform
2026-06-03 01:44:13 +08:00

915 B
Raw Permalink Blame History

license, tags
license tags
apache-2.0
merge
mergekit
aaditya/OpenBioLLM-Llama3-8B
johnsnowlabs/JSL-Med-Sft-Llama-3-8B

arcee-ai/Llama-3-OpenBioLLM-JSL-8B-SLERP

arcee-ai/Llama-3-OpenBioLLM-JSL-8B-SLERP is a merge of the following models using mergekit:

🧩 Configuration

slices:
  - sources:
      - model: aaditya/OpenBioLLM-Llama3-8B
        layer_range: [0, 32]
      - model: johnsnowlabs/JSL-Med-Sft-Llama-3-8B
        layer_range: [0, 32]
merge_method: slerp
base_model: aaditya/OpenBioLLM-Llama3-8B
parameters:
  t:
    - filter: self_attn
      value: [0, 0.5, 0.3, 0.7, 1]
    - filter: mlp
      value: [1, 0.5, 0.7, 0.3, 0]
    - value: 0.5
dtype: bfloat16