初始化项目,由ModelHub XC社区提供模型
Model: ShahriarFerdoush/deepseek-7b-math-code-obf-emb-ties-k10 Source: Original Platform
This commit is contained in:
34
merge_stats.json
Normal file
34
merge_stats.json
Normal file
@@ -0,0 +1,34 @@
|
||||
{
|
||||
"method": "obf-emb-ties",
|
||||
"base_model": "deepseek-ai/deepseek-llm-7b-base",
|
||||
"ft_models": [
|
||||
"deepseek-ai/deepseek-math-7b-base",
|
||||
"deepseek-ai/deepseek-coder-7b-base-v1.5"
|
||||
],
|
||||
"weights": [
|
||||
1,
|
||||
1
|
||||
],
|
||||
"density": 0.1,
|
||||
"merge_time_seconds": 620.2964997291565,
|
||||
"logits_clean": true,
|
||||
"smoke_generations": {
|
||||
"math": "Question: If a store sells 3 apples for $2, how much would 15 apples cost?\n\nAnswer: Let me solve this step by step.\nBring rainy madness fame \\[Spend seventeen dancers \\[\\ redeem Bobby Hurricane \\[ Bark kidding traders payday _. Dollar Dollars \\[ Boss Teddy Aunt Yun Ru KD Buk Kob Yak Bunny Feet Ow Earn Ore Nash Nurs Ner Nash Nar Kids NSF NN SSS Knights Dodge RHS Knot DK RB RK UD Rud KK Blind Kot BJ Kart Kop NU NK ND KO DST OO DN Participants PD BD OD Boards Buff Doors Neut DF IrrKD ASAP nd Brillirt Pup Bub OTP PU BBB DPS PP PursKP PP Buk OP dBDD IBOTS BB OH BPS HBODO PLL Pul BHIB PBIBA PBS Bott BPABBOTT PP pand OBOTHER DPOLD OT OL\u00c0 MIR BP DAR JP UB DOT Kod Iris BOOST BRA BTC dun PAR BOOK CRT BFZO BoseBul SSITA BV DOSERE BCS IMMUL IM",
|
||||
"code": "Problem: Write a Python function that returns the sum of even numbers in a list.\n\nSolution:\nSol \\[1 Ace \\[ RHS Sizes synonyms \\[ [# WW RW LIN\\^ NN SSS warp ESS WAR MX EV HV EW EH HF RH RB NZ RV RM LR NR DEV EQ PP ESL EOS ERR OO OE Ow ND OD ER ED EAR NSD REV Purs TRY WOR OT EB RD RR ROI ROM OTP RN RU NU COS Neut CCD CCC UNS ECC SS ERA FD COPODO COUNT DOS OP Err NAND COR DAR DPS MIR ADA MER Imported DEN DEM KD DU IST DY swapped BOM\u00c0 IMM UA PRINT BOOKIER ANNOWN Disabled HAND IMO NONUNDOTABLE HUDITOROTH UNDERBOOKACCORDIED ERROR OLD JE SMPOLDER PATAPER BEST SCHKRUNTIUS EACH BUS HMS FOREIGN OLIGHITYBOR COLLIMITARDUESOUR JPILLEPREVERTABB PU POTULARVIS HU"
|
||||
},
|
||||
"aggregator": "ties",
|
||||
"merge_embed": "ties",
|
||||
"merge_norm": "ties",
|
||||
"percdamp": 0.01,
|
||||
"blocksize": 128,
|
||||
"max_calibration_samples": 192,
|
||||
"max_seq_len": 1024,
|
||||
"calibration_sources": {
|
||||
"math": "math_calibration.json (GSM8K-train + MATH-train mix)",
|
||||
"code": "theblackcat102/evol-codealpaca-v1 (HF, train split)"
|
||||
},
|
||||
"total_params": 12981370880,
|
||||
"kept_params": 1298125216.0,
|
||||
"actual_density": 0.09999908545868462,
|
||||
"final_conflicts": 707583
|
||||
}
|
||||
Reference in New Issue
Block a user