初始化项目,由ModelHub XC社区提供模型
Model: ruilinwho/Llama-3.1-8B-SchemaLinker Source: Original Platform
This commit is contained in:
17
BIRD_Validation_DPO_Result_IR_Enhanced.txt
Normal file
17
BIRD_Validation_DPO_Result_IR_Enhanced.txt
Normal file
@@ -0,0 +1,17 @@
|
||||
|
||||
============================================================
|
||||
Schema Linking DPO Validation Report (with IR Enhancement)
|
||||
============================================================
|
||||
Model Path: /data/trained_models_august/linker_dpo/dpo_lr_1e-06_beta_0.2_alpha_0.3_epoch_1.0_seed_39392
|
||||
Validation Data: /home/ruilin/OpenSQL/dataset/schema_link_dynamic_0718/BIRD_dev_dynamic.json
|
||||
------------------------------------------------------------
|
||||
Corpus Column Recall: 0.9078
|
||||
Corpus Column Precision: 0.8285
|
||||
Corpus Column F1-Score: 0.8664
|
||||
------------------------------------------------------------
|
||||
Bad JSON Format Rate: 0.0026 (4 points)
|
||||
Imperfect Recall Rate: 0.2283 (350 points)
|
||||
- Table-level Errors: 0.1115 (171 points)
|
||||
- Column-level Errors: 0.1168 (179 points)
|
||||
============================================================
|
||||
|
||||
Reference in New Issue
Block a user