17 lines
988 B
Plaintext
17 lines
988 B
Plaintext
|
|
============================================================
|
|
Schema Linking DPO Validation Report (with IR Enhancement)
|
|
============================================================
|
|
Model Path: /data/trained_models_august/linker_dpo/dpo_lr_1e-06_beta_0.2_alpha_0.3_epoch_1.0_seed_39392
|
|
Validation Data: /home/ruilin/OpenSQL/dataset/schema_link_dynamic_0718/BIRD_dev_dynamic.json
|
|
------------------------------------------------------------
|
|
Corpus Column Recall: 0.9078
|
|
Corpus Column Precision: 0.8285
|
|
Corpus Column F1-Score: 0.8664
|
|
------------------------------------------------------------
|
|
Bad JSON Format Rate: 0.0026 (4 points)
|
|
Imperfect Recall Rate: 0.2283 (350 points)
|
|
- Table-level Errors: 0.1115 (171 points)
|
|
- Column-level Errors: 0.1168 (179 points)
|
|
============================================================
|
|
|