Bykot/rugpt3small_minhash_dedup_08
1
0
Fork 0
Code Issues Pull Requests Actions Projects Releases Wiki Activity

初始化项目，由ModelHub XC社区提供模型

Browse Source 
Model: Bykot/rugpt3small_minhash_dedup_08
Source: Original Platform
This commit is contained in:
ModelHub XC
2026-06-01 06:21:22 +08:00
commit f53754e11d
11 changed files with 250686 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

11
results/cleaning_summary.json Normal file
View File

@@ -0,0 +1,11 @@
{
"experiment": "minhash_dedup_08",
"method": "minhash_lsh",
"base_dataset_repo": "Bykot/c4_ru_200k_split",
"source_train_docs": 198000,
"cleaned_docs": 197775,
"removed_docs": 225,
"removed_percent": 0.11363636363636363,
"eval_docs": 2000,
"created_at_utc": "2026-05-12T01:13:09.279538+00:00"
}