pmock/localRAG
0
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Add evaluation matrix for 2000/400 chunks (loader x headers x search mode)

Browse Source 
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
Philipp Mock
2026-10-07 18:04:48 +02:00
co-authored by Claude Opus 5.5
parent 6b5c292158
commit 9ebcda1f55
50 changed files with 4383 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
eval/matrix_2000.out
+25
View File
@@ -0,0 +1,25 @@
human pypdf_2000 dense Recall@5 0.70 Recall@10 0.70 Recall@20 0.73 MRR 0.65
human pypdf_2000 hybrid Recall@5 0.70 Recall@10 0.73 Recall@20 0.83 MRR 0.69
human pypdf_2000 union Recall@5 0.70 Recall@10 0.73 Recall@20 0.77 MRR 0.68
human pypdf_2000_hdr dense Recall@5 0.67 Recall@10 0.73 Recall@20 0.77 MRR 0.65
human pypdf_2000_hdr hybrid Recall@5 0.67 Recall@10 0.73 Recall@20 0.77 MRR 0.68
human pypdf_2000_hdr union Recall@5 0.67 Recall@10 0.77 Recall@20 0.80 MRR 0.68
human docling_2000 dense Recall@5 0.60 Recall@10 0.60 Recall@20 0.63 MRR 0.51
human docling_2000 hybrid Recall@5 0.57 Recall@10 0.60 Recall@20 0.67 MRR 0.50
human docling_2000 union Recall@5 0.57 Recall@10 0.60 Recall@20 0.67 MRR 0.50
human docling_2000_hdr dense Recall@5 0.67 Recall@10 0.67 Recall@20 0.73 MRR 0.57
human docling_2000_hdr hybrid Recall@5 0.70 Recall@10 0.70 Recall@20 0.77 MRR 0.58
human docling_2000_hdr union Recall@5 0.70 Recall@10 0.70 Recall@20 0.77 MRR 0.58
synthetic pypdf_2000 dense Recall@5 0.81 Recall@10 0.84 Recall@20 0.84 MRR 0.68
synthetic pypdf_2000 hybrid Recall@5 0.91 Recall@10 1.00 Recall@20 1.00 MRR 0.78
synthetic pypdf_2000 union Recall@5 0.91 Recall@10 1.00 Recall@20 1.00 MRR 0.78
synthetic pypdf_2000_hdr dense Recall@5 0.84 Recall@10 0.84 Recall@20 0.84 MRR 0.73
synthetic pypdf_2000_hdr hybrid Recall@5 0.98 Recall@10 1.00 Recall@20 1.00 MRR 0.87
synthetic pypdf_2000_hdr union Recall@5 0.98 Recall@10 1.00 Recall@20 1.00 MRR 0.86
synthetic docling_2000 dense Recall@5 0.81 Recall@10 0.84 Recall@20 0.84 MRR 0.76
synthetic docling_2000 hybrid Recall@5 0.93 Recall@10 0.98 Recall@20 0.98 MRR 0.85
synthetic docling_2000 union Recall@5 0.93 Recall@10 0.98 Recall@20 0.98 MRR 0.85
synthetic docling_2000_hdr dense Recall@5 0.86 Recall@10 0.86 Recall@20 0.86 MRR 0.77
synthetic docling_2000_hdr hybrid Recall@5 0.95 Recall@10 1.00 Recall@20 1.00 MRR 0.87
synthetic docling_2000_hdr union Recall@5 0.95 Recall@10 0.98 Recall@20 1.00 MRR 0.87
FERTIG