What this checkpoint is
Direct preference optimisation on top of the corrective SFT, 2 epochs over 8,383 preference pairs. Intended to move the model from 'roughly right structure' to 'exactly right structure'.
Lineage
Fine-tuned from CheneyWong/povl-sft-2d-merge, which is its own immediate predecessor in the same run.
PaddleOCR-VL-1.6 (base)
└─ povl-dpo-2ep <-- this checkpoint
Results on public datasets
Base = the unmodified base model. Public datasets only; the project's
self-built benchmarks are excluded.
| Dataset |
n |
Base TEDS |
Ours TEDS |
d TEDS |
Base TEDS-S |
Ours TEDS-S |
d TEDS-S |
| PubTables-1M |
2000 |
0.9015 |
0.9403 |
+0.0388 |
0.9243 |
0.9503 |
+0.0259 |
| PubTables-v2 |
2000 |
0.9026 |
0.9556 |
+0.0530 |
0.9239 |
0.9644 |
+0.0405 |
| FinTabNet (OTSL) |
2000 |
0.9442 |
0.9651 |
+0.0209 |
0.9524 |
0.9726 |
+0.0202 |
| PubTabNet / ICDAR |
2000 |
0.9297 |
0.9293 |
-0.0004 |
0.9464 |
0.9425 |
-0.0038 |
| SynthTabNet |
2000 |
0.8093 |
0.9194 |
+0.1100 |
0.8474 |
0.9316 |
+0.0842 |
| TableVerse-5K |
? |
? |
? |
? |
? |
? |
? |
| OmniDocBench v1.5 |
? |
? |
? |
? |
? |
? |
? |
| OmniDocBench v1.6 |
? |
? |
? |
? |
? |
? |
? |
| CC-OCR |
? |
? |
? |
? |
? |
? |
? |
| OCRBench-v2 |
? |
? |
? |
? |
? |
? |
? |
| Real5 (re-shot OmniDoc) |
? |
? |
? |
? |
? |
? |
? |
| SPRINT-MUSTARD |
? |
? |
? |
? |
? |
? |
? |
| TABLET |
? |
? |
? |
? |
? |
? |
? |
| Overall (equal weight) |
- |
0.8975 |
0.9419 |
+0.0445 |
0.9189 |
0.9523 |
+0.0334 |
Note on SPRINT-MUSTARD: its ground truth carries no cell text, so its TEDS
(~0.22 here) measures how well the model reproduces empty cells and should
be ignored -- a perturbation test shows a structurally perfect prediction that
correctly reads the visible text scores 0.33 TEDS / 1.00 TEDS-S. Only the
TEDS-S column is meaningful for that dataset.
Known limitations
The gain is within sampling noise (+/- 0.5 pt) and should be treated as no effect. Worth recording precisely because it is evidence about where the remaining headroom is not.
Task format: a single table image plus the prompt Table Recognition:, one
pass, emitting OTSL markup (<fcel> <ecel> <ucel> <lcel> <xcel> <nl>).
Evaluation numbers are tracked separately and are not part of this card.