xugangqiang
8c8253a3be
chore(deps): let download_go_deps.py fetch Go DeepDoc .ort weights ( #19376 )
...
Go DeepDoc now uses .ort weights downloaded via download_go_deps.py — no MODEL_DIR needed from repo root. Script fetches 5 model files into rag/res/deepdoc/; supports mirrors; CI updated. .onnx path unchanged.
2026-09-09 16:07:43 +08:00
xugangqiang
6de46a233c
feat(deepdoc): switch in-process Go backend from .onnx to FlatBuffer (.ort) models ( #19318 )
2026-09-08 12:54:10 +08:00
xugangqiang
c4a0190961
fix(native): build 0-origin raster in FromImage/Decode for cropped sub-images ( #19308 )
2026-09-08 11:27:28 +08:00
xugangqiang
1dce167602
chore: remove the DeepDoc Go alignment report ( #19311 )
2026-09-07 13:11:38 +08:00
xugangqiang
aaed9fd40e
Perf: link onnxruntime without --whole-archive to cut binary size ( #19277 )
2026-09-07 10:01:36 +08:00
xugangqiang
4298700cb2
chore(deps): depend on org mirror infiniflow/onnxruntime_go ( #19169 )
2026-09-04 15:26:46 +08:00
xugangqiang
50806c7e95
test(deepdoc): add 1.pdf colspan end-to-end replay test ( #19139 )
2026-09-02 16:37:50 +08:00
xugangqiang
0d1338d63e
fix(deepdoc): harden ORT build guard, OCR test contract ( #19082 )
2026-09-02 12:13:19 +08:00
xugangqiang
c28edde895
feat(deepdoc): in-process static-linked ONNX Runtime DeepDoc backend ( #18731 )
2026-08-31 13:18:12 +08:00
xugangqiang
9c4c7d0ad4
fix(pdf): remove unused context import breaking manual test build ( #18837 )
2026-08-27 11:22:07 +08:00
xugangqiang
d82ab2eced
fix(pdf): do not cross-page merge tables whose anchor is not at page bottom ( #18789 )
2026-08-27 09:55:59 +08:00
Jin Hai
6c2bca893c
Go: fix context, part3 ( #18821 )
...
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2026-08-26 22:33:10 +08:00
Taranum Wasu
ee3360bccb
fix(pdf): strip tiled watermark text from text-layer extraction ( #18308 )
2026-08-25 19:52:34 +08:00
jay77721
f9e86b1bb1
fix(parser): crop media sections in PDF JSON path, unify Data URI and markdown rendering ( #18742 )
2026-08-25 19:47:02 +08:00
xugangqiang
b6a0a3cc62
fix(pdf): restore cross-page table merge wrongly rejected by #18688 page-absolute Y gate ( #18740 )
2026-08-25 19:05:48 +08:00
xugangqiang
d7e3592501
fix(pdf): colspan assembly loss + TSR geometry comparison diagnostics ( #18727 )
2026-08-25 15:03:10 +08:00
Jack
4b6346b052
fix(deepdoc): propagate spanning-cell bbox so Go emits correct colspan ( #18707 )
2026-08-25 10:41:17 +08:00
Jack
290a8d8f79
fix(deepdoc): prevent cross-page table over-merge from page-local Y coordinates ( #18688 )
2026-08-25 10:18:01 +08:00
Jack
aa6e19e70f
fix(deepdoc): resolve OCR text gaps — char loss/duplication in pdf parser ( #18643 )
2026-08-23 10:22:00 +08:00
Jack
b1b8cd6235
fix(deepdoc): align Go table row count with Python per-char R/C in parity replay ( #18622 )
2026-08-22 23:13:11 +08:00
Jack
6483f84d0c
fix(deepdoc): close ocr_real text-gap divergences and pin char-to-box matching ( #18630 )
2026-08-21 20:12:56 +08:00
Jack
295dc12cc5
fix(deepdoc): preserve covered cells through span injection so span tables keep all TSR rows ( #18574 )
2026-08-20 19:59:17 +08:00
Jack
f793a44f99
fix(deepdoc): dedup OCR substring fragments regardless of whitespace divergence ( #18568 )
2026-08-20 19:59:05 +08:00
Jack
20ee2dad22
fix(deepdoc): drop nested OCR boxes before table cell fill + expose 13/14 parity gaps ( #18524 )
2026-08-20 15:57:58 +08:00
Jack
c90a0b7a87
feat(deepdoc): Python-intermediate replay parity harness + table cell-fill fixes ( #18516 )
2026-08-19 21:45:45 +08:00
Wangshu
e3def573d4
fix(deepdoc): collapse overlapping OCR boxes before Go table cell-fill ( #18507 )
2026-08-19 16:05:56 +08:00
Jack
746fe4f0b3
fix(deepdoc): align table header detection with Python (follow-up to #18404 ) ( #18454 )
2026-08-19 10:57:30 +08:00
Jack
b6b6c4de97
fix(deepdoc): score table orientation by per-line detect+recognize ( #18452 )
2026-08-18 22:48:39 +08:00
Jack
b78b559ac5
Remove noocr/SkipOCR dead code path and text-layer-only parity test ( #18443 )
2026-08-18 22:47:31 +08:00
Jack
c370f629dc
fix(deepdoc): align Go table header detection with Python (parity #4 ) ( #18404 )
2026-08-18 17:24:19 +08:00
Jack
06463f6a35
fix(deepdoc): preserve cross-page continuation rows on column-count mismatch ( #18416 )
2026-08-18 16:16:02 +08:00
Jack
5aeba40d99
chore(deepdoc): remove dead standalone DLA client, converge on inference.Client ( #18384 )
2026-08-18 16:14:37 +08:00
Jack
fb788ee7dc
fix(deepdoc): assign each PDF box to a single table cell matching Python ( #18410 )
2026-08-18 15:13:41 +08:00
Jack
fa386ddf10
fix(deepdoc): drop per-cell OCR in Go table parser to align with Python ( #18405 )
2026-08-18 13:42:16 +08:00
Jack
97db1b4c38
chore(table): remove stale manual parity-issues test ( #18403 )
2026-08-18 13:18:57 +08:00
Jack
3a7e275155
fix(deepdoc): add orphan-row cleanup to Go table construction (parity with Python) ( #18402 )
2026-08-18 13:18:25 +08:00
Jack
d3ff25763c
fix(deepdoc): align table orientation scoring with Python recognition confidence ( #18401 )
2026-08-18 13:18:09 +08:00
Jack
5ec11f7b07
fix(pdf): align TSR crop margin with Python (fixed 30px, not 3%) ( #18387 )
2026-08-18 13:11:41 +08:00
Jack
f94438adcc
fix(parser): check every grid row, not just the first, before cross-page rebuild ( #18378 )
2026-08-18 09:45:46 +08:00
Jin Hai
68f8260821
Go: fix context, part3 ( #18390 )
...
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2026-08-18 00:07:37 +08:00
Jack
cb012380fe
fix(deepdoc): trim garbage-gate comments, fix subtest fact error, dedupe constants ( #18377 )
2026-08-17 19:08:47 +08:00
questfever
52519e2fd7
refactor: replace Split in loops with more efficient SplitSeq ( #18248 )
2026-08-17 19:04:04 +08:00
Jack
68da250f8f
Fix cross-page merged tables dropping continuation rows ( #18362 )
2026-08-17 17:58:19 +08:00
Jack
7ceafa07f8
fix(deepdoc): drop low-confidence garbage DLA regions to match Python ( #18365 )
...
- The Go DLA client (`inference.Client.DLA`) kept `footer`/`header`/`reference` regions whose detection confidence was below 0.4.
- Python's production path (`parse_into_bboxes` -> `LayoutRecognizer.__call__`, `deepdoc/vision/layout_recognizer.py:97` and `:379`) drops such regions via a 0.4 garbage gate over
`garbage_layouts=['footer','header','reference']`.
- The shared `/predict/dla` backend runs `LayoutRecognizer.forward`, which does **not** apply that gate, so the Go client was the only place the filter was missing — a real Go<->Python parity gap.
2026-08-17 17:50:28 +08:00
Jack
bd01c78d2b
fix(pdf): drop text boxes only when replaced by a table HTML ( #18363 )
...
## Problem
In the Go PDF pipeline, `processTablesWithReplacements`
(`internal/deepdoc/parser/pdf/table/table_post.go`) marked **every** box
overlapping a DLA table region for removal, then `insertTableBoxes`
re-inserted an HTML box only when `buildTableHTMLs` produced one.
When DLA over-labels a **text** box as a table but TSR produces **no
cells** (so `buildTableHTMLs` skips the table and `htmls[ti]` is unset),
the box was removed with nothing re-inserted — the original text was
**silently dropped**.
2026-08-17 17:07:56 +08:00
Jack
8d20cbd0b3
deepdoc(pdf): WarpCrop de-skew + score-based layer-2 rotation (Go OCR parity with Python) ( #18299 )
...
Supersedes / folds in #18305 . The score-based layer-2 rotation selection from #18305 now lives here, on top of `WarpCrop` (layer 1), applied to **all three** Go OCR paths, together with the Python score plumbing the Go side depends on. #18305 is closed in favor of this PR.
2026-08-17 15:13:56 +08:00
Jack
272645a27a
fix(pdf): align DLA region handling with Python reference ( #18295 )
...
Aligns three Go DLA / PDF post-processing behaviors with the Python `deepdoc` reference so the Go PDF pipeline matches Python's DLA region / annotation semantics.
2026-08-17 14:33:44 +08:00
Jin Hai
fa5762336b
Go: fix context, part2 ( #18296 )
...
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2026-08-14 19:42:41 +08:00
Jack
2678a0c5f5
deepdoc: send lossless PNG instead of JPEG to the DeepDoc inference service ( #18282 )
2026-08-14 18:49:33 +08:00
Jin Hai
2c775d0549
Go: fix context ( #18291 )
...
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2026-08-14 17:50:13 +08:00
xugangqiang
Jin Hai
Taranum Wasu
jay77721
Wangshu
questfever