Harsh Kashyap
af61e3fcd6
fix(api): validate embedding check sample count ( #19574 )
...
Fix #19567 — validate check_num before sampler use. Non-integer/zero/negative values now return clear argument errors.
2026-09-14 13:53:11 +08:00
Yingfeng
1f5d33333a
Add claim/evidence to tree/pageindex compilation pipeline ( #19267 )
2026-09-11 22:37:33 +08:00
buua436
2aedd79b8f
refa: remove unused knowledge compilation code ( #19437 )
2026-09-11 10:15:53 +08:00
buua436
7e86beadd1
fix: route navigation API through tree search ( #19493 )
2026-09-10 17:13:57 +08:00
buua436
7b01906d45
fix: filter structure alteration by document products ( #19346 )
2026-09-08 13:23:28 +08:00
Manan Bansal
03d861a926
fix(api): allow setting language on dataset creation ( #15703 ) ( #16242 )
...
Fix #15703 — dataset create endpoint now accepts language.
2026-09-08 10:53:40 +08:00
Wang Qi
f8b0a1de19
Refactor: update dataset API should not have ext ( #19272 )
2026-09-07 14:25:15 +08:00
buua436
f4bafa1596
fix: exclude empty documents from structure alteration ( #19246 )
2026-09-04 17:06:38 +08:00
buua436
447f87d79f
feat: adapt knowledge compilation concurrency ( #19156 )
2026-09-04 11:17:56 +08:00
Yingfeng
a11c27e01d
Adjust navigation tools for agentic search ( #19172 )
2026-09-03 10:43:00 +08:00
buua436
cf441d4c72
fix: align wiki alteration provenance ( #19140 )
2026-09-02 18:03:15 +08:00
Wang Qi
fe63e09781
Refactor: add total/returned entities/relations ( #19095 )
2026-09-01 16:01:59 +08:00
b149a392f4
fix(api): return parsing-status counts at the top level of each dataset ( #17595 ) ( #17611 )
...
Fix #17595 — parsing status counts now return as top-level fields per documentation, not nested under parsing_status.
Signed-off-by: Anai-Guo <antai12232931@anaiguo.com >
Signed-off-by: Anai-Guo <antai12232931@outlook.com >
Co-authored-by: Anai-Guo <antai12232931@anaiguo.com >
Co-authored-by: Jin Hai <haijin.chn@gmail.com >
2026-08-31 13:52:08 +08:00
Wang Qi
66113709cc
Feature: add highlight for retrieval testing and search ( #18981 )
2026-08-28 19:26:41 +08:00
MarMar Labs
439c3be9cb
fix(dataset): rebuild the navigation tree in the dataset owner index ( #18932 )
...
Fix generate_nav tenant mismatch: wipe used dataset owner's tenant_id but rebuild used caller's. Team members could delete owner's navigation tree and rebuild into their own. Now both use kb.tenant_id.
2026-08-28 11:58:31 +08:00
Wang Qi
f74e04581a
Refactor: add page_size support ( #18876 )
2026-08-28 09:37:44 +08:00
Wang Qi
fd7cd3289a
Fix total as the total, follow Go ( #18750 )
2026-08-25 19:25:43 +08:00
Wang Qi
92c69db79e
Refactor: expose knn top_k and knn num_candidaties ( #18737 )
...
Follow on #18300
2026-08-25 17:16:36 +08:00
Mpider-San
aa57022bfd
Fix: cross-KB document id collision in data source sync ( #18116 ) ( #18244 )
...
### What problem does this PR solve?
Closes #18116 .
Fix cross-KB document ID collision (#18116 ). Older ID derivation excluded kb_id, causing two KBs to fight over one row. Unified derivation to be KB-scoped, with fallback for existing rows. Stranded rows are reclaimed, dataset deletion now cleans up state, and upgraded instances update in place. Tests added.
2026-08-25 15:15:46 +08:00
buua436
3a836911d1
fix: support hierarchical Wiki topic navigation ( #18721 )
2026-08-25 13:59:27 +08:00
Wang Qi
4c6f745c1e
Refactor: rename prefetch_size to rerank_candidates ( #18718 )
2026-08-25 11:35:53 +08:00
Wang Qi
5659476a30
Fix: correct rerank #17296 - add prefetch_size ( #18300 )
2026-08-24 16:09:07 +08:00
zws202606
d02723ca76
feat: Gaussdb adaptation ( #17703 )
2026-08-18 09:53:11 +08:00
Wang Qi
57b907cd1e
Refactor: do not include compliation chunks in retrieval testing ( #18364 )
...
Retrieval Testing: do not include compilation result.
Search: include compilation result.
2026-08-17 16:19:05 +08:00
qinling0210
554fb1133a
Search in navigation tree & store graph content in nav_doc ( #18303 )
...
### Summary
Search in navigation tree & store graph content in nav_doc during parse
2026-08-14 22:26:57 +08:00
buua436
024c35f085
fix: track wiki chunk changes incrementally ( #18285 )
2026-08-14 20:11:55 +08:00
buua436
15a63bc15c
fix: exclude disabled documents from wiki compilation ( #18261 )
2026-08-14 13:45:14 +08:00
qinling0210
a6dcc0f665
Add dataset navigation search for agentic RAG ( #18218 )
...
### Summary
Add dataset navigation search for agentic RAG.
dataset_navigation_search() calls
dataset_api_service.search_dataset_layers with mode as "nav_doc"
2026-08-13 17:35:24 +08:00
buua436
649b631cac
fix: improve incremental wiki compilation ( #18164 )
2026-08-12 19:12:39 +08:00
buua436
0cfd8f41e4
fix: improve incremental wiki compilation ( #18130 )
...
### What problem does this PR solve?
Incremental Wiki compilation could lose provenance for claim-light
entities, produce unstable page groups across embedding models, route
entities to unrelated pages, and assign topics without sufficient
page-level context. Document removals and page membership changes could
also leave stale Wiki state.
This PR:
- preserves source document and chunk provenance throughout entity
matching, reduction, page generation, and deletion;
- uses embeddings to retrieve candidates and the LLM to make final page
grouping and incremental routing decisions;
- batches embedding and LLM operations with bounded concurrency and
deterministic fallbacks;
- selects source-scoped topic candidates with embeddings before the page
LLM chooses the final topic;
- rebuilds Wiki state when the compilation mode or embedding model
changes;
- normalizes Wiki array fields returned by the API and retains entities
without relations in graph responses.
### Type of change
- [x] Bug Fix (non-breaking change which fixes an issue)
2026-08-11 20:13:04 +08:00
qinling0210
d49af7f218
Generate navigation, navigation search ( #18096 )
...
### Summary
2 API
POST /api/v1/datasets/{dataset_id}/navigation
GET
/api/v1/datasets/{dataset_id}/navigation/search?q={query}&mode={mode}&top_k={topk}
2 cli
uv run --no-sync python3 admin/client/ragflow_cli.py -h 127.0.0.1 -p
9380 -t user
ragflow> GENERATE NAVIGATION OF DATASET 'frames tree';
ragflow> NAVIGATION SEARCH 'Christie introduced blockchain-based digital
passports' IN DATASET 'frames tree' MODE 'all' topk 20;
(mode: chunk, nav_cluster, nav_doc, navigation_tree, all)
2026-08-11 17:48:24 +08:00
buua436
5fd66154f3
fix: improve structure keyword search ( #18055 )
2026-08-11 13:58:00 +08:00
Lynn
15ab2b3ee2
Fix: update tree when delete skill node ( #18063 )
2026-08-11 09:49:22 +08:00
buua436
6f50e478e0
fix: exclude disabled documents from dataset structures ( #18041 )
2026-08-10 17:50:34 +08:00
buua436
c0582b8e18
fix: handle disabled documents in dataset structures ( #18033 )
2026-08-10 13:52:49 +08:00
Lynn
7433fbb77b
Fix: exclude unauthorized memory/dataset from list results ( #18006 )
2026-08-10 10:16:56 +08:00
buua436
8379165c12
fix: record generated wiki page versions ( #17931 )
2026-08-06 16:49:50 +08:00
buua436
38435255f9
fix: filter wiki artifacts by keywords ( #17871 )
2026-08-05 19:40:27 +08:00
Lynn
02923bfc46
Fix: display embedding model name in list dataset api response ( #17832 )
2026-08-05 14:51:07 +08:00
Wang Qi
f707cca074
Fix: Let delete dataset/document to a dedicated thread to avoid blocking othe APIs ( #17800 )
2026-08-04 19:04:16 +08:00
buua436
4d997bc740
fix: allow team members to update shared datasets ( #17798 )
2026-08-04 17:24:23 +08:00
Wang Qi
7e67b71b81
Let DELETE /datasets to a dedicated thread to avoid blocking other APIs ( #17796 )
2026-08-04 16:19:56 +08:00
3b4a96d421
Refactor: refine wiki plan procedure. ( #17579 )
...
### Summary
Refine wiki plan procedure.
---------
Co-authored-by: Yingfeng Zhang <yingfeng.zhang@gmail.com >
Co-authored-by: buua436 <sz_buua@foxmail.com >
2026-08-03 16:03:17 +08:00
Wang Qi
0969c04eca
Feature: GET /datasets to support ids array ( #17606 )
2026-07-31 13:23:02 +08:00
Kevin Hu and Yingfeng Zhang
3f8a3dfcff
Feat: Compilation benefit naive rag. ( #17555 )
...
### Summary
Compilation benifit naive rag
---------
Co-authored-by: Yingfeng Zhang <yingfeng.zhang@gmail.com >
2026-07-30 18:39:01 +08:00
Kevin Hu
9bb037271e
Refact: Rename "artifact_" to "wiki_". ( #17553 )
2026-07-30 11:06:16 +08:00
Kevin Hu and Yingfeng Zhang
48a3280eac
Refactor: merge dataset scope graph. ( #17526 )
...
### Summary
merge dataset scope graph.
---------
Co-authored-by: Yingfeng Zhang <yingfeng.zhang@gmail.com >
2026-07-29 18:23:51 +08:00
Wang Qi
989529c00a
Fix filter dataset by owner_ids not working ( #17499 )
2026-07-29 11:48:40 +08:00
Jin Hai
7f21a7ba18
Go: add context, part14 ( #17446 )
...
Signed-off-by: Jin Hai <haijin.chn@gmail.com >
2026-07-28 19:05:59 +08:00
buua436
b7ddf45774
fix: stabilize wiki planning and artifact graph rendering ( #17473 )
2026-07-28 17:08:40 +08:00