Commit Graph
57 Commits
Author SHA1 Message Date
xugangqiang ed7510638e Revert "Provision native libs from versioned user cache (offline CI, drop /opt pre-bake)" (#22097)
Reverts infiniflow/ragflow#22023
2026-11-06 16:33:19 +08:00
xugangqiang d6dbfd97d4 Provision native libs from versioned user cache (offline CI, drop /opt pre-bake) (#22023) 2026-11-06 14:48:00 +08:00
Wang Qi a26066c879 Refactor: refine response data (#21858) 2026-11-03 14:10:05 +08:00
Sanderhoff-alt 819751a915 fix(build): adjust onnxruntime static link flags on Darwin arm64 (#21162)
Closes #21160
2026-11-02 17:15:24 +08:00
jay77721 aaa8e05354 feat(parser): hand off Office images as media refs (#21700) 2026-10-30 16:48:51 +08:00
jay77721 9ba49c523e feat(media): harden run media cache lifecycle and limits (#21694) 2026-10-30 12:41:23 +08:00
jay77721 d697b0410a feat(parser): add media references for on-demand image materialization (#21561) 2026-10-28 19:47:53 +08:00
Wang Qi d717d0c975 Refactor: delete agent browser (#21599) 2026-10-28 15:44:29 +08:00
xugangqiang 6a2ef7ec6b refactor(deps): rename ragflow_deps directory to deps (#21345)
## Summary

Rename the repository dependency-resource directory `ragflow_deps/` to
`deps/`, and update every hardcoded reference to that directory name so
the rename does not break resource loading at build/runtime.

This is not a purely cosmetic rename: the Go runtime hardcodes the
directory name as a resource search path (e.g.
`internal/common/model_assets.go` trimming the `deps/` prefix, and the
tokenizers joining `deps/` into candidate paths), and the Dockerfiles
copy assets into `/ragflow/deps`. Those literals must move together with
the directory, otherwise assets fail to resolve.

## Two intentional exceptions (kept unchanged)

The rename deliberately keeps two names that only *coincidentally*
contained the old string:

- The published image tag `infiniflow/ragflow_deps:latest` (used by
`Dockerfile`, `Dockerfile_base`, docs, and CI `image inspect` checks).
- The CI install path `/opt/ragflow_deps` inside the CI runner image
(`build.sh` `SYSTEM_DEPS_TOKENIZER`).

## Changes

- `git mv ragflow_deps deps`.
- `build.sh`: `CL100K_TABLE_RELPATH`, native asset zip path, and related
references updated to `deps/`.
- `tools/scripts/download_dev_deps.py`: `RAGFLOW_DEPS_DIR` points at
`deps/`.
- Go runtime resource search paths (`internal/common`,
`internal/tokenizer`) updated to the `deps/` layout.
- `Dockerfile` / `Dockerfile_base`: container asset path changed to
`/ragflow/deps`; kept tag `infiniflow/ragflow_deps:latest` unchanged.
- Docs / `AGENTS.md` / CI workflow paths updated to the new directory
name.

## Test plan

- Go unit tests in `internal/common` and `internal/tokenizer` updated to
the new `deps/` layout and pass via `bash build.sh --test`.
- Python download scripts import and build URLs correctly (`py_compile`
clean).
- Added `tools/scripts/test_dep_rename_invariants.py` as a regression
guard asserting the two intentional exceptions (`/opt/ragflow_deps` and
`infiniflow/ragflow_deps`) stay intact, so a future blanket rename
cannot silently regress them.

---

## Follow-up fix (commit 2f6857095d)

The original rename used a blanket `sed s/ragflow_deps/deps/g` and only
selectively reverted `build.sh`. That left two intentionally-kept names
rewritten, which this follow-up restores:

- CI install path `/opt/ragflow_deps` — `sep-tests.yml` had been changed
to read `/opt/deps`, breaking the offline cl100k table fallback (the
cached-image path pointed at a directory that never receives the file).
Restored to `/opt/ragflow_deps`.
- Published image tag `infiniflow/ragflow_deps` — left as bare
`infiniflow/deps` in `sep-tests.yml` comments/echo, `.dockerignore`, and
`Dockerfile` / `Dockerfile_base` error messages. Restored to
`infiniflow/ragflow_deps`.

The regression guard `tools/scripts/test_dep_rename_invariants.py` was
added to prevent recurrence.
2026-10-22 19:20:42 +08:00
xugangqiang b44e852e6b Build: add multi-platform native build support (linux/arm64, darwin) (#19247) 2026-10-16 14:26:31 +08:00
xugangqiang c754300366 refactor(deps): split dependency download into two Python scripts (#20861) 2026-10-13 20:44:56 +08:00
Sourav Rajvi 68752fcddd feat(parser): support MinerU 4.0 V1 HTTP API (#20712)
Fixes infiniflow/ragflow#20365
2026-10-12 19:08:45 +08:00
Jin Hai a093968c46 doc: update development.md (#20799)
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-10-12 11:23:24 +08:00
xugangqiang d05e8c317f docs: mark macOS as temporarily unsupported for the Go backend (#20642) 2026-10-09 12:53:04 +08:00
jay77721 4071451ea4 refactor(deps): use Go dependency downloader as sole entrypoint (#20360) 2026-09-30 18:02:03 +08:00
Jin Hai 60016b39c9 refactor: move res into internal (#20390)
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-09-30 10:49:17 +08:00
YanZhang 01f6b9c3bc docs:update Docker commands in deployment guides (#20353) 2026-09-29 15:29:42 +08:00
Wang Qi 1be9590a4a Docs: v0.27.2 -> v1.0.0-rc1 (#20338) 2026-09-29 13:20:25 +08:00
Jin Hai 7c102247c6 refactor: update go verion server port to 9380 and 9381 (#20298)
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-09-28 17:35:16 +08:00
xugangqiang 3a23ba00a5 feat(deepdoc): share ONNX model weights across pooled native sessions (#20035) 2026-09-22 20:12:38 +08:00
qinling0210 25a7c14e4f fix(tag): rebuild tagging on a Go tag source index (#19985)
### Summary

rebuild tagging on a Go tag source index

```
The following endpoints are removed in GO because there is no tag datatset inGO.
GET	/api/v1/datasets/:dataset_id/tags 
PUT	/api/v1/datasets/:dataset_id/tags 
DELETE	/api/v1/datasets/:dataset_id/tags 
```
2026-09-21 19:23:29 +08:00
xugangqiang 7aa012fc5c refactor(go): default Go cache/queue backend to Kvrocks and fail fast when down (#19804) 2026-09-18 19:16:07 +08:00
adws f69e33559c docs: run migrations before starting Go servers (#19776) 2026-09-17 15:01:57 +08:00
Lynn 81a5fdd56e Feat: migrate chat message and reference (#19724) 2026-09-17 09:36:36 +08:00
Lynn e8fcc7b153 Fix(go): migration cleanup and add DB version tracking (#19598) 2026-09-15 19:09:00 +08:00
qinling0210 aa78e8d224 Remove internal cli 'insert chunks from file' and 'insert metadata from file' (#19591) 2026-09-14 14:23:04 +08:00
xugangqiangandmaoyifeng 2e6003cfd4 Unify ONNX Runtime native to 1.29.0 from infiniflow/ragflow-build (#19446)
Switch Go DeepDoc's static ONNX Runtime to our own infiniflow/ragflow-build release (v1.29.0) instead of third-party. Keeps fused kernels; normalizes dir naming; added ORT version consistency check.

---------

Co-authored-by: maoyifeng <myfbee5@163.com>
2026-09-11 12:12:34 +08:00
Jin Hai d5a89c324c Go: update build.sh and development.md (#19448)
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-09-09 21:03:48 +08:00
xugangqiang 8c8253a3be chore(deps): let download_go_deps.py fetch Go DeepDoc .ort weights (#19376)
Go DeepDoc now uses .ort weights downloaded via download_go_deps.py — no MODEL_DIR needed from repo root. Script fetches 5 model files into rag/res/deepdoc/; supports mirrors; CI updated. .onnx path unchanged.
2026-09-09 16:07:43 +08:00
xugangqiang f1c42e85e3 build: use a stable dynamic-list path for OrtGetApiBase export (#19302) 2026-09-08 10:47:18 +08:00
xugangqiang aaed9fd40e Perf: link onnxruntime without --whole-archive to cut binary size (#19277) 2026-09-07 10:01:36 +08:00
xugangqiang 4298700cb2 chore(deps): depend on org mirror infiniflow/onnxruntime_go (#19169) 2026-09-04 15:26:46 +08:00
xugangqiang 0d1338d63e fix(deepdoc): harden ORT build guard, OCR test contract (#19082) 2026-09-02 12:13:19 +08:00
Jin Hai ae8cfd4d1e Go: fix heartbeat log (#17899)
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-08-05 22:05:07 +08:00
Jin Hai 0b01171a86 Go: Update response message (#16803)
### Summary

As title.

---------

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-07-10 14:26:54 +08:00
Lynn 1430d0e431 Fix: provider name (#16733) 2026-07-09 10:19:10 +08:00
Jin Hai 9eba45249c Go: fix development guide (#16678)
### Summary

Go development guide

---------

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-07-07 15:09:39 +08:00
Wang Qi 06aa169df7 Update development script (#16623) 2026-07-03 20:34:30 +08:00
Jin Hai 1880e65e99 Go: refactor (#16602)
### Summary

1. update doc
2. refactor route code

---------

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-07-03 17:00:43 +08:00
Jin Hai 7d64a78f83 Go: unify three services into one binary (#16462)
### Summary

Plan to start api_server, admin_server and ingestor in one binary:
- ./ragflow_main --admin
- ./ragflow_main --api
- ./ragflow_main --ingestor

---------

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-07-02 21:21:10 +08:00
Jack 7ae18a45ee Fix: correct download_deps.py path in error messages and add native libs doc (#16557)
## Summary

Fix error messages in `build.sh` and add documentation in
`internal/development.md` for downloading native static libraries
(pdfium, pdf_oxide, office_oxide).

## Changes

- `build.sh`: change error hint from `uv run download_deps.py` to `uv
run ragflow_deps/download_deps.py` (correct path from project root)
- `internal/development.md`: add section 2.1 documenting how to download
native libs and install lld
2026-07-02 18:41:39 +08:00
JackandClaude 42a0faad18 Fix: use .a to replace .so for pdfium/pdf_oxide/office_oxide (#16496)
### Summary

Use .a to replace .so for pdfium/pdf_oxide/office_oxide

---------

Co-authored-by: Claude <noreply@anthropic.com>
2026-07-01 21:21:31 +08:00
qinling0210 7862f69f39 Implement chat completions in go (#16491)
### Summary

POST   /api/v1/chat/completions
2026-07-01 15:52:52 +08:00
Jin Hai d4ef3d21d1 Go CLI: Add create and drop commands (#16430)
### What problem does this PR solve?

1. Add CREATE and DROP DATASET / MEMORY / AGENT / SEARCH / CHAT.
2. Add option to build.sh to strip RAGFlow binary.

### Type of change

- [x] Refactoring

---------

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-06-29 11:13:14 +08:00
Jin Hai 49714865c1 Go: rename ragflow_cli to ragflow-cli (#16270)
### What problem does this PR solve?

rename ragflow cli binary

### Type of change

- [x] Refactoring

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-06-23 19:20:49 +08:00
Haruko386 d89e29fba8 Document[Go-develop]: update Go development docs (#16229)
### What problem does this PR solve?

Document updated:

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
2026-06-23 19:19:44 +08:00
Haruko386 02cc1d6438 fix: unable to chat after set model (#16195)
### What problem does this PR solve?

```
fixed:

RAGFlow(api/default)> use model 'minimax-m2.5@test@minimax'
SUCCESS

RAGFlow(api/default)> chat message 'who r u'
Answer: Hey! I'm MiniMax-M2.5, an AI assistant here to help you with questions, tasks, or whatever you need. What can I do for you?
Time: 1.727263

```

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
2026-06-22 18:14:58 +08:00
qinling0210 563d855780 Implement OpenAI chat completions in GO (#16177)
### What problem does this PR solve?

Implement OpenAI chat completions in GO

POST /api/v1/openai/<chat_id>/chat/completions

OpenAI chat cli: internal/development.md

### Type of change

- [x] Refactoring
2026-06-18 18:07:27 +08:00
Jin Hai 234f1b7cff Go: add office_oxide and parse docx file. (#15976)
### What problem does this PR solve?

As title.

### Type of change

- [x] New Feature (non-breaking change which adds functionality)

---------

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
2026-06-12 20:28:15 +08:00
Haruko386 547139da29 fix(Go-models): preserve model name lookup when aliases exist (#15969)
### What problem does this PR solve?

As title

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)
- [x] Documentation Update
2026-06-12 19:15:28 +08:00