youngkingdom/ragflow
1
0
Fork 0
mirror of https://github.com/infiniflow/ragflow.git synced 2026-06-08 08:07:21 +08:00
Code Issues Packages Projects Releases Wiki Activity
6,401 Commits 3 Branches 48 Tags
5ae41dc1ebebcaad8daf40982d626dbdf73282fe
Commit Graph

99 Commits

Author SHA1 Message Date
Liu An
0639dba89a Docs: Update version references to v0.25.6 in READMEs and docs (#15248) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.25.5 to v0.25.6
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2026-05-26 19:45:43 +08:00
writinwaters
bf9297a343 Docs: Added a guide on integrating Discord. (#15156) 
### What problem does this PR solve?

How to ingest messages from your Discord server.

### Type of change

- [x] Documentation Update
 2026-05-22 17:49:18 +08:00
Jin Hai
90c76e73d0 Docs: Update version references to v0.25.5 in READMEs and docs (#15059) 
Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2026-05-20 20:05:45 +08:00
Liu An
f038a34154 Docs: Update version references to v0.25.4 in READMEs and docs (#14912) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.25.3 to v0.25.4
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2026-05-14 11:07:08 +08:00
Liu An
3182fd0789 Docs: Update version references to v0.25.3 in READMEs and docs (#14896) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.25.2 to v0.25.3
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2026-05-13 18:42:42 +08:00
writinwaters
5e46457c28 Docs: How to add Bitbucket as data source. (#14846) 
### What problem does this PR solve?

Added a guide on integrating Bitbucket as an external data source.

### Type of change

- [x] Documentation Update
 2026-05-12 20:48:30 +08:00
Liu An
57b24be6d6 Docs: Update version references to v0.25.2 in READMEs and docs (#14731) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.25.1 to v0.25.2
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2026-05-09 19:06:05 +08:00
Liu An
ce4c782fd7 Docs: Update version references to v0.25.1 in READMEs and docs (#14488) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.25.0 to v0.25.1
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2026-04-30 10:49:26 +08:00
wdeveloper16
78188ce9e9 Feat: add OpenDataLoader PDF parser backend (#14058) (#14097) 
### What problem does this PR solve?

Closes #14058.

RAGFlow supports multiple PDF parsing backends (DeepDOC, MinerU,
Docling, TCADP, PaddleOCR). This PR adds **OpenDataLoader**
([opendataloader-project/opendataloader-pdf](https://github.com/opendataloader-project/opendataloader-pdf))
as a new optional backend, giving users a deterministic, local-first
alternative with competitive table extraction accuracy.

### Type of change

- [x] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update

---

### Changes

#### Backend
- `deepdoc/parser/opendataloader_parser.py` — new `OpenDataLoaderParser`
class inheriting `RAGFlowPdfParser`. Implements `check_installation()`
(guards Python package + Java 11+ runtime), `parse_pdf()` with
JSON-first extraction (heading/paragraph/table/list/image/formula) and
Markdown fallback, position-tag generation compatible with the shared
`@@page\tx0\tx1\ty0\ty1##` format, and temp-dir lifecycle with cleanup.
- `rag/app/naive.py` — new `by_opendataloader()` wrapper, registered in
`PARSERS` dict, added to `chunk_token_num=0` override list.
- `rag/flow/parser/parser.py` — `"opendataloader"` branch in the
pipeline PDF handler + check validation list.

#### Infrastructure
- `docker/entrypoint.sh` — `ensure_opendataloader()` function: opt-in
via `USE_OPENDATALOADER=true`, skips gracefully if Java is not on PATH.

#### Frontend
- `web/src/components/layout-recognize-form-field.tsx` —
`OpenDataLoader` added to `ParseDocumentType` enum and parser dropdown.
Cascades automatically to the pipeline editor's Parser component.

#### Docs
- `docs/guides/dataset/select_pdf_parser.md` — added OpenDataLoader
entry and full env-var reference.

---

### Environment variables

| Variable | Default | Description |
|---|---|---|
| `USE_OPENDATALOADER` | `false` | Set `true` to install
`opendataloader-pdf` on container startup |
| `OPENDATALOADER_VERSION` | latest | Pin the PyPI release (e.g.
`==2.2.1`) |
| `OPENDATALOADER_HYBRID` | _(unset)_ | Enable hybrid AI mode (e.g.
`docling-fast`) |
| `OPENDATALOADER_IMAGE_OUTPUT` | _(unset)_ | `off` / `embedded` /
`external` |
| `OPENDATALOADER_OUTPUT_DIR` | _(tmp)_ | Persistent output dir; temp
dir used + cleaned if unset |
| `OPENDATALOADER_DELETE_OUTPUT` | `1` | `0` to retain intermediate
files for debugging |
| `OPENDATALOADER_SANITIZE` | _(unset)_ | `1` to filter prompt-injection
patterns from output |

---

### Dependencies

- **Runtime**: `opendataloader-pdf` (PyPI, Apache 2.0) — opt-in, not
added to `pyproject.toml` core deps. Installed by
`ensure_opendataloader()` at container startup when
`USE_OPENDATALOADER=true`.
- **System**: Java 11+ on PATH (JVM is the underlying engine). The
installer skips with a warning if `java` is not found.

---

### How to test

**Standalone parser:**
```bash
source .venv/bin/activate
uv pip install opendataloader-pdf
python3 -c "
import sys; sys.path.insert(0, '.')
from deepdoc.parser.opendataloader_parser import OpenDataLoaderParser
p = OpenDataLoaderParser()
print('available:', p.check_installation())
s, t = p.parse_pdf('path/to/test.pdf', parse_method='pipeline')
print(f'sections={len(s)} tables={len(t)}')
"

```
### Benchmark vs Docling
```
file                      parser            secs  sections  tables
----------------------------------------------------------------------
text-heavy.pdf            docling           45.29       148      10
text-heavy.pdf            opendataloader     3.14       559       0
table-heavy.pdf           docling           7.05        76       3
table-heavy.pdf           opendataloader     3.71        90       0
complex.pdf               docling            42.67       114       8
complex.pdf               opendataloader     3.51       180       0
```
 2026-04-25 00:33:02 +08:00
Wang Qi
01753b8f31 Refactor: API connectors (#14228) 
### What problem does this PR solve?

Refactor /api/v1/connectors to be more RESTful.

### Type of change
- [x] Refactoring
 2026-04-22 20:42:41 +08:00
Liu An
a33d0737cd Docs: Update version references to v0.25.0 in READMEs and docs (#14257) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.24.0 to v0.25.0
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2026-04-21 17:26:50 +08:00
writinwaters
8a874c7a09 Doc: Added Ingetrating Notion connector (#14163) 
### What problem does this PR solve?

Added How to integrate Notion to RAGFlow.

### Type of change

- [x] Documentation Update
 2026-04-16 20:06:02 +08:00
writinwaters
2520065c5a Doc: Added Integrate Confluence (#14131) 
### What problem does this PR solve?

Added a guide on integrating Confluence as connector.

### Type of change

- [x] Documentation Update
 2026-04-15 18:38:36 +08:00
writinwaters
52442c8eb5 Docs: Added a guide on adding Github repo as data source (#14048) 
### What problem does this PR solve?

Added a guide on adding Github repo as data source

### Type of change


- [x] Documentation Update
 2026-04-10 21:32:26 +08:00
auyua9
fa08fa2a17 docs: fix broken internal links in guides (#13935) 
### What problem does this PR solve?

This fixes two broken internal documentation links in the guides:

- `docs/develop/mcp/launch_mcp_server.md` linked
`./acquire_ragflow_api_key.md`, but the target page lives one level up
as `../acquire_ragflow_api_key.md`.
- `docs/guides/dataset/run_retrieval_test.md` linked
`./construct_knowledge_graph.md`, but the actual page lives under
`./advanced/construct_knowledge_graph.md`.

These broken links make it harder to follow the MCP and retrieval-test
docs from the local docs tree.

### Type of change

- [ ] Bug Fix (non-breaking change which fixes an issue)
- [ ] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update
- [ ] Refactoring
- [ ] Performance Improvement
- [ ] Other (please describe):
 2026-04-07 14:01:12 +08:00
writinwaters
bbd0cd80e4 Docs: Updated Add Google Drive as data source (#13684) 
### What problem does this PR solve?

Gave an editorial pass to the Add Google Drive document.

### Type of change

- [x] Documentation Update
 2026-03-18 21:05:25 +08:00
Yingfeng
b686a60713 Switch from demo.ragflow.io to cloud.ragflow.io (#13624) 
### What problem does this PR solve?

Switch from demo.ragflow.io to cloud.ragflow.io

### Type of change

- [x] Documentation Update
 2026-03-16 14:44:39 +08:00
NeedmeFordev
387b0b27c4 feat(parser): support external Docling server via DOCLING_SERVER_URL (#13527) 
### What problem does this PR solve?

This PR adds support for parsing PDFs through an external Docling
server, so RAGFlow can connect to remote `docling serve` deployments
instead of relying only on local in-process Docling.

It addresses the feature request in
[#13426](https://github.com/infiniflow/ragflow/issues/13426) and aligns
with the external-server usage pattern already used by MinerU.

### Type of change

- [ ] Bug Fix (non-breaking change which fixes an issue)
- [x] New Feature (non-breaking change which adds functionality)
- [x] Documentation Update
- [ ] Refactoring
- [ ] Performance Improvement
- [ ] Other (please describe):

### What is changed?

- Add external Docling server support in `DoclingParser`:
  - Use `DOCLING_SERVER_URL` to enable remote parsing mode.
- Try `POST /v1/convert/source` first, and fallback to
`/v1alpha/convert/source`.
- Keep existing local Docling behavior when `DOCLING_SERVER_URL` is not
set.
- Wire Docling env settings into parser invocation paths:
  - `rag/app/naive.py`
  - `rag/flow/parser/parser.py`
- Add Docling env hints in constants and update docs:
  - `docs/guides/dataset/select_pdf_parser.md`
  - `docs/guides/agent/agent_component_reference/parser.md`
  - `docs/faq.mdx`

### Why this approach?

This keeps the change focused on one issue and one capability (external
Docling connectivity), without introducing unrelated provider-model
plumbing.

### Validation

- Static checks:
  - `python -m py_compile` on changed Python files
  - `python -m ruff check` on changed Python files
- Functional checks:
  - Remote v1 endpoint path works
  - v1alpha fallback works
  - Local Docling path remains available when server URL is unset

### Related links

- Feature request: [Support external Docling server (issue
#13426)](https://github.com/infiniflow/ragflow/issues/13426)
- Compare view for this branch:
[main...feat/docling-server](https://github.com/infiniflow/ragflow/compare/main...spider-yamet:ragflow:feat/docling-server?expand=1)

##### Fixes [#13426](https://github.com/infiniflow/ragflow/issues/13426)
 2026-03-12 17:09:03 +08:00
writinwaters
9deb3a6249 Refact: Fine tweaks to the doc structure. (#13379) 
### What problem does this PR solve?

Fine tweaks to the doc structure.

### Type of change


- [x] Documentation Update
 2026-03-04 21:30:28 +08:00
Liu An
392ec99651 Docs: Update version references to v0.24.0 in READMEs and docs (#13095) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.23.1 to v0.24.0
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2026-02-10 17:24:03 +08:00
writinwaters
4341d81e29 Refact: Updated UI tips. (#13093) 
### What problem does this PR solve?

Updated UI tips.

### Type of change


- [x] Refactoring
 2026-02-10 16:25:56 +08:00
writinwaters
9c39ac11c6 Docs: Replaced TOC Enhance with Page Index. (#13075) 
### What problem does this PR solve?

Replaced TOC Enhance with Page Index.

### Type of change

- [x] Documentation Update
 2026-02-09 20:13:34 +08:00
Jimmy Ben Klieve
867ec94258 revert white-space changes in docs (#12557) 
### What problem does this PR solve?

Trailing white-spaces in commit 6814ace1aa
got automatically trimmed by code editor may causes documentation
typesetting broken.

Mostly for double spaces for soft line breaks.  

### Type of change

- [x] Documentation Update
 2026-01-13 09:41:02 +08:00
Jimmy Ben Klieve
6814ace1aa docs: update docs icons (#12465) 
### What problem does this PR solve?

Update icons for docs.
Trailing spaces are auto truncated by the editor, does not affect real
content.

### Type of change

- [x] Documentation Update
 2026-01-07 10:00:09 +08:00
Liu An
07ef35b7e6 Docs: Update version references to v0.23.1 in READMEs and docs (#12349) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.23.0 to v0.23.1
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2025-12-31 12:49:42 +08:00
Jin Hai
86b03f399a Fix error in docs (#12269) 
### What problem does this PR solve?

As title

### Type of change

- [x] Bug Fix (non-breaking change which fixes an issue)

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2025-12-28 11:55:52 +08:00
Liu An
8dc5b4dc56 Docs: Update version references to v0.23.0 in READMEs and docs (#12253) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.22.1 to v0.23.0
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update

Co-authored-by: Jin Hai <haijin.chn@gmail.com>
 2025-12-27 20:44:35 +08:00
writinwaters
c2e9064474 Docs: v0.23.0 release notes (#12251) 
### What problem does this PR solve?


### Type of change


- [x] Documentation Update

---------

Co-authored-by: Yingfeng Zhang <yingfeng.zhang@gmail.com>
 2025-12-26 19:11:10 +08:00
writinwaters
8683a5b1b7 Docs: How to call MinerU as a remote service (#12004) 
### Type of change

- [x] Documentation Update
 2025-12-19 17:06:32 +08:00
Jin Hai
ef44979b5c Fix table format warning in Markdown file (#12002) 
### What problem does this PR solve?

As title

### Type of change

- [x] Documentation Update
- [x] Refactoring

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2025-12-17 19:27:47 +08:00
Yongteng Lei
03f9be7cbb Refa: only support MinerU-API now (#11977) 
### What problem does this PR solve?

Only support MinerU-API now, still need to complete frontend for
pipeline to allow the configuration of MinerU options.

### Type of change

- [x] Refactoring
 2025-12-17 12:58:48 +08:00
Jin Hai
a7d40e9132 Update since 'File manager' is renamed to 'File' (#11698) 
### What problem does this PR solve?

Update some docs and comments, since 'File manager' is rename to 'File'

### Type of change

- [x] Documentation Update
- [x] Refactoring

---------

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
Co-authored-by: writinwaters <93570324+writinwaters@users.noreply.github.com>
 2025-12-03 18:32:15 +08:00
writinwaters
7c3c185038 Minor style changes (#11554) 
### What problem does this PR solve?

### Type of change


- [ ] Documentation Update
 2025-11-27 09:42:06 +08:00
Jin Hai
1cb6b7f5dd Update version info to v0.22.1 (#11346) 
### What problem does this PR solve?

As title

### Type of change

- [x] Other (please describe): Update version info

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2025-11-19 09:50:23 +08:00
writinwaters
63131ec9b2 Docs: default admin credentials (#11260) 
### What problem does this PR solve?

### Type of change

- [x] Documentation Update
 2025-11-14 09:35:56 +08:00
Liu An
a36a0fe71c Docs: Update version references to v0.22.0 in READMEs and docs (#11211) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.21.1 to v0.22.0
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2025-11-12 14:54:28 +08:00
Jin Hai
8406a5ea47 Fix typos (#11208) 
### What problem does this PR solve?

As title

### Type of change

- [x] Documentation Update

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2025-11-12 14:20:04 +08:00
Jin Hai
20b6dafbd8 Update docs (#11204) 
### What problem does this PR solve?

as title

### Type of change

- [x] Documentation Update

Signed-off-by: Jin Hai <haijin.chn@gmail.com>
 2025-11-12 14:01:47 +08:00
writinwaters
2c727a4a9c Docs: parser behavior change (#11176) 
### What problem does this PR solve?


### Type of change


- [x] Documentation Update
 2025-11-11 21:10:06 +08:00
Carlo
685311814f description (#10928) 
### Type of change

- [x] Documentation Update
 2025-11-03 09:50:21 +08:00
writinwaters
de24e74b4c Docs: How to use MinerU to parse pdf documents (#10763) 
### What problem does this PR solve?



### Type of change

- [x] Documentation Update
 2025-10-23 18:56:09 +08:00
Liu An
83e80e3d7f Docs: Update version references to v0.21.1 in READMEs and docs (#10761) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.21.0 to v0.21.1
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2025-10-23 18:55:41 +08:00
writinwaters
c9e56d20cf Doc: miscellaneous (#10641) 
### What problem does this PR solve?

### Type of change

- [x] Documentation Update
 2025-10-17 18:47:09 +08:00
writinwaters
74c195cd36 Doc: Added Long context RAG guide (#10591) 
### What problem does this PR solve?

### Type of change


- [x] Documentation Update
 2025-10-15 21:00:19 +08:00
writinwaters
205a5eb9f5 Docs: Updated dataset configuration, KG building and RAPTOR building for v0.21.0 (#10584) 
### What problem does this PR solve?



### Type of change


- [x] Documentation Update
 2025-10-15 16:39:26 +08:00
Liu An
3ae126836a Docs: Update version references to v0.21.0 in READMEs and docs (#10565) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.20.5 to v0.21.0
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2025-10-15 11:46:24 +08:00
writinwaters
ff4239c7cf Docs: Updated descriptions on metadata filtering (#10518) 
### What problem does this PR solve?

### Type of change

- [x] Documentation Update
 2025-10-13 17:33:04 +08:00
writinwaters
4058715df7 Docs: Knowledge base renamed to dataset. (#10269) 
### What problem does this PR solve?

### Type of change

- [x] Documentation Update
 2025-09-25 09:45:27 +08:00
Liu An
067b4fc012 Docs: Update version references to v0.20.5 in READMEs and docs (#10015) 
### What problem does this PR solve?

- Update version tags in README files (including translations) from
v0.20.4 to v0.20.5
- Modify Docker image references and documentation to reflect new
version
- Update version badges and image descriptions
- Maintain consistency across all language variants of README files

### Type of change

- [x] Documentation Update
 2025-09-10 11:20:43 +08:00
writinwaters
7eb25e0de6 UI updates (#9836) 
### What problem does this PR solve?

### Type of change


- [x] Documentation Update
 2025-08-30 21:44:58 +08:00