d4ee915058
Merge branch 'feat/queue-based-graph-engine' into feat/rag-2
2025-09-04 20:51:48 +08:00
81e9d6f63a
fix: correct type checking for None values in code node output validation
...
- Fixed isinstance() checks to properly handle None values by checking None separately
- Fixed typo in STRING type validation where 'output_name' was hardcoded as string instead of variable
- Updated error message format to be consistent and more informative
- Updated test assertion to match new error message format
2025-09-04 20:39:37 +08:00
b9394d542c
Merge branch 'feat/queue-based-graph-engine' into feat/rag-2
...
# Conflicts:
# api/core/app/apps/advanced_chat/generate_task_pipeline.py
# api/pyproject.toml
# api/uv.lock
# docker/docker-compose-template.yaml
# docker/docker-compose.yaml
# web/package.json
2025-09-04 20:30:08 +08:00
9c2943183e
test: fix code node
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 20:17:28 +08:00
f6a2a09815
test: fix code node
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 20:04:29 +08:00
e229510e73
perf: eliminate lock contention in worker pool by removing callbacks
...
Remove worker idle/active callbacks that caused severe lock contention.
Instead, use sampling-based monitoring where worker states are queried
on-demand during scaling decisions. This eliminates the performance
bottleneck caused by workers acquiring locks 10+ times per second.
Changes:
- Remove callback parameters from Worker class
- Add properties to expose worker idle state directly
- Update WorkerPool to query worker states without callbacks
- Maintain scaling functionality with better performance
2025-09-04 19:37:31 +08:00
36048d1526
feat(graph_engine): allow to scale down without lock
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 19:32:07 +08:00
aff7ca12b8
fix(code_node): type checking bypass
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 19:25:08 +08:00
ad9eed2551
fix: disable scale for perfermance
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 19:11:22 +08:00
2aeaefccec
test: fix test
2025-09-04 17:47:36 +08:00
4d63bd2083
refactor(graph_engine): rename SimpleWorkerPool to WorkerPool
2025-09-04 17:47:13 +08:00
226f14a20f
feat(graph_engine): implement scale down worker
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 15:35:20 +08:00
2b28aed4e2
[autofix.ci] apply automated fixes
2025-09-04 04:50:21 +00:00
ead8568bfc
fix: some errors reported by basedpyright
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 11:58:54 +08:00
647af6fc69
fix file name
2025-09-04 10:36:44 +08:00
04bbf540d9
chore: code format
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 02:33:53 +08:00
657c27ec75
feat(graph_engine): make runtime state read-only in layer
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 02:30:40 +08:00
16e9cd5ac5
feat(graph_runtime_state): prevent to set variable pool after initialized.
2025-09-04 02:20:19 +08:00
8332472944
refactor(graph_engine): rename Layer to GraphEngineLayer
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-04 02:11:31 +08:00
fe3f03e50a
feat: add property-based access control to GraphRuntimeState
...
- Replace direct field access with private attributes and property decorators
- Implement deep copy protection for mutable objects (dict, LLMUsage)
- Add helper methods: set_output(), get_output(), update_outputs()
- Add increment_node_run_steps() and add_tokens() convenience methods
- Update loop_node and event_handlers to use new accessor methods
- Add comprehensive unit tests for immutability and validation
- Ensure backward compatibility with existing property access patterns
2025-09-04 02:08:58 +08:00
e3092837e4
fix file name
2025-09-03 21:26:28 +08:00
49d268d4a3
fix preview and recommend plugins
2025-09-03 19:20:14 +08:00
aa670c8982
fix(datasource): add datasource icon in tracing panel
2025-09-03 18:23:23 +08:00
fd3b55cc16
fix preview and recommend plugins
2025-09-03 18:09:56 +08:00
d4aed3df5c
Merge branch 'feat/queue-based-graph-engine' into feat/rag-2
...
# Conflicts:
# api/core/memory/token_buffer_memory.py
# api/core/rag/extractor/notion_extractor.py
# api/core/repositories/sqlalchemy_workflow_node_execution_repository.py
# api/core/variables/variables.py
# api/core/workflow/graph/graph.py
# api/core/workflow/graph_engine/entities/event.py
# api/services/dataset_service.py
# web/app/components/app-sidebar/index.tsx
# web/app/components/base/tag-management/selector.tsx
# web/app/components/base/toast/index.tsx
# web/app/components/datasets/create/website/index.tsx
# web/app/components/datasets/create/website/jina-reader/base/options-wrap.tsx
# web/app/components/workflow/header/version-history-button.tsx
# web/app/components/workflow/hooks/use-inspect-vars-crud-common.ts
# web/app/components/workflow/hooks/use-workflow-interactions.ts
# web/app/components/workflow/panel/version-history-panel/index.tsx
# web/service/base.ts
2025-09-03 15:01:06 +08:00
f6acff4cce
chore: remove unused variables
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-03 12:12:27 +08:00
b81745aed8
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-03 11:56:05 +08:00
9d5956cef8
[Chore/Refactor] Switch from MyPy to Basedpyright for type checking ( #25047 )
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-03 11:52:26 +08:00
77a9a73d0d
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-03 01:33:17 +08:00
7ace7e65e1
fix preview and recommend plugins
2025-09-02 16:44:18 +08:00
7b379e2a61
chore: apply ty checks on api code with script and ci action ( #24653 )
2025-09-02 16:05:13 +08:00
1770b93e5b
chore(graph_engine): Add a TODO commment in _update_response_outputs in event_handlers
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-02 15:20:03 +08:00
d8ff4aa9ba
feat(graph_engine): Handle NodeRunAgentLogEvent
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-02 15:02:07 +08:00
9f8f21bf87
chore: remove backup files
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-02 15:01:58 +08:00
a32dde5428
Fix: Resolve workflow_node_execution primary key conflicts with UUID v7 ( #24643 )
...
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-02 14:18:29 +08:00
56fc9088dd
add recommended rag plugin endpoint
2025-09-02 11:56:05 +08:00
0b0dc63f29
Merge remote-tracking branch 'origin/main' into feat/queue-based-graph-engine
2025-09-02 11:52:25 +08:00
be3af1e234
Migrate SQLAlchemy from 1.x to 2.0 with automated and manual adjustments ( #23224 )
...
Co-authored-by: Yongtao Huang <99629139+hyongtao-db@users.noreply.github.com >
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
2025-09-02 10:30:19 +08:00
826b9d5b21
add recommended rag plugin endpoint
2025-09-01 20:41:14 +08:00
633de2cb47
add recommended rag plugin endpoint
2025-09-01 20:12:27 +08:00
89ec13ec67
fix(api): fix ToolNode._extract_variable_selector_to_variable_mapping
...
The original selector syntax does not match our current implementation
for injecting user inputs into VariablePool.
2025-09-01 18:11:33 +08:00
5b3cc560d5
fix:hard-coded top-k fallback issue. ( #24879 )
2025-09-01 15:46:37 +08:00
e2ae89e08d
fix(tests): fix broken tests and linter issues
2025-09-01 14:55:35 +08:00
ffba341258
[CHORE]: remove redundant-cast ( #24807 )
2025-09-01 14:05:32 +08:00
8433cf4437
refactor(graph_engine): Merge event_collector and event_emitter into event_manager
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-01 13:15:58 +08:00
bb5d52539c
refactor(graph_engine): Merge branch_handler into edge_processor
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-01 12:53:06 +08:00
88622f70fb
refactor(graph_engine): Move setup methods into __init__
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-01 12:08:03 +08:00
0fdb1b2bc9
refactor(graph_engine): Correct private attributes and private methods naming
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-01 04:37:23 +08:00
a5cb9d2b73
refactor(graph_engine): inline output_registry into response_coordinator
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-01 03:59:53 +08:00
64c1234724
refactor(graph_engine): Merge worker management into one WorkerPool
...
Signed-off-by: -LAN- <laipz8200@outlook.com >
2025-09-01 03:23:47 +08:00
