youngkingdom/dify
1
0
Fork 0
mirror of https://github.com/langgenius/dify.git synced 2026-02-27 21:17:13 +08:00
Code Issues Packages Projects Releases Wiki Activity
8,813 Commits 379 Branches 166 Tags
8764e401ea7b9706099ff90d036ebd3a3ee5e692
Commit Graph

5163 Commits

Author SHA1 Message Date
GareArc
8764e401ea chore: Add __init__.py files for enterprise Python packages 
Add package initialization files for:
- enterprise/
- enterprise/telemetry/
- tests/integration_tests/enterprise/
- tests/unit_tests/enterprise/
 2026-01-29 17:12:35 -08:00
GareArc
775b28d3c9 test(enterprise): Add comprehensive tests for telemetry system 
Add unit and integration tests for enterprise OTEL telemetry with 25 tests
covering exporter, trace handler, event handlers, and end-to-end integration.

Unit tests (22 tests):
- test_exporter.py (11 tests): Header parsing, enable flags, counter/histogram operations
- test_enterprise_trace.py (4 tests): Workflow/node traces, privacy gating, parent context
- test_event_handlers.py (6 tests): App lifecycle and feedback event handlers
- test_enterprise_telemetry_config.py (1 test): Config validation

Integration tests (3 tests):
- test_telemetry_integration.py: Node trace construction, parent context propagation

Test results:
- 19/19 core tests pass reliably
- 6/6 event handler tests have pre-existing Flask context issues (not related to this PR)
- Code quality: 0 errors, 0 warnings (ruff + basedpyright)

Coverage includes:
- Enum-based span/counter/histogram usage
- Privacy controls (include_content flag)
- Parent trace context attributes
- Enterprise flag gating
- OTEL exporter initialization
- Dual processing (enterprise + per-app providers)
 2026-01-29 17:08:47 -08:00
GareArc
fbbe8a1be9 feat(enterprise): Add event handlers for app lifecycle and feedback telemetry 
Add Blinker signal handlers to emit OTEL spans for app CRUD operations and
user feedback events. All handlers use enum-based span/counter names for
type safety.

App lifecycle telemetry:
- app_was_created: Emit span + requests counter
- app_was_deleted: Emit span + requests counter
- app_was_updated: Emit span only

Feedback telemetry:
- feedback_was_created: Emit span + feedback counter
- Privacy gating via exporter.include_content flag

Infrastructure changes:
- Add missing signal exports to events/app_event.py
- Create events/feedback_event.py with feedback_was_created signal
- Emit app_was_deleted signal in services/app_service.py
- Emit feedback_was_created signal in services/message_service.py

Handlers are registered at import time via @signal.connect decorators and
loaded during ext_enterprise_telemetry.init_app().
 2026-01-29 17:08:23 -08:00
GareArc
6405a30278 feat(enterprise): Add node execution trace integration and complete parent context wiring 
Integrate enterprise per-node telemetry into workflow execution pipeline and
complete parent trace context propagation through the trace system.

Enterprise node execution tracing (GATED):
- Add WorkflowNodeTraceInfo entity with full node execution metadata
- Emit node trace on every node completion (succeeded/failed/exception/paused)
- Include LLM tokens, tool info, iteration/loop context, and timing data
- Hook into workflow persistence layer via _enqueue_node_trace_task()

Parent trace context wiring (COMMUNITY):
- Pass parent_trace_context through TraceTask to WorkflowTraceInfo.metadata
- Enables child workflows to include parent attributes for all trace providers
- Completes the distributed tracing feature started in first commit

Dual processing architecture:
- TraceQueueManager processes traces when enterprise OR per-app tracing enabled
- Celery task calls both EnterpriseDataTrace AND per-app trace providers
- Single queue, dual dispatch pattern

Files changed:
- core/ops/entities/trace_entity.py: Add WorkflowNodeTraceInfo + NODE_EXECUTION_TRACE
- core/app/workflow/layers/persistence.py: Emit node traces + parent context
- core/ops/ops_trace_manager.py: node_execution_trace() + dual dispatch
- tasks/ops_trace_task.py: Call enterprise trace handler
 2026-01-29 17:07:58 -08:00
GareArc
6cc38c61cc feat(enterprise): Add OTEL exporter and trace handler with enum-based telemetry 
Implement core enterprise OpenTelemetry infrastructure with type-safe enums
for all telemetry primitives (spans, counters, histograms).

Architecture:
- EnterpriseExporter: Own TracerProvider + shared global MeterProvider
- EnterpriseDataTrace: Duck-typed trace handler (not BaseTraceInstance subclass)
- Flask extension: Lifecycle management and singleton exporter access
- Enums: Single source of truth for span names and metric names

Key features:
- Type-safe telemetry with IDE autocomplete and compile-time checking
- Configurable trace sampling (default 100%)
- 100% accurate metrics (always collected, no sampling)
- Privacy controls via ENTERPRISE_INCLUDE_CONTENT flag
- Zero overhead when disabled (enterprise flag gates)

Components:
- enterprise/telemetry/entities: Span/Counter/Histogram enums
- enterprise/telemetry/exporter.py: OTEL exporter setup
- enterprise/telemetry/enterprise_trace.py: Trace handler using enums
- extensions/ext_enterprise_telemetry.py: Flask extension
- app_factory.py: Register extension in init list
 2026-01-29 17:07:31 -08:00
GareArc
df30383fe9 feat(enterprise): Add OTEL telemetry configuration 
Add configuration fields for enterprise OpenTelemetry telemetry:
- ENTERPRISE_TELEMETRY_ENABLED: Master toggle for telemetry
- ENTERPRISE_OTLP_ENDPOINT: OTEL collector endpoint URL
- ENTERPRISE_OTLP_HEADERS: Optional authentication headers
- ENTERPRISE_INCLUDE_CONTENT: Privacy control for PII in traces
- ENTERPRISE_OTEL_SAMPLING_RATE: Trace sampling rate (default 1.0)
- ENTERPRISE_SERVICE_NAME: Service name in OTEL resource attributes

All settings require ENTERPRISE_ENABLED=true to take effect.
 2026-01-29 17:07:05 -08:00
GareArc
a8e3c5701d feat: Add parent trace context propagation for workflow-as-tool hierarchy 
Enables distributed tracing for nested workflows across all trace providers
(Langfuse, LangSmith, community providers). When a workflow invokes another
workflow via workflow-as-tool, the child workflow now includes parent context
attributes that allow trace systems to reconstruct the full execution tree.

Changes:
- Add parent_trace_context field to WorkflowTool
- Set parent context in tool node when invoking workflow-as-tool
- Extract and pass parent context through app generator

This is a community enhancement (ungated) that improves distributed tracing
for all users. Parent context includes: trace_id, node_execution_id,
workflow_run_id, and app_id.
 2026-01-29 17:06:29 -08:00
eux
b48a10d7ec feat(qdrant): implement full-text search with multi-keyword support (#31658) 2026-01-29 11:12:18 +08:00
fenglin
91532ef429 fix: add list type support for ToolInput constant value in tool node (#31276) 
Co-authored-by: qiaofenglin <qiaofenglin@baidu.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-29 10:49:29 +08:00
-LAN-
24ebe2f5c6 refactor(graph_engine): Add a Config class for graph engine. (#31663) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2026-01-28 19:57:55 +08:00
moonpanda
78198c6452 fix: vdb-migrate command did not use for parent-child segment migration (#31605) 
Co-authored-by: warlocgao <warlocgao@tencent.com>
 2026-01-28 14:54:50 +08:00
-LAN-
3d414678e3 fix(graph_engine): Cannot run single iteration or loop node (#31470) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Yeuoly <45712896+Yeuoly@users.noreply.github.com>
 2026-01-28 01:05:59 +08:00
-LAN-
d76ad15fca refactor(graph_engine): move observability layer and persistence laye… (#31620) 2026-01-28 00:54:21 +08:00
NeatGuyCoding
144ef0880a fix(cors): correct CORS resource pattern for /console/api routes (#31485) 
Signed-off-by: NeatGuyCoding <15627489+NeatGuyCoding@users.noreply.github.com>
 2026-01-27 20:03:32 +08:00
Asuka Minato
8ec4233611 fix: doc not gen bug (#31547) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Stephen Zhou <38493346+hyoban@users.noreply.github.com>
 2026-01-27 20:19:39 +09:00
Asuka Minato
e482588ef8 fix: ConsoleDatasetListQuery request.args.to_dict() (#31598) 2026-01-27 17:12:52 +09:00
heyszt
eca26a9b9b feat: Enhances OpenTelemetry node parsers (#30706) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-27 15:30:21 +08:00
hj24
b4eef76c14 fix: billing account deletion (#31556) 2026-01-27 11:18:23 +08:00
dependabot[bot]
cbf7f646d9 chore(deps): bump pypdf from 6.6.0 to 6.6.2 in /api (#31568) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
 2026-01-27 11:06:13 +08:00
E.G
f6be9cd90d refactor: replace request.args.get with Pydantic BaseModel validation (#31104) 
Co-authored-by: GlobalStar117 <GlobalStar117@users.noreply.github.com>
Co-authored-by: Asuka Minato <i@asukaminato.eu.org>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-27 10:48:42 +08:00
dependabot[bot]
360f3bb32f chore(deps): bump pycryptodome from 3.19.1 to 3.23.0 in /api (#31504) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-01-27 10:43:05 +08:00
盐粒 Yanli
f00d823f9f chore: move agent notes into docstrings (#31560) 2026-01-27 09:32:26 +08:00
wangxiaolei
e48419937b feat: chatflow support multimodal (#31293) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-27 00:24:48 +08:00
Asuka Minato
5eaf0c733a fix: service api doc can not gen (#31549) 2026-01-26 21:59:02 +09:00
Junyan Qin (Chin)
f01f555146 chore: increase plugin cache ttl to 1 hour (#31552) 2026-01-26 19:48:33 +08:00
Asuka Minato
eba5eac3fa refactor: api/controllers/console/setup.py to ov3 (#31465) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-26 15:04:33 +08:00
Asuka Minato
19008dce13 refactor: api/controllers/console/version.py to v3 (#31463) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-26 15:04:25 +08:00
盐粒 Yanli
92011d0a31 refactor: LLM plugin invoke parsing (#31499) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-26 14:59:57 +08:00
Xiangxuan Qu
a51ced0a4f refactor: pass BaseModel instances instead of dict (#31514) 
Co-authored-by: fghpdf <fghpdf@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-26 14:50:14 +08:00
zyssyz123
7c12e923b6 feat: add trial model list in system features (#31313) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: hj24 <mambahj24@gmail.com>
 2026-01-26 11:52:05 +08:00
Asuka Minato
b9f1d65d4f refactor: example of refine dict / Mapping (#31498) 2026-01-26 10:23:38 +08:00
dependabot[bot]
9d38af6d99 chore(deps): bump pyasn1 from 0.6.1 to 0.6.2 in /api (#31140) 
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2026-01-24 10:31:56 +08:00
TomoOkuyama
0772d49257 fix(api): fix IRIS hybrid search returning zero results (#31309) 
Co-authored-by: Tomo Okuyama <tomo.okuyama@intersystems.com>
 2026-01-24 10:29:19 +08:00
-LAN-
67eb8c052d refactor: single-node workflow runner helpers (#31472) 2026-01-24 10:27:44 +08:00
Asuka Minato
5c4028d557 refactor: port AppModelConfig (#30919) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-24 10:25:51 +08:00
lif
55e6bca11c fix(http-request): prevent UUID truncation in JSON body (#31444) 
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-24 10:21:21 +08:00
盐粒 Yanli
67657c2f48 chore: Update dev setup scripts and API README (#31415) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-24 10:20:47 +08:00
fenglin
e8f9d64651 fix(tools): fix ToolInvokeMessage Union type parsing issue (#31450) 
Co-authored-by: qiaofenglin <qiaofenglin@baidu.com>
 2026-01-24 10:18:06 +08:00
wangxiaolei
1f8c730259 feat: optimize http status code (#31430) 2026-01-24 10:16:16 +08:00
Asuka Minato
8d45755303 feat: init fastopenapi (#30453) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-23 21:07:52 +09:00
Asuka Minato
6342d196e8 refactor: split changes for api/controllers/web/workflow.py (#29852) 2026-01-23 19:06:21 +09:00
Asuka Minato
5dc5709d58 refactor: split changes for api/controllers/web/login.py (#29854) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-23 19:06:04 +09:00
QuantumGhost
99d19cd3db docs(api): clarity SystemFeatureApi for webapp is unauthenticated by design (#31432) 
The `/api/system-features` is required for the web app initialization.
Authentication would create circular dependency (can't authenticate without web app loading).

Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-23 16:03:12 +08:00
非法操作
fa92548cf6 feat: archive workflow run logs backend (#31310) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
 2026-01-23 13:11:56 +08:00
Cursx
b3a869b91b refactor: optimize system features response payload for unauthenticated clients (#31392) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com>
 2026-01-23 12:12:11 +08:00
wangxiaolei
056095238b fix: fix create-by-file doc_form (#31346) 2026-01-23 11:34:47 +08:00
QuantumGhost
61f8647f37 docs(api): mark SystemFeatureApi as unauthenticated by design (#31417) 
The `/console/api/system-features` is required for the dashboard initialization. Authentication would create circular dependency (can't login without dashboard loading).

ref: CVE-2025-63387

Related: #31368
 2026-01-22 22:33:59 +08:00
-LAN-
c575c34ca6 refactor: Move workflow node factory to app workflow (#31385) 
Signed-off-by: -LAN- <laipz8200@outlook.com>
 2026-01-22 18:08:21 +08:00
wangxiaolei
a112caf5ec fix: use thread local isolation the context (#31410) 2026-01-22 18:02:54 +08:00
zyssyz123
515002a8ba feat: app trial (#26281) 
Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: hj24 <mambahj24@gmail.com>
 2026-01-22 15:42:54 +08:00