mirror of
https://github.com/langgenius/dify.git
synced 2026-05-06 02:18:08 +08:00
* test: adding some web tests (#27792) * feat: add validation to prevent saving empty opening statement in conversation opener modal (#27843) * fix(web): improve the consistency of the inputs-form UI (#27837) * fix(web): increase z-index of PortalToFollowElemContent (#27823) * fix: installation_id is missing when in tools page (#27849) * fix: avoid passing empty uniqueIdentifier to InstallFromMarketplace (#27802) Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * test: create new test scripts and update some existing test scripts o… (#27850) * feat: change feedback to forum (#27862) * chore: translate i18n files and update type definitions (#27868) Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com> * Fix/template transformer line number (#27867) Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com> * bump vite to 6.4.1 (#27877) * Add WEAVIATE_GRPC_ENDPOINT as designed in weaviate migration guide (#27861) Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> * Fix: correct DraftWorkflowApi.post response model (#27289) Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> * fix Version 2.0.0-beta.2: Chat annotations Api Error #25506 (#27206) Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Asuka Minato <i@asukaminato.eu.org> * fix jina reader creadential migration command (#27883) * fix agent putout the output of workflow-tool twice (#26835) (#27087) * fix jina reader transform (#27922) * fix: prevent fetch version info in enterprise edition (#27923) * fix(api): fix `VariablePool.get` adding unexpected keys to variable_dictionary (#26767) Co-authored-by: -LAN- <laipz8200@outlook.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> * refactor: implement tenant self queue for rag tasks (#27559) Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: -LAN- <laipz8200@outlook.com> * fix: bump brotli to 1.2.0 resloved CVE-2025-6176 (#27950) Signed-off-by: kenwoodjw <blackxin55+@gmail.com> * docs: clarify how to obtain workflow_id for version execution (#28007) Signed-off-by: OneZero-Y <aukovyps@163.com> * fix: fix https://github.com/langgenius/dify/issues/27939 (#27985) * fix: the model list encountered two children with the same key (#27956) Co-authored-by: haokai <haokai@shuwen.com> * add onupdate=func.current_timestamp() (#28014) Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * chore(deps): bump scipy-stubs from 1.16.2.3 to 1.16.3.0 in /api (#28025) Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> * Fix typo in weaviate comment, improve time test precision, and add security tests for get-icon utility (#27919) Signed-off-by: NeatGuyCoding <15627489+NeatGuyCoding@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * feat: Add Audio Content Support for MCP Tools (#27979) * fix: elasticsearch_vector version (#28028) Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * fix workflow default updated_at (#28047) * feat(api): Introduce Broadcast Channel (#27835) This PR introduces a `BroadcastChannel` abstraction with broadcasting and at-most once delivery semantics, serving as the communication component between celery worker and API server. It also includes a reference implementation backed by Redis PubSub. Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> * fix * back --------- Signed-off-by: Yongtao Huang <yongtaoh2022@gmail.com> Signed-off-by: kenwoodjw <blackxin55+@gmail.com> Signed-off-by: OneZero-Y <aukovyps@163.com> Signed-off-by: dependabot[bot] <support@github.com> Signed-off-by: NeatGuyCoding <15627489+NeatGuyCoding@users.noreply.github.com> Co-authored-by: aka James4u <smart.jamesjin@gmail.com> Co-authored-by: Novice <novice12185727@gmail.com> Co-authored-by: yangzheli <43645580+yangzheli@users.noreply.github.com> Co-authored-by: Elliott <105957288+Elliott-byte@users.noreply.github.com> Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com> Co-authored-by: johnny0120 <johnny0120@users.noreply.github.com> Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> Co-authored-by: Gritty_dev <101377478+codomposer@users.noreply.github.com> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> Co-authored-by: wangjifeng <163279492+kk-wangjifeng@users.noreply.github.com> Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com> Co-authored-by: Boris Polonsky <BorisPolonsky@users.noreply.github.com> Co-authored-by: Yongtao Huang <yongtaoh2022@gmail.com> Co-authored-by: Cursx <33718736+Cursx@users.noreply.github.com> Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com> Co-authored-by: Asuka Minato <i@asukaminato.eu.org> Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com> Co-authored-by: red_sun <56100962+redSun64@users.noreply.github.com> Co-authored-by: NFish <douxc512@gmail.com> Co-authored-by: QuantumGhost <obelisk.reg+git@gmail.com> Co-authored-by: -LAN- <laipz8200@outlook.com> Co-authored-by: hj24 <huangjian@dify.ai> Co-authored-by: kenwoodjw <blackxin55+@gmail.com> Co-authored-by: OneZero-Y <aukovyps@163.com> Co-authored-by: wangxiaolei <fatelei@gmail.com> Co-authored-by: Kenn <kennfalcon@gmail.com> Co-authored-by: haokai <haokai@shuwen.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: NeatGuyCoding <15627489+NeatGuyCoding@users.noreply.github.com> Co-authored-by: Will <vvfriday@gmail.com> Co-authored-by: huangzhuo1949 <167434202+huangzhuo1949@users.noreply.github.com> Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
135 lines
4.4 KiB
Python
135 lines
4.4 KiB
Python
"""
|
|
Broadcast channel for Pub/Sub messaging.
|
|
"""
|
|
|
|
import types
|
|
from abc import abstractmethod
|
|
from collections.abc import Iterator
|
|
from contextlib import AbstractContextManager
|
|
from typing import Protocol, Self
|
|
|
|
|
|
class Subscription(AbstractContextManager["Subscription"], Protocol):
|
|
"""A subscription to a topic that provides an iterator over received messages.
|
|
The subscription can be used as a context manager and will automatically
|
|
close when exiting the context.
|
|
|
|
Note: `Subscription` instances are not thread-safe. Each thread should create its own
|
|
subscription.
|
|
"""
|
|
|
|
@abstractmethod
|
|
def __iter__(self) -> Iterator[bytes]:
|
|
"""`__iter__` returns an iterator used to consume the message from this subscription.
|
|
|
|
If the caller did not enter the context, `__iter__` may lazily perform the setup before
|
|
yielding messages; otherwise `__enter__` handles it.”
|
|
|
|
If the subscription is closed, then the returned iterator exits without
|
|
raising any error.
|
|
"""
|
|
...
|
|
|
|
@abstractmethod
|
|
def close(self) -> None:
|
|
"""close closes the subscription, releases any resources associated with it."""
|
|
...
|
|
|
|
def __enter__(self) -> Self:
|
|
"""`__enter__` does the setup logic of the subscription (if any), and return itself."""
|
|
return self
|
|
|
|
def __exit__(
|
|
self,
|
|
exc_type: type[BaseException] | None,
|
|
exc_value: BaseException | None,
|
|
traceback: types.TracebackType | None,
|
|
) -> bool | None:
|
|
self.close()
|
|
return None
|
|
|
|
@abstractmethod
|
|
def receive(self, timeout: float | None = 0.1) -> bytes | None:
|
|
"""Receive the next message from the broadcast channel.
|
|
|
|
If `timeout` is specified, this method returns `None` if no message is
|
|
received within the given period. If `timeout` is `None`, the call blocks
|
|
until a message is received.
|
|
|
|
Calling receive with `timeout=None` is highly discouraged, as it is impossible to
|
|
cancel a blocking subscription.
|
|
|
|
:param timeout: timeout for receive message, in seconds.
|
|
|
|
Returns:
|
|
bytes: The received message as a byte string, or
|
|
None: If the timeout expires before a message is received.
|
|
|
|
Raises:
|
|
SubscriptionClosed: If the subscription has already been closed.
|
|
"""
|
|
...
|
|
|
|
|
|
class Producer(Protocol):
|
|
"""Producer is an interface for message publishing. It is already bound to a specific topic.
|
|
|
|
`Producer` implementations must be thread-safe and support concurrent use by multiple threads.
|
|
"""
|
|
|
|
@abstractmethod
|
|
def publish(self, payload: bytes) -> None:
|
|
"""Publish a message to the bounded topic."""
|
|
...
|
|
|
|
|
|
class Subscriber(Protocol):
|
|
"""Subscriber is an interface for subscription creation. It is already bound to a specific topic.
|
|
|
|
`Subscriber` implementations must be thread-safe and support concurrent use by multiple threads.
|
|
"""
|
|
|
|
@abstractmethod
|
|
def subscribe(self) -> Subscription:
|
|
pass
|
|
|
|
|
|
class Topic(Producer, Subscriber, Protocol):
|
|
"""A named channel for publishing and subscribing to messages.
|
|
|
|
Topics provide both read and write access. For restricted access,
|
|
use as_producer() for write-only view or as_subscriber() for read-only view.
|
|
|
|
`Topic` implementations must be thread-safe and support concurrent use by multiple threads.
|
|
"""
|
|
|
|
@abstractmethod
|
|
def as_producer(self) -> Producer:
|
|
"""as_producer creates a write-only view for this topic."""
|
|
...
|
|
|
|
@abstractmethod
|
|
def as_subscriber(self) -> Subscriber:
|
|
"""as_subscriber create a read-only view for this topic."""
|
|
...
|
|
|
|
|
|
class BroadcastChannel(Protocol):
|
|
"""A broadcasting channel is a channel supporting broadcasting semantics.
|
|
|
|
Each channel is identified by a topic, different topics are isolated and do not affect each other.
|
|
|
|
There can be multiple subscriptions to a specific topic. When a publisher publishes a message to
|
|
a specific topic, all subscription should receive the published message.
|
|
|
|
There are no restriction for the persistence of messages. Once a subscription is created, it
|
|
should receive all subsequent messages published.
|
|
|
|
`BroadcastChannel` implementations must be thread-safe and support concurrent use by multiple threads.
|
|
"""
|
|
|
|
@abstractmethod
|
|
def topic(self, topic: str) -> "Topic":
|
|
"""topic returns a `Topic` instance for the given topic name."""
|
|
...
|