|
|
899df30bf6
|
Plugin/merge main to plugin/beta 20250122 (#12962)
Signed-off-by: yihong0618 <zouzou0208@gmail.com>
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: kurokobo <kuro664@gmail.com>
Co-authored-by: Hiroshi Fujita <fujita-h@users.noreply.github.com>
Co-authored-by: NFish <douxc512@gmail.com>
Co-authored-by: Gen Sato <52241300+halogen22@users.noreply.github.com>
Co-authored-by: eux <euxuuu@gmail.com>
Co-authored-by: huangzhuo1949 <167434202+huangzhuo1949@users.noreply.github.com>
Co-authored-by: huangzhuo <huangzhuo1@xiaomi.com>
Co-authored-by: lotsik <lotsik@mail.ru>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
Co-authored-by: Wu Tianwei <30284043+WTW0313@users.noreply.github.com>
Co-authored-by: nite-knite <nkCoding@gmail.com>
Co-authored-by: Jyong <76649700+JohnJyong@users.noreply.github.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: gakkiyomi <gakkiyomi@aliyun.com>
Co-authored-by: CN-P5 <heibai2006@gmail.com>
Co-authored-by: CN-P5 <heibai2006@qq.com>
Co-authored-by: Chuehnone <1897025+chuehnone@users.noreply.github.com>
Co-authored-by: yihong <zouzou0208@gmail.com>
Co-authored-by: Kevin9703 <51311316+Kevin9703@users.noreply.github.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: Boris Feld <lothiraldan@gmail.com>
Co-authored-by: mbo <himabo@gmail.com>
Co-authored-by: mabo <mabo@aeyes.ai>
Co-authored-by: Warren Chen <warren.chen830@gmail.com>
Co-authored-by: KVOJJJin <jzongcode@gmail.com>
Co-authored-by: JzoNgKVO <27049666+JzoNgKVO@users.noreply.github.com>
Co-authored-by: jiandanfeng <chenjh3@wangsu.com>
Co-authored-by: zhu-an <70234959+xhdd123321@users.noreply.github.com>
Co-authored-by: zhaoqingyu.1075 <zhaoqingyu.1075@bytedance.com>
Co-authored-by: 海狸大師 <86974027+yenslife@users.noreply.github.com>
Co-authored-by: Xu Song <xusong.vip@gmail.com>
Co-authored-by: rayshaw001 <396301947@163.com>
Co-authored-by: Ding Jiatong <dingjiatong@gmail.com>
Co-authored-by: Bowen Liang <liangbowen@gf.com.cn>
Co-authored-by: JasonVV <jasonwangiii@outlook.com>
Co-authored-by: le0zh <newlight@qq.com>
Co-authored-by: zhuxinliang <zhuxinliang@didiglobal.com>
Co-authored-by: k-zaku <zaku99@outlook.jp>
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: luckylhb90 <luckylhb90@gmail.com>
Co-authored-by: hobo.l <hobo.l@binance.com>
Co-authored-by: jiangbo721 <365065261@qq.com>
Co-authored-by: 刘江波 <jiangbo721@163.com>
Co-authored-by: Shun Miyazawa <34241526+miya@users.noreply.github.com>
Co-authored-by: EricPan <30651140+Egfly@users.noreply.github.com>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: zxhlyh <jasonapring2015@outlook.com>
Co-authored-by: sino <sino2322@gmail.com>
Co-authored-by: Jhvcc <37662342+Jhvcc@users.noreply.github.com>
Co-authored-by: lowell <lowell.hu@zkteco.in>
|
2025-01-23 14:48:16 +08:00 |
|
|
|
78664c8903
|
Merge branch 'main' into fix/chore-fix
|
2024-12-27 17:33:58 +08:00 |
|
|
|
84ac004772
|
py lint (#12102)
Signed-off-by: -LAN- <laipz8200@outlook.com>
Co-authored-by: -LAN- <laipz8200@outlook.com>
|
2024-12-26 00:16:35 +08:00 |
|
|
|
9231fdbf4c
|
Feat/support parent child chunk (#12092)
|
2024-12-25 19:49:07 +08:00 |
|
|
|
4199998c7e
|
Merge branch 'main' into fix/chore-fix
|
2024-12-24 21:28:56 +08:00 |
|
|
|
56e15d09a9
|
feat: mypy for all type check (#10921)
|
2024-12-24 18:38:51 +08:00 |
|
|
|
db726e02a0
|
feat: support multi token count
|
2024-11-26 18:59:03 +08:00 |
|
|
|
5ff9cee326
|
Merge branch 'main' into fix/chore-fix
|
2024-11-25 15:37:19 +08:00 |
|
|
|
6c8e208ef3
|
chore: bump minimum supported Python version to 3.11 (#10386)
|
2024-11-24 13:28:46 +08:00 |
|
|
|
a700b49461
|
fix: migration
|
2024-11-21 13:55:08 +08:00 |
|
|
|
94c9cadbd8
|
fix image files not deleted on indexing_estimate #9541 (#10798)
Co-authored-by: root <root@localhost.localdomain>
|
2024-11-21 13:03:16 +08:00 |
|
|
|
14f3d44c37
|
refactor: improve handling of leading punctuation removal (#10761)
|
2024-11-18 21:32:33 +08:00 |
|
|
|
51db59622c
|
chore(lint): cleanup repeated cause exception in logging.exception replaced by helpful message (#10425)
|
2024-11-15 15:41:40 +08:00 |
|
|
|
5f21d13572
|
fix: handle KeyError when accessing rules in CleanProcessor.clean (#10258)
|
2024-11-05 14:47:15 +08:00 |
|
|
|
82033af097
|
clean un-allowed special charters when doing indexing estimate (#10153)
|
2024-11-01 15:09:22 +08:00 |
|
|
|
240b66d737
|
chore: avoid implicit optional in type annotations of method (#8727)
|
2024-10-09 14:36:43 +08:00 |
|
|
|
a1104ab97e
|
chore: refurish python code by applying Pylint linter rules (#8322)
|
2024-09-13 22:42:08 +08:00 |
|
|
|
292220c596
|
chore: apply pep8-naming rules for naming convention (#8261)
|
2024-09-11 16:40:52 +08:00 |
|
|
|
2cf1187b32
|
chore(api/core): apply ruff reformatting (#7624)
|
2024-09-10 17:00:20 +08:00 |
|
|
|
2d7954c7da
|
Fix variable typo (#8084)
|
2024-09-08 13:14:11 +08:00 |
|
|
|
14af87527f
|
Feat:remove estimation of embedding cost (#7950)
Co-authored-by: jyong <718720800@qq.com>
|
2024-09-04 14:41:47 +08:00 |
|
|
|
35431bce0d
|
fix dataset_id and index_node_id idx missed in document_segments tabl… (#7681)
|
2024-08-27 10:25:24 +08:00 |
|
|
|
430e100142
|
refactor: Add @staticmethod decorator in api/core (#7652)
|
2024-08-26 19:45:03 +08:00 |
|
|
|
b7778de224
|
fix: document error message can not be cleared (#7453)
|
2024-08-20 19:30:57 +08:00 |
|
|
|
a98284b1ef
|
refactor(api): Switch to dify_config (#6750)
Signed-off-by: -LAN- <laipz8200@outlook.com>
|
2024-07-30 11:15:26 +08:00 |
|
|
|
d27e3ab99d
|
chore: remove unresolved reference (#6110)
|
2024-07-09 23:04:44 +08:00 |
|
|
|
dcb72e0067
|
chore: apply flake8-comprehensions Ruff rules to improve collection comprehensions (#5652)
Co-authored-by: -LAN- <laipz8200@outlook.com>
|
2024-06-27 11:21:31 +08:00 |
|
|
|
ba5f8afaa8
|
Feat/firecrawl data source (#5232)
Co-authored-by: Nicolas <nicolascamara29@gmail.com>
Co-authored-by: chenhe <guchenhe@gmail.com>
Co-authored-by: takatost <takatost@gmail.com>
|
2024-06-15 02:46:02 +08:00 |
|
|
|
f976740b57
|
improve: mordernizing validation by migrating pydantic from 1.x to 2.x (#4592)
|
2024-06-14 01:05:37 +08:00 |
|
|
|
d1dbbc1e33
|
feat: backend model load balancing support (#4927)
|
2024-06-05 00:13:04 +08:00 |
|
|
|
b6631cd878
|
modify rerank and splitter code directory (#4924)
|
2024-06-04 20:07:25 +08:00 |
|
|
|
233c4150d1
|
support images and tables extract from docx (#4619)
|
2024-05-23 18:05:23 +08:00 |
|
|
|
c255a20d7c
|
allow to config max segmentation tokens length for RAG document using environment variable (#4375)
|
2024-05-20 13:20:27 +08:00 |
|
|
|
04ad46dd31
|
chore: skip unnecessary key checks prior to accessing a dictionary (#4497)
|
2024-05-19 18:30:45 +08:00 |
|
|
|
c227f3d985
|
feat: Deprecate datetime.utcnow() in favor of datetime.now(timezone.utc).replace(tzinfo=None) for better timezone handling (#3408) (#3416)
|
2024-04-12 16:22:24 +08:00 |
|
|
|
33ea689861
|
fix detached instance error in keyword index create thread and fix question classifier node out of index error (#3219)
|
2024-04-09 14:34:51 +08:00 |
|
|
|
283979fc46
|
fix keyword index error when storage source is S3 (#3182)
|
2024-04-09 01:42:58 +08:00 |
|
|
|
7753ba2d37
|
FEAT: NEW WORKFLOW ENGINE (#3160)
Co-authored-by: Joel <iamjoel007@gmail.com>
Co-authored-by: Yeuoly <admin@srmxy.cn>
Co-authored-by: JzoNg <jzongcode@gmail.com>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: nite-knite <nkCoding@gmail.com>
Co-authored-by: jyong <718720800@qq.com>
|
2024-04-08 18:51:46 +08:00 |
|
|
|
b0b0cc045f
|
add mutil-thread document embedding (#3016)
Co-authored-by: jyong <jyong@dify.ai>
|
2024-03-28 17:02:35 +08:00 |
|
|
|
6454e1d644
|
chunk-overlap None check (#2781)
Co-authored-by: jyong <jyong@dify.ai>
|
2024-03-11 15:36:56 +08:00 |
|
|
|
31070ffbca
|
fix qa index processor tenant id is None error (#2713)
Co-authored-by: jyong <jyong@dify.ai>
|
2024-03-06 16:46:08 +08:00 |
|
|
|
fa7ba30ba3
|
Fix rebuild index&csv parsing (#2705)
Co-authored-by: luowei <glpat-EjySCyNjWiLqAED-YmwM>
Co-authored-by: crazywoola <427733928@qq.com>
Co-authored-by: crazywoola <100913391+crazywoola@users.noreply.github.com>
|
2024-03-06 11:33:32 +08:00 |
|
|
|
5b953c1ef2
|
Fix some RAG bugs (#2570)
Co-authored-by: jyong <jyong@dify.ai>
|
2024-02-27 11:39:05 +08:00 |
|
|
|
0620fa3094
|
Feat/vdb migrate command (#2562)
Co-authored-by: jyong <jyong@dify.ai>
|
2024-02-26 19:47:29 +08:00 |
|
|
|
4be3087642
|
Fix/new RAG bugs (#2547)
Co-authored-by: jyong <jyong@dify.ai>
|
2024-02-23 16:54:15 +08:00 |
|
|
|
91ea6fe4ee
|
Fix/langchain document schema (#2539)
Co-authored-by: jyong <jyong@dify.ai>
|
2024-02-23 14:16:44 +08:00 |
|
|
|
6c4e6bf1d6
|
Feat/dify rag (#2528)
Co-authored-by: jyong <jyong@dify.ai>
|
2024-02-22 23:31:57 +08:00 |
|
|
|
97fe817186
|
Fix/upload limit (#2521)
Co-authored-by: jyong <jyong@dify.ai>
Co-authored-by: StyleZhang <jasonapring2015@outlook.com>
|
2024-02-22 17:16:22 +08:00 |
|
|
|
063191889d
|
chore: apply ruff's pyupgrade linter rules to modernize Python code with targeted version (#2419)
|
2024-02-09 15:21:33 +08:00 |
|
|
|
243ca5b1e2
|
fix: typo in package path of core.splitter (#2411)
|
2024-02-07 15:34:02 +08:00 |
|
