Enhancements:

1. Improved performance for last() without cache enabled
2. Minimize the impact on data writing caused by data subscription
3. Improved rebalance performance

Fixed bugs:

1. taosd exit may take too much time when there is a long query
2. data subscription may hang in some extreme cases
3. order by _wstart with partition by doesn't work
4. A few crashe problems when using stream
5. The result of sum + case when is not correct
6. The result of interp is incorrect
7. Schemaless writing reported error "table not exist"
8. taosd keeps logging "database not exist"

What's Changed

• enh(stream): the stream will start after vnode restore being completed. by @hjxilinx in https://github.com/taosdata/TDengine/pull/20873
• fix: udf plan error by @xiao-yu-wang in https://github.com/taosdata/TDengine/pull/20940
• fix:stream memory leak by @54liuyao in https://github.com/taosdata/TDengine/pull/20953
• opti:the logic of mndDoRebalance for clear by @wangmm0220 in https://github.com/taosdata/TDengine/pull/20938
• chore(deps): bump spring-core from 5.3.26 to 5.3.27 in /examples/JDBC/taosdemo by @dependabot in https://github.com/taosdata/TDengine/pull/20955
• enh: remove unused functions in sync by @bgzhao66 in https://github.com/taosdata/TDengine/pull/20954
• fix(stream): set the correct initial checkpoint versions. by @hjxilinx in https://github.com/taosdata/TDengine/pull/20947
• fix: atoi on int64 config item for main by @sangshuduo in https://github.com/taosdata/TDengine/pull/20956
• fix: jdbc connector illegal accesses by @huolibo in https://github.com/taosdata/TDengine/pull/20962
• fix: fix double free caused crash by @glzhao89 in https://github.com/taosdata/TDengine/pull/20952
• fix(stream): update the reference count value to be int32 by @hjxilinx in https://github.com/taosdata/TDengine/pull/20967
• fix: duplicate calling shellWriteHistory by @DuanKuanJun in https://github.com/taosdata/TDengine/pull/20958
• enh: ignore single row null data type validation by @dapan1121 in https://github.com/taosdata/TDengine/pull/20973
• fix(os): fix a deadlock. by @hjxilinx in https://github.com/taosdata/TDengine/pull/20977
• fix: tdengine swarm cluster(3 mnodes) startup error by @lazyky in https://github.com/taosdata/TDengine/pull/20966
• fix: trim database db from mnd by @kailixu in https://github.com/taosdata/TDengine/pull/20983
• test:add testcase of compatibility.py for TS-3209 by @tomchon in https://github.com/taosdata/TDengine/pull/20984
• test: modify test case by @plum-lihui in https://github.com/taosdata/TDengine/pull/20934
• test: add cases for TS-3150 by @jiajingbin in https://github.com/taosdata/TDengine/pull/20911
• ci: enable Jemalloc in compilation by @tomchon in https://github.com/taosdata/TDengine/pull/20616
• fix: invalid identifier check by @xiao-yu-wang in https://github.com/taosdata/TDengine/pull/20993
• fix(stream): add lock during check wal to create new stream task. by @hjxilinx in https://github.com/taosdata/TDengine/pull/20995
• enh(stream): add more check to stop stream asap. by @hjxilinx in https://github.com/taosdata/TDengine/pull/20998
• add the cast that select field include two udf function by @DuanKuanJun in https://github.com/taosdata/TDengine/pull/20991
• enhance: enterprise package include jdbc driver by @xleili in https://github.com/taosdata/TDengine/pull/21001
• fix: do not performace table count scan optimized where there are no agg functions by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/20989
• fix(stream): set the correct number of tasks. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21002
• fix:[TS-3082] change offset to firstver if offset is smller than firs… by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21006
• fix:[TS-3250] change strtegy in schemaless if modifyDBSchema error by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21005
• opti:escape logic in schemaless by @wangmm0220 in https://github.com/taosdata/TDengine/pull/20970
• feat: support table_prefix/table_suffix new mode by @dapan1121 in https://github.com/taosdata/TDengine/pull/21007
• fix: taosdump escape dbname by @sangshuduo in https://github.com/taosdata/TDengine/pull/21014
• fix: topic name supports capital by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21012
• fix: when db_name!=xxx can not be used in systable scan index by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21008
• fix: vnode errcode setting error by @xiao-yu-wang in https://github.com/taosdata/TDengine/pull/21028
• fix: taosbenchmark rest socket in stb section for main by @sangshuduo in https://github.com/taosdata/TDengine/pull/21020
• fix: change tdbTbInsert to tdbTbUpsert for meta update in tdb by @bgzhao66 in https://github.com/taosdata/TDengine/pull/21013
• fix:add log for locale setting by @cadem in https://github.com/taosdata/TDengine/pull/21023
• fix: release resources if node open/start failed by @kailixu in https://github.com/taosdata/TDengine/pull/21032
• fix filter err by @yihaoDeng in https://github.com/taosdata/TDengine/pull/21019
• test:modify base version in compatibility.py by @tomchon in https://github.com/taosdata/TDengine/pull/21044
• fix(query): add null ptr check. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21030
• Test/ts 3249 by @happyguoxy in https://github.com/taosdata/TDengine/pull/21047
• fix: delete table error by @hzcheng in https://github.com/taosdata/TDengine/pull/21064
• fix: restore ci buildPath by @tomchon in https://github.com/taosdata/TDengine/pull/21067
• opti:test cases for tmq by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21046
• enhance: packaging keeper in deb rpm main by @xleili in https://github.com/taosdata/TDengine/pull/21071
• fix: the latest schema may delete columns by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21074
• feat: subtable level privilege by @xiao-yu-wang in https://github.com/taosdata/TDengine/pull/21056
• fix: more fix by @hzcheng in https://github.com/taosdata/TDengine/pull/21078
• enh(query): opt last row read performance. TD-23313 by @hjxilinx in https://github.com/taosdata/TDengine/pull/21070
• fix: schema/tag version update to int32 by @dapan1121 in https://github.com/taosdata/TDengine/pull/21088
• fix: log file size over 4G report error on windows by @DuanKuanJun in https://github.com/taosdata/TDengine/pull/21077
• fix: fix crash caused by deleting from system table by @glzhao89 in https://github.com/taosdata/TDengine/pull/21029
• refactor: do some internal refactor. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21087
• test：add test case for multistage by @jiacy-jcy in https://github.com/taosdata/TDengine/pull/20997
• Lihui3.0/test by @plum-lihui in https://github.com/taosdata/TDengine/pull/21094
• log: disable some logs. TD-23861 by @hjxilinx in https://github.com/taosdata/TDengine/pull/21097
• fix(taosAdapter): tmq lift blocking time limit by @huskar-t in https://github.com/taosdata/TDengine/pull/21100
• enhance: relase enterpise pull jdbc from tag 3.1.0 by @xleili in https://github.com/taosdata/TDengine/pull/21102
• fix(query): check the init status for pReader->status.merger TD-23903 by @hjxilinx in https://github.com/taosdata/TDengine/pull/21105
• fix:[TD-23881] check the max row's length in schemaless by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21090
• release: upgrade default version to 3.0.4.1 by @xleili in https://github.com/taosdata/TDengine/pull/21110
• enh(query): stop tsdb reader ASAP. TD-23249 by @hjxilinx in https://github.com/taosdata/TDengine/pull/21111
• fix(query): stop tsdbreade ASAP, and do some internal refactor. TD-23249 by @hjxilinx in https://github.com/taosdata/TDengine/pull/21116
• refactor: do some internal refactor. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21119
• other: add some logs. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21120
• refactor: remove assert. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21123
• enh: optimize tbname condition by @dapan1121 in https://github.com/taosdata/TDengine/pull/21126
• opti:change push mgr to consume msg for subscribe by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21060
• refactor: do some internal refactor. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21131
• fix:change field bytes if length is bigger than 1024 by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21137
• fix(query): stop tsdb reader asap. TD-23964 by @hjxilinx in https://github.com/taosdata/TDengine/pull/21148
• fix: subtable grant is not allowed by @dapan1121 in https://github.com/taosdata/TDengine/pull/21158
• fix(stream): secure the delete task operation. TD-23966 by @hjxilinx in https://github.com/taosdata/TDengine/pull/21164
• fix: stable name not responsed while stable removed issue by @dapan1121 in https://github.com/taosdata/TDengine/pull/21150
• update crash gen push message by @xiaopingcs in https://github.com/taosdata/TDengine/pull/21170
• fix(stream): opt task scan performance. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21169
• fix(tdb/decoder): free decoder's value if not needed by user by @stephenkgu in https://github.com/taosdata/TDengine/pull/21167
• refactor: do some internal refactor. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21139
• enh: declare mndSplitVgroup in mndVgroup.h by @bgzhao66 in https://github.com/taosdata/TDengine/pull/21172
• int16 overflow by @cadem in https://github.com/taosdata/TDengine/pull/21140
• fix: print float with 20 width limit by @DuanKuanJun in https://github.com/taosdata/TDengine/pull/21174
• fix:[TS-3277]table not exist if drop stable in another client when in… by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21163
• fix:change field bytes if length is bigger than 1024 by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21153
• fix:[TS-3303]use stable name + child table name as key to save uid to… by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21152
• [TS-3140]: add test case for user privilege by @xiaopingcs in https://github.com/taosdata/TDengine/pull/21042
• fix: clear null bitmap bit when set value by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21180
• refactor: do some internal refactor. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21183
• fix: fix taosd not exit when press ctrl+c by @glzhao89 in https://github.com/taosdata/TDengine/pull/21184
• fix:[TS-3347]set ver to first version if version stored is smaller th… by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21190
• use wrong usedb map by @cadem in https://github.com/taosdata/TDengine/pull/21195
• test: fix tsim/db/error1.sim random failed by @DuanKuanJun in https://github.com/taosdata/TDengine/pull/21185
• docs: add wal args by @AdamEECS in https://github.com/taosdata/TDengine/pull/21203
• colid overflow by @cadem in https://github.com/taosdata/TDengine/pull/21206
• fix: forbid some stream computing by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21187
• fix: protect against nullptr in syncRespCleanRsp by @bgzhao66 in https://github.com/taosdata/TDengine/pull/21211
• update push message by @xiaopingcs in https://github.com/taosdata/TDengine/pull/21171
• fix:[TD-23972] push subscribe msg to vnode even though consumer not c… by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21177
• fix:[TD-24010] subscribeStb.py failed in windows CI by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21194
• fix: fix invalid read by @yihaoDeng in https://github.com/taosdata/TDengine/pull/21212
• fix: data compare of signed and unsigned integers by @wangjiaming0909 in https://github.com/taosdata/TDengine/pull/21213
• Test/update push message by @xiaopingcs in https://github.com/taosdata/TDengine/pull/21228
• fix: fix crash caused by tsdbReaderResume error not handled by @glzhao89 in https://github.com/taosdata/TDengine/pull/21224
• fix: show table distributed t; set the unit of Size to KB by @wangjiaming0909 in https://github.com/taosdata/TDengine/pull/21218
• fix:after restarting taosd, stream does not work. by @54liuyao in https://github.com/taosdata/TDengine/pull/21216
• fix:after restarting taosd, stream does not work. by @54liuyao in https://github.com/taosdata/TDengine/pull/21226
• fix: check varchar/nchar column length for alter normal table by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21221
• fix:[TD-24058]send poll result to client if no data 5 times to avoid … by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21227
• Optimize scripts for packaging/docker by @muicoder in https://github.com/taosdata/TDengine/pull/21225
• fix: set telemetry reporting service url from telemetry.taosdata.com … by @wangjiaming0909 in https://github.com/taosdata/TDengine/pull/21219
• test:add testcases of learner in election by @tomchon in https://github.com/taosdata/TDengine/pull/21229
• fix: connect error when login with information_schema/performance_sc… by @wangjiaming0909 in https://github.com/taosdata/TDengine/pull/21232
• fix: not to set ignoring signals in dmLogCrash by @bgzhao66 in https://github.com/taosdata/TDengine/pull/21244
• fix: repair timestamps of wal log files in meta by @bgzhao66 in https://github.com/taosdata/TDengine/pull/21249
• fix:compile error in release mode by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21252
• test: add test case by @xiaopingcs in https://github.com/taosdata/TDengine/pull/21251
• docs: update readme with tdengin1 wechat by @sangshuduo in https://github.com/taosdata/TDengine/pull/21268
• enh: remove group_key from subsidiaries if multiple different select function present by @glzhao89 in https://github.com/taosdata/TDengine/pull/21250
• fix: column length check when update/add column by @kailixu in https://github.com/taosdata/TDengine/pull/21262
• fix:[TD-24111]avoid exec pHandle task in multi query thread by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21269
• fix: func ctgHandleGetTbMetasRsp invalid read SName by @wangjiaming0909 in https://github.com/taosdata/TDengine/pull/21254
• fix: bypass projection pruning if union set op and subquery by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21258
• fix(tmq): check handle status before close sub. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21289
• fix: disable table count scan optimization when filters and group by both exist by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21283
• docs: update readme with libgflags by @sangshuduo in https://github.com/taosdata/TDengine/pull/21294
• refactor: do some internal refactor. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21296
• enh(taosAdapter): update taosAdapter by @huskar-t in https://github.com/taosdata/TDengine/pull/21297
• fix: fix linear interpolation error by @glzhao89 in https://github.com/taosdata/TDengine/pull/21301
• fix: ignore crash signals in dmLogCrash by @bgzhao66 in https://github.com/taosdata/TDengine/pull/21309
• fix:add lock to pHandle for safety by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21311
• Enh/tsbs perf.4 by @dapan1121 in https://github.com/taosdata/TDengine/pull/21271
• fix(stream):extract delete msg from wal. TD-24207 by @hjxilinx in https://github.com/taosdata/TDengine/pull/21314
• fix: join push down condition issue by @dapan1121 in https://github.com/taosdata/TDengine/pull/21346
• docs(connector-rust): update documents of connector for rust by @bioinformatist in https://github.com/taosdata/TDengine/pull/21345
• Update cases.task by @plum-lihui in https://github.com/taosdata/TDengine/pull/21356
• fix(stream): fix memory leak for stream processing. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21359
• fix: select , <expr1##sth else> from ... return error data whe… by @wangjiaming0909 in https://github.com/taosdata/TDengine/pull/21310
• fix: union clause error message by @dapan1121 in https://github.com/taosdata/TDengine/pull/21337
• fix: memory size overflow issue by @dapan1121 in https://github.com/taosdata/TDengine/pull/21361
• fix: join improvement by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21328
• enh: optimize order by for partition by clause by @dapan1121 in https://github.com/taosdata/TDengine/pull/21365
• fix: last table scan issue by @dapan1121 in https://github.com/taosdata/TDengine/pull/21379
• fix: join eq conditions optimization work on not only for tag by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21384
• fix(query): add null check. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21385
• fix: distinct wrong result issue by @dapan1121 in https://github.com/taosdata/TDengine/pull/21371
• fix(query): do some internal refactor, and fix the bug when calender duration exists in sliding and offset. by @hjxilinx in https://github.com/taosdata/TDengine/pull/21378
• fix: result block ensure capacity when finalize may produce serveral … by @shenglian-zhou in https://github.com/taosdata/TDengine/pull/21382
• fix:error in pHandle lock by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21355
• docs: update readme main by @sangshuduo in https://github.com/taosdata/TDengine/pull/21401
• fix: select last(*) ..group by tag return wrong rows of data by @wangjiaming0909 in https://github.com/taosdata/TDengine/pull/21388
• fix:set task code success after kill by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21407
• add parameter by @yihaoDeng in https://github.com/taosdata/TDengine/pull/21406
• fix:remove get schema from previous for taosx by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21411
• update crash_gen by @xiaopingcs in https://github.com/taosdata/TDengine/pull/21421
• fix:lost data because tsdbreader or task is killed by @wangmm0220 in https://github.com/taosdata/TDengine/pull/21427
• Remove taosx, connector, explorer and taoskeeper in cloud tdengine by @wingwing2005 in https://github.com/taosdata/TDengine/pull/21423

New Contributors

• @lazyky made their first contribution in https://github.com/taosdata/TDengine/pull/20966
• @muicoder made their first contribution in https://github.com/taosdata/TDengine/pull/21225
• @bioinformatist made their first contribution in https://github.com/taosdata/TDengine/pull/21345

Full Changelog: https://github.com/taosdata/TDengine/compare/ver-3.0.4.0...ver-3.0.4.2