CHANGELOG.md 15.4 KB
Newer Older
J
jinhai 已提交
1 2 3 4
# Changelog

Please mark all change in change log and use the ticket from JIRA.

J
JinHai-CN 已提交
5 6 7
# Milvus 0.5.1 (TODO)

## Bug
Z
Zhiru Zhu 已提交
8
- \#134 - JFrog cache error
J
Jin Hai 已提交
9 10

## Feature
11
- \#90 - The server start error messages could be improved to enhance user experience
F
fishpenguin 已提交
12
- \#104 - test_scheduler core dump
J
Jin Hai 已提交
13
- \#115 - Using new structure for tasktable
F
fishpenguin 已提交
14

J
JinHai-CN 已提交
15
## Improvement
W
wxyu 已提交
16
- \#64 - Improvement dump function in scheduler
17
- \#80 - Print version information into log during server start
W
wxyu 已提交
18
- \#82 - Move easyloggingpp into "external" directory
Z
Zhiru Zhu 已提交
19
- \#92 - Speed up CMake build process
20
- \#96 - Remove .a file in milvus/lib for docker-version
21
- \#118 - Using shared_ptr instead of weak_ptr to avoid performance loss
W
wxyu 已提交
22
- \#122 - Add unique id for Job
23
- \#130 - Set task state MOVED after resource copy it completed
W
wxyu 已提交
24

J
JinHai-CN 已提交
25 26
## Task

J
JinHai-CN 已提交
27
# Milvus 0.5.0 (2019-10-21)
J
jinhai 已提交
28 29

## Bug
X
xiaojun.lin 已提交
30
- MS-568 - Fix gpuresource free error
Y
yudong.cai 已提交
31
- MS-572 - Milvus crash when get SIGINT
W
wxyu 已提交
32
- MS-577 - Unittest Query randomly hung
33
- MS-587 - Count get wrong result after adding vectors and index built immediately
34
- MS-599 - Search wrong result when table created with metric_type: IP
H
Heisenberg 已提交
35
- MS-601 - Docker logs error caused by get CPUTemperature error
36
- MS-605 - Server going down during searching vectors
37
- MS-620 - Get table row counts display wrong error code
38 39
- MS-622 - Delete vectors should be failed if date range is invalid
- MS-624 - Search vectors failed if time ranges long enough
40
- MS-637 - Out of memory when load too many tasks
41
- MS-639 - SQ8H index created failed and server hang
42
- MS-640 - Cache object size calculate incorrect
43
- MS-641 - Segment fault(signal 11) in PickToLoad
44
- MS-644 - Search crashed with index-type: flat
45
- MS-647 - grafana display average cpu-temp
X
update  
xiaojun.lin 已提交
46
- MS-652 - IVFSQH quantization double free
Y
Yu Kun 已提交
47
- MS-650 - SQ8H index create issue
48
- MS-653 - When config check fail, Milvus close without message
49
- MS-654 - Describe index timeout when building index
J
JinHai-CN 已提交
50
- MS-658 - Fix SQ8 Hybrid can't search
51
- MS-665 - IVF_SQ8H search crash when no GPU resource in search_resources
S
starlord 已提交
52
- \#9 - Change default gpu_cache_capacity to 4
S
starlord 已提交
53
- \#20 - C++ sdk example get grpc error 
Y
Yu Kun 已提交
54
- \#23 - Add unittest to improve code coverage
55
- \#31 - make clang-format failed after run build.sh -l
56
- \#39 - Create SQ8H index hang if using github server version
57
- \#30 - Some troubleshoot messages in Milvus do not provide enough information
S
starlord 已提交
58
- \#48 - Config unittest failed
59
- \#59 - Topk result is incorrect for small dataset
J
jinhai 已提交
60 61

## Improvement
62
- MS-552 - Add and change the easylogging library
S
starlord 已提交
63
- MS-553 - Refine cache code
Y
yudong.cai 已提交
64
- MS-555 - Remove old scheduler
W
wxyu 已提交
65
- MS-556 - Add Job Definition in Scheduler
Y
yudong.cai 已提交
66
- MS-557 - Merge Log.h
S
starlord 已提交
67
- MS-558 - Refine status code
68
- MS-562 - Add JobMgr and TaskCreator in Scheduler
Z
zhiru 已提交
69
- MS-566 - Refactor cmake
Y
yudong.cai 已提交
70 71
- MS-574 - Milvus configuration refactor
- MS-578 - Make sure milvus5.0 don't crack 0.3.1 data
W
wxyu 已提交
72
- MS-585 - Update namespace in scheduler
Y
yudong.cai 已提交
73
- MS-606 - Speed up result reduce
W
wxyu 已提交
74
- MS-608 - Update TODO names
W
wxyu 已提交
75
- MS-609 - Update task construct function
76
- MS-611 - Add resources validity check in ResourceMgr
77
- MS-619 - Add optimizer class in scheduler
78
- MS-626 - Refactor DataObj to support cache any type data
X
xiaojun.lin 已提交
79
- MS-648 - Improve unittest
X
xiaojun.lin 已提交
80
- MS-655 - Upgrade SPTAG
Y
Yu Kun 已提交
81
- \#42 - Put union of index_build_device and search resources to gpu_pool
Z
Zhiru Zhu 已提交
82
- \#67 - Avoid linking targets multiple times in cmake
J
jinhai 已提交
83

J
JinHai-CN 已提交
84
## Feature
J
JinHai-CN 已提交
85
- MS-614 - Preload table at startup
86
- MS-627 - Integrate new index: IVFSQHybrid
W
wxyu 已提交
87
- MS-631 - IVFSQ8H Index support
88
- MS-636 - Add optimizer in scheduler for FAISS_IVFSQ8H
J
jinhai 已提交
89 90

## Task
J
jinhai 已提交
91
- MS-554 - Change license to Apache 2.0
J
jielin.xu 已提交
92
- MS-561 - Add contributing guidelines, code of conduct and README docs
J
jinhai 已提交
93
- MS-567 - Add NOTICE.md
H
Heisenberg 已提交
94
- MS-569 - Complete the NOTICE.md
95
- MS-575 - Add Clang-format & Clang-tidy & Cpplint
96
- MS-586 - Remove BUILD_FAISS_WITH_MKL option
97
- MS-590 - Refine cmake code to support cpplint
S
starlord 已提交
98
- MS-600 - Reconstruct unittest code
S
starlord 已提交
99
- MS-602 - Remove zilliz namespace
100
- MS-610 - Change error code base value from hex to decimal
S
starlord 已提交
101
- MS-624 - Re-organize project directory for open-source
102
- MS-635 - Add compile option to support customized faiss
Z
Zhiru 已提交
103
- MS-660 - add ubuntu_build_deps.sh
J
JinHai-CN 已提交
104
- \#18 - Add all test cases
Z
Zhiru 已提交
105
	
J
jinhai 已提交
106
# Milvus 0.4.0 (2019-09-12)
Z
zhiru 已提交
107 108

## Bug
109
- MS-119 - The problem of combining the log files
H
Heisenberg 已提交
110
- MS-121 - The problem that user can't change the time zone
W
wxyu 已提交
111 112
- MS-411 - Fix metric unittest linking error
- MS-412 - Fix gpu cache logical error
113
- MS-416 - ExecutionEngineImpl::GpuCache has not return value cause crash
114
- MS-417 - YAML sequence load disable cause scheduler startup failed
115
- MS-413 - Create index failed and server exited
116
- MS-427 - Describe index error after drop index
117
- MS-432 - Search vectors params nprobe need to check max number
118 119
- MS-431 - Search vectors params nprobe: 0/-1, expected result: raise exception
- MS-331 - Crate Table : when table exists, error code is META_FAILED(code=15) rather than ILLEGAL TABLE NAME(code=9))
120
- MS-430 - Search no result if index created with FLAT
S
starlord 已提交
121
- MS-443 - Create index hang again
122
- MS-436 - Delete vectors failed if index created with index_type: IVF_FLAT/IVF_SQ8
123
- MS-449 - Add vectors twice success, once with ids, the other no ids
124 125
- MS-450 - server hang after run stop_server.sh
- MS-458 - Keep building index for one file when no gpu resource
S
starlord 已提交
126
- MS-461 - Mysql meta unittest failed
127
- MS-462 - Run milvus server twices, should display error
Y
Yu Kun 已提交
128
- MS-463 - Search timeout
Z
zhiru 已提交
129
- MS-467 - mysql db test failed
130
- MS-470 - Drop index success, which table not created
S
starlord 已提交
131
- MS-471 - code coverage run failed
132
- MS-492 - Drop index failed if index have been created with index_type: FLAT
X
xj.lin 已提交
133
- MS-493 - Knowhere unittest crash
134
- MS-453 - GPU search error when nprobe set more than 1024
135
- MS-474 - Create index hang if use branch-0.3.1 server config
136
- MS-510 - unittest out of memory and crashed
137
- MS-507 - Dataset 10m-512, index type sq8,performance in-normal when set CPU_CACHE to 16 or 64
138
- MS-543 - SearchTask fail without exception
139
- MS-582 - grafana displays changes frequently
Z
zhiru 已提交
140 141

## Improvement
S
starlord 已提交
142
- MS-327 - Clean code for milvus
S
starlord 已提交
143 144 145 146
- MS-336 - Scheduler interface
- MS-344 - Add TaskTable Test
- MS-345 - Add Node Test
- MS-346 - Add some implementation of scheduler to solve compile error
S
starlord 已提交
147
- MS-348 - Add ResourceFactory Test
S
starlord 已提交
148
- MS-350 - Remove knowhere submodule
149
- MS-354 - Add task class and interface in scheduler
150
- MS-355 - Add copy interface in ExcutionEngine
W
wxyu 已提交
151
- MS-357 - Add minimum schedule function
W
wxyu 已提交
152
- MS-359 - Add cost test in new scheduler
W
wxyu 已提交
153
- MS-361 - Add event in resource
W
wxyu 已提交
154
- MS-364 - Modify tasktableitem in tasktable
155
- MS-365 - Use tasktableitemptr instead in event
W
wxyu 已提交
156
- MS-366 - Implement TaskTable
W
wxyu 已提交
157
- MS-368 - Implement cost.cpp
W
wxyu 已提交
158
- MS-371 - Add TaskTableUpdatedEvent
W
wxyu 已提交
159
- MS-373 - Add resource test
W
wxyu 已提交
160
- MS-374 - Add action definition
W
wxyu 已提交
161
- MS-375 - Add Dump implementation for Event
162
- MS-376 - Add loader and executor enable flag in Resource avoid diskresource execute task
163
- MS-377 - Improve process thread trigger in ResourceMgr, Scheduler and TaskTable
164
- MS-378 - Debug and Update normal_test in scheduler unittest
165
- MS-379 - Add Dump implementation in Resource
166
- MS-380 - Update resource loader and executor, work util all finished
167
- MS-383 - Modify condition variable usage in scheduler
168
- MS-384 - Add global instance of ResourceMgr and Scheduler
W
wxyu 已提交
169
- MS-389 - Add clone interface in Task
W
wxyu 已提交
170
- MS-390 - Update resource construct function
171
- MS-391 - Add PushTaskToNeighbourHasExecutor action
W
wxyu 已提交
172
- MS-394 - Update scheduler unittest
173
- MS-400 - Add timestamp record in task state change function
174
- MS-402 - Add dump implementation for TaskTableItem
S
starlord 已提交
175
- MS-406 - Add table flag for meta
Y
Yu Kun 已提交
176
- MS-403 - Add GpuCacheMgr
177
- MS-404 - Release index after search task done avoid memory increment continues
W
wxyu 已提交
178
- MS-405 - Add delete task support
Y
Yu Kun 已提交
179
- MS-407 - Reconstruct MetricsCollector
180
- MS-408 - Add device_id in resource construct function
W
wxyu 已提交
181
- MS-409 - Using new scheduler
S
starlord 已提交
182
- MS-413 - Remove thrift dependency
W
wxyu 已提交
183
- MS-410 - Add resource config comment
W
wxyu 已提交
184
- MS-414 - Add TaskType in Scheduler::Task
185
- MS-415 - Add command tasktable to dump all tasktables
186
- MS-418 - Update server_config.template file, set CPU compute only default
187
- MS-419 - Move index_file_size from IndexParam to TableSchema
W
wxyu 已提交
188
- MS-421 - Add TaskLabel in scheduler
189
- MS-422 - Support DeleteTask in Multi-GpuResource case
190
- MS-428 - Add PushTaskByDataLocality in scheduler
Y
Yu Kun 已提交
191
- MS-440 - Add DumpTaskTables in sdk
X
xj.lin 已提交
192
- MS-442 - Merge Knowhere
193
- MS-445 - Rename CopyCompleted to LoadCompleted
194
- MS-451 - Update server_config.template file, set GPU compute default
Y
Yu Kun 已提交
195
- MS-455 - Distribute tasks by minimal cost in scheduler
196
- MS-460 - Put transport speed as weight when choosing neighbour to execute task
197
- MS-459 - Add cache for pick function in tasktable
X
xj.lin 已提交
198
- MS-476 - Improve search performance
Y
Yu Kun 已提交
199
- MS-482 - Change search stream transport to unary in grpc
200
- MS-487 - Define metric type in CreateTable
W
wxyu 已提交
201
- MS-488 - Improve code format in scheduler
Z
update  
zhiru 已提交
202
- MS-495 - cmake: integrated knowhere
203
- MS-496 - Change the top_k limitation from 1024 to 2048
W
wxyu 已提交
204
- MS-502 - Update tasktable_test in scheduler
W
wxyu 已提交
205
- MS-504 - Update node_test in scheduler
206
- MS-505 - Install core unit test and add to coverage
W
wxyu 已提交
207
- MS-508 - Update normal_test in scheduler
Y
Yu Kun 已提交
208
- MS-532 - Add grpc server unittest
W
wxyu 已提交
209
- MS-511 - Update resource_test in scheduler
210
- MS-517 - Update resource_mgr_test in scheduler
W
wxyu 已提交
211
- MS-518 - Add schedinst_test in scheduler
W
wxyu 已提交
212
- MS-519 - Add event_test in scheduler
W
wxyu 已提交
213
- MS-520 - Update resource_test in scheduler
214
- MS-524 - Add some unittest in event_test and resource_test
215
- MS-525 - Disable parallel reduce in SearchTask
216
- MS-527 - Update scheduler_test and enable it
W
wxyu 已提交
217
- MS-528 - Hide some config used future
W
wxyu 已提交
218
- MS-530 - Add unittest for SearchTask->Load
W
wxyu 已提交
219
- MS-531 - Disable next version code
220
- MS-533 - Update resource_test to cover dump function
Z
zhiru 已提交
221
- MS-523 - Config file validation
W
wxyu 已提交
222
- MS-539 - Remove old task code
W
wxyu 已提交
223
- MS-546 - Add simple mode resource_config
224
- MS-570 - Add prometheus docker-compose file
Y
Yu Kun 已提交
225
- MS-576 - Scheduler refactor
226
- MS-592 - Change showtables stream transport to unary
Z
zhiru 已提交
227

J
JinHai-CN 已提交
228
## Feature
S
starlord 已提交
229
- MS-343 - Implement ResourceMgr
S
starlord 已提交
230 231 232
- MS-338 - NewAPI: refine code to support CreateIndex
- MS-339 - NewAPI: refine code to support DropIndex
- MS-340 - NewAPI: implement DescribeIndex
Z
zhiru 已提交
233 234 235

## Task
- MS-297 - disable mysql unit test
236 237 238 239 240

# Milvus 0.3.1 (2019-07-10)

## Bug

Z
zhiru 已提交
241 242
- MS-148 - Disable cleanup if mode is read only
- MS-149 - Fixed searching only one index file issue in distributed mode
243 244 245
- MS-153 - Fix c_str error when connecting to MySQL
- MS-157 - Fix changelog
- MS-190 - Use env variable to switch mem manager and fix cmake
S
starlord 已提交
246
- MS-217 - Fix SQ8 row count bug
247
- MS-224 - Return AlreadyExist status in MySQLMetaImpl::CreateTable if table already exists
248 249 250
- MS-232 - Add MySQLMetaImpl::UpdateTableFilesToIndex and set maximum_memory to default if config value = 0
- MS-233 - Remove mem manager log
- MS-230 - Change parameter name: Maximum_memory to insert_buffer_size
251
- MS-234 - Some case cause background merge thread stop
S
starlord 已提交
252
- MS-235 - Some test cases random fail
Z
zhiru 已提交
253
- MS-236 - Add MySQLMetaImpl::HasNonIndexFiles
Y
yudong.cai 已提交
254
- MS-257 - Update bzip2 download url
X
xj.lin 已提交
255
- MS-288 - Update compile scripts
256
- MS-330 - Stability test failed caused by server core dumped
S
starlord 已提交
257 258
- MS-347 - Build index hangs again
- MS-382 - fix MySQLMetaImpl::CleanUpFilesWithTTL unknown column bug
Z
zhiru 已提交
259

260
## Improvement
261
- MS-156 - Add unittest for merge result functions
Z
zhiru 已提交
262
- MS-152 - Delete assert in MySQLMetaImpl and change MySQLConnectionPool impl
S
starlord 已提交
263
- MS-204 - Support multi db_path
S
starlord 已提交
264
- MS-206 - Support SQ8 index type
265
- MS-208 - Add buildinde interface for C++ SDK
266
- MS-212 - Support Inner product metric type
Z
zhiru 已提交
267
- MS-241 - Build Faiss with MKL if using Intel CPU; else build with OpenBlas
268 269
- MS-242 - Clean up cmake and change MAKE_BUILD_ARGS to be user defined variable
- MS-245 - Improve search result transfer performance
Y
yudong.cai 已提交
270
- MS-248 - Support AddVector/SearchVector profiling
S
starlord 已提交
271
- MS-256 - Add more cache config
S
starlord 已提交
272
- MS-260 - Refine log
273
- MS-249 - Check machine hardware during initialize
274
- MS-261 - Update faiss version to 1.5.3 and add BUILD_FAISS_WITH_MKL as an option
275 276
- MS-266 - Improve topk reduce time by using multi-threads
- MS-275 - Avoid sqlite logic error excetion
Z
zhiru 已提交
277
- MS-278 - add IndexStatsHelper
Z
zhiru 已提交
278
- MS-313 - add GRPC
K
kun yu 已提交
279
- MS-325 - add grpc status return for C++ sdk and modify some format
280
- MS-278 - Add IndexStatsHelper
281
- MS-312 - Set openmp thread number by config
282 283 284
- MS-305 - Add CPU core percent metric
- MS-310 - Add milvus CPU utilization ratio and CPU/GPU temperature metrics
- MS-324 - Show error when there is not enough gpu memory to build index
285
- MS-328 - Check metric type on server start
Y
Yu Kun 已提交
286
- MS-332 - Set grpc and thrift server run concurrently
S
starlord 已提交
287
- MS-352 - Add hybrid index
Z
zhiru 已提交
288

J
JinHai-CN 已提交
289
## Feature
Z
zhiru 已提交
290
- MS-180 - Add new mem manager
291
- MS-195 - Add nlist and use_blas_threshold conf
J
jinhai 已提交
292
- MS-137 - Integrate knowhere
293

294 295 296
## Task

- MS-125 - Create 0.3.1 release branch
Q
quicksilver 已提交
297
- MS-306 - Optimize build efficiency
298 299

# Milvus 0.3.0 (2019-06-30)
J
jinhai 已提交
300

J
jinhai 已提交
301
## Bug
302
- MS-104 - Fix unittest lcov execution error
Q
quicksilver 已提交
303
- MS-102 - Fix build script file condition error
G
groot 已提交
304
- MS-80 - Fix server hang issue
W
wxyu 已提交
305
- MS-89 - Fix compile failed, libgpufaiss.a link missing
306
- MS-90 - Fix arch match incorrect on ARM
307
- MS-99 - Fix compilation bug
G
groot 已提交
308
- MS-110 - Avoid huge file size
J
jinhai 已提交
309

J
jinhai 已提交
310
## Improvement
J
jinhai 已提交
311 312
- MS-82 - Update server startup welcome message
- MS-83 - Update vecwise to Milvus
G
groot 已提交
313
- MS-77 - Performance issue of post-search action
G
groot 已提交
314
- MS-22 - Enhancement for MemVector size control 
315
- MS-92 - Unify behavior of debug and release build
316
- MS-98 - Install all unit test to installation directory
Y
yu yunfeng 已提交
317
- MS-115 - Change is_startup of metric_config switch from true to on
G
groot 已提交
318
- MS-122 - Archive criteria config 
G
groot 已提交
319
- MS-124 - HasTable interface
G
groot 已提交
320
- MS-126 - Add more error code
G
groot 已提交
321
- MS-128 - Change default db path
G
groot 已提交
322

J
JinHai-CN 已提交
323
## Feature
J
jinhai 已提交
324

G
groot 已提交
325
- MS-57 - Implement index load/search pipeline
326
- MS-56 - Add version information when server is started
G
groot 已提交
327 328
- MS-64 - Different table can have different index type
- MS-52 - Return search score
G
groot 已提交
329
- MS-66 - Support time range query
Z
zhiru 已提交
330
- MS-68 - Remove rocksdb from third-party
Z
zhiru 已提交
331
- MS-70 - cmake: remove redundant libs in src
Z
zhiru 已提交
332
- MS-71 - cmake: fix faiss dependency
Z
zhiru 已提交
333
- MS-72 - cmake: change prometheus source to git
Z
zhiru 已提交
334
- MS-73 - cmake: delete civetweb
G
groot 已提交
335 336
- MS-65 - Implement GetTableRowCount interface
- MS-45 - Implement DeleteTable interface
337
- MS-75 - cmake: change faiss version to 1.5.2; add CUDA gencode
Z
zhiru 已提交
338
- MS-81 - fix faiss ptx issue; change cuda gencode
Z
zhiru 已提交
339
- MS-84 - cmake: add arrow, jemalloc and jsoncons third party; default build option OFF
Y
yu yunfeng 已提交
340
- MS-85 - add NetIO metric
341
- MS-96 - add new query interface for specified files
342
- MS-97 - Add S3 SDK for MinIO Storage
Z
zhiru 已提交
343
- MS-105 - Add MySQL
Y
yu yunfeng 已提交
344
- MS-130 - Add prometheus_test
Y
yu yunfeng 已提交
345
- MS-144 - Add nprobe config
Y
yu yunfeng 已提交
346
- MS-147 - Enable IVF
Y
yu yunfeng 已提交
347
- MS-130 - Add prometheus_test
S
starlord 已提交
348

J
jinhai 已提交
349
## Task
Z
zhiru 已提交
350
- MS-74 - Change README.md in cpp
W
wxyu 已提交
351
- MS-88 - Add support for arm architecture
J
jinhai 已提交
352

G
groot 已提交
353
# Milvus 0.2.0 (2019-05-31)
J
jinhai 已提交
354 355 356 357 358

## Bug

- MS-32 - Fix thrift error
- MS-34 - Fix prometheus-cpp thirdparty
G
groot 已提交
359
- MS-67 - Fix license check bug
G
groot 已提交
360
- MS-76 - Fix pipeline crash bug
Z
zhiru 已提交
361
- MS-100 - cmake: fix AWS build issue
Z
zhiru 已提交
362
- MS-101 - change AWS build type to Release
J
jinhai 已提交
363 364 365 366 367

## Improvement

- MS-20 - Clean Code Part 1

J
JinHai-CN 已提交
368
## Feature
J
jinhai 已提交
369

X
Xu Peng 已提交
370
- MS-5 - Implement Auto Archive Feature
G
groot 已提交
371
- MS-6 - Implement SDK interface part 1
J
jinhai 已提交
372
- MS-16 - Implement metrics without prometheus
G
groot 已提交
373
- MS-21 - Implement SDK interface part 2
Z
zhiru 已提交
374
- MS-26 - cmake. Add thirdparty packages
Z
zhiru 已提交
375
- MS-31 - cmake: add prometheus
Z
zhiru 已提交
376
- MS-33 - cmake: add -j4 to make third party packages build faster
X
xj.lin 已提交
377
- MS-27 - support gpu config and disable license build config in cmake
Y
yu yunfeng 已提交
378
- MS-47 - Add query vps metrics
J
jinhai 已提交
379 380
- MS-37 - Add query, cache usage, disk write speed and file data size metrics
- MS-30 - Use faiss v1.5.2
381
- MS-54 - cmake: Change Thrift third party URL to github.com
Y
yu yunfeng 已提交
382
- MS-69 - prometheus: add all proposed metrics
G
groot 已提交
383

J
jinhai 已提交
384
## Task
J
jinhai 已提交
385

386
- MS-1 - Add CHANGELOG.md
X
Xu Peng 已提交
387
- MS-4 - Refactor the vecwise_engine code structure
X
Xu Peng 已提交
388
- MS-62 - Search range to all if no date specified