* #1929 Skip mysql meta schema field width check
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* typo
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* merge master
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* Improve code quality
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Improve code quality
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Improve code quality
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Fix lint
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Fix compiling error
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Fix compiling error
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Fix compiling error
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Fix issue
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* #1705 Limit the insert data batch size
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* typo
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix unittest
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1910 C++ SDK GetIDsInSegment could not work for large dataset (#1911)
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1903 Fix invalid annoy result (#1912)
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* #1914: Partition max size should be 4096 (#1915)
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* add log (#1913)

* add log
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* add log
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix ut
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* partition limit 4096
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix py test
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* update server version (#1916)
Signed-off-by: Nzw <zw@zilliz.com>

* Update to 0.8.0 (#1918)

* Create new branch 0.8.0 and change preload_table to preload_collection
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Fix format
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Update CHANGELOG
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* update helm version
Signed-off-by: Nzw <zw@zilliz.com>

* Update CHANGELOG
Signed-off-by: Njinhai <hai.jin@zilliz.com>
Co-authored-by: Nzw <zw@zilliz.com>

* fix issue 1901 (#1920)

* fix issue 1901
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* update change log
Signed-off-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Ncmli <chengming.li@zilliz.com>

* #1900 (#1923)

* add log
Signed-off-by: Nyhmo <yihua.mo@zilliz.com>

* fix #1900
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* Upgrade mishards to 0.8.0 (#1933)

* update grpc server of milvus & rename table name to collection
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update changlog
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [skip ci] Skip CI
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [skip ci] Update changlog
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Caiyd 1883 fix rw (#1926)

* #1883 use DiskIO
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix logic error
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update changelog
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* retry CI
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* Update CHANGELOG
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* update changelog
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>
Co-authored-by: NJinHai-CN <hai.jin@zilliz.com>

* #1928 Too many data and uid copies when loading files (#1931)
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>
Co-authored-by: NJin Hai <hai.jin@zilliz.com>

* Update mishards configure files (#1938)

* Update web readme
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [skip ci] update configure files
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [skip ci] rename table to collection
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Update test.groovy
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Update test.groovy
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Fix lint
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Fix compiling error
Signed-off-by: Njinhai <hai.jin@zilliz.com>
Co-authored-by: Ngroot <yhmo@zeronedata.com>
Co-authored-by: Nshengjun.li <49774184+shengjun1985@users.noreply.github.com>
Co-authored-by: Ndel-zhenwu <56623710+del-zhenwu@users.noreply.github.com>
Co-authored-by: Nzw <zw@zilliz.com>
Co-authored-by: Nop-hunter <ophunter52@gmail.com>
Co-authored-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: NBossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: NCai Yudong <yudong.cai@zilliz.com>

* update log format
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* add new log macro
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* use new log macro instead
Signed-off-by: NXiangyu Wang <xy.wang@zilliz.com>

* add SetThreadName function
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* clang-format
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* set thread name
Signed-off-by: NXiangyu Wang <xy.wang@zilliz.com>

* add changelog
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* add git ignore .swp file
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* update log level in LogUtil.cpp
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* Create new branch 0.8.0 and change preload_table to preload_collection
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Fix format
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Update CHANGELOG
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Update CHANGELOG
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* update helm version
Signed-off-by: Nzw <zw@zilliz.com>
Co-authored-by: Nzw <zw@zilliz.com>

* add heap_swap_top
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* fix wrong code
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* Fix multi client search crash in tracing module fix #1789 fix #1832
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* add lock for every context_map_ access
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* remove never used variable
Signed-off-by: Nwxyu <xy.wang@zilliz.com>

* #1276 SQLite throw exception when create 50000+ partitions in a table
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1276 SQLite throw exception when create 50000+ partitions in a table
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* remove some log
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* remove some log
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* typo
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* typo
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix unittest
Signed-off-by: Ngroot <yihua.mo@zilliz.com>
Co-authored-by: NJinHai-CN <hai.jin@zilliz.com>

* rename table to collection
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* rename collection
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* rename
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* Update change log
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>
Co-authored-by: NJinHai-CN <hai.jin@zilliz.com>

* optimize knowhere unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* code clean
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* optimize knowhere util
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix clang-format
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update changelog
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix unittest build error
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* retry CI
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>
Co-authored-by: NJin Hai <hai.jin@zilliz.com>

* fix stash conflict
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Log config information and device information (fix #1893)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Add index annoy into http module (fix #1882)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Refactor log on search and insert request (fix #1886)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* use vsnprintf to avoid oom
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix PR Quality problem & remove surplus comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* code format
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* replace strlen with strnlen & remove some surplus comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* format
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* #1881 update storage APIs, use int64_t for size
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update changelog
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* #1873 fix index file serialize to incorrect path
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* not create sq8h index when gpu disabled
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* #1858 disable s3 build
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update changelog
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* disable s3 in unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* skip ci, refactor knowhere inner unittest for annoy and hnsw, which aimed to remove logs of std output
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* skip ci, fix lint error
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix annoy load bugs and add serialize test 4 annoy and hnsw
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* update changelog
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* update lower bound of annoy search_k param
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* lint errorgit add src/utils/ValidationUtil.cpp
Signed-off-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Ncmli <chengming.li@zilliz.com>

* #1627 move read/write index into codec
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix clang-format
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update changelog
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* code optimize
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update WriteVectorIndex
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix clang-format
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* nsg delete
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* fix request
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* Fix clang
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* fix typo
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* [skip ci] add changelog
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* fix test_nsg and changelog
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* fix test
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* fix test case
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* fix clang-format
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* Polish
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* update mishards images to 0.7.1 (fix #1799) (#1802)

* update mishards images to 0.7.1 (fix #1799)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [skip ci] Skip CI
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [skip ci] Update CHANGELOG
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* fix lsn meta bug (#1813)

* fix lsn meta bug
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix mysql lsn meta bug
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* Update CHANGELOG.md (#1814)
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Fix compile (#1815)

* Update CHANGELOG.md
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Update
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Fix compile (#1816)

* Update CHANGELOG.md
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Update
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Update
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Fix compile (#1817)

* Update CHANGELOG.md
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Update
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Update
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Increase Resources
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Decrease the compiling thread
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* #1818 Duplicate data generated after restart milvus server (#1819)

* #1818 Duplicate data generated after restart milvus server
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* set compile thread number
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* [skip-ci]Remove auto flush interval from config (#1837)
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* Fix lint
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Fix compile error
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>
Co-authored-by: NBossZou <40255591+BossZou@users.noreply.github.com>
Co-authored-by: Ngroot <yhmo@zeronedata.com>

* fix bug & solve compile warning from annoylib
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix lint error
Signed-off-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Ncmli <chengming.li@zilliz.com>

Signed-off-by: Nfishpenguin <kun.yu@zilliz.com>

* support GPUIVF delete
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* calc bitset offset correctly
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* support GPUSQ8 delete
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* support GPUIVFPQ delete
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update unittest for GPU delete
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* delete FAISS compile option -DFAISS_USE_FLOAT16
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* code opt
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update changelog
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* add sub/super-structure in http module
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update http test case
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add Superstructure/Substructure in http module (fix #1784)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* Update CHANGLOG.md
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Update
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* Update
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* HasTable with a not exist table name, return error status
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* Server is not forbidden to create new partition which tag is _default
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* add annoy source code
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* add annoy knowhere
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* annoy local gtest passed
Signed-off-by: Nlichengming <chengming.li@zilliz.com>

* fix lint error and update changelog
Signed-off-by: Nlichengming <chengming.li@zilliz.com>

* fix compile error
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* Update connect timeout in test cases
Signed-off-by: Nzw <zw@milvus.io>

* fix some potential bugs
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* retry ci
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* rerun ci!
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix errors tested by c++ sdk
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix lint error
Signed-off-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Nshengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Nlichengming <chengming.li@zilliz.com>
Co-authored-by: Nzw <zw@milvus.io>

Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* fix
Signed-off-by: NNicky <nicky.xj.lin@gmail.com>

* update.
Signed-off-by: NNicky <nicky.xj.lin@gmail.com>

* lint pass
Signed-off-by: Nxiaojun.lin <xiaojun.lin@zilliz.com>

* UPDATE CASE: search with tag not exist
Signed-off-by: Nzw <zw@zilliz.com>
Co-authored-by: Nzw <zw@zilliz.com>

* modify changelog
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* improve search qps
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* changelog
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix hang bug
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix combine request result bug
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* add unittest for combine request
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix python test failure
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix python test failure
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix unittest failure
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1756 fix memory exhausted during searching
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* #1756 update const names
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update mishards get file ids
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update behaviour for getting file ids
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* check default partition
Signed-off-by: Nyhz <413554850@qq.com>

* remove exception when file id not found
Signed-off-by: Nyhz <413554850@qq.com>

* Optimize behavior to get file ids from metadata in mishards (fix #1754)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [skip ci] Update changlog
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* #1735 fix search fail with gpu out of memory using ivf_flag
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* #1735 add lock for each GpuCacheMgr instance
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* #1735 optimize cache debug info
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* #1735 set smaller cache threshold
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* #1735 update cache debug log
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* #1735 fix cache issue
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* enable IP and fix crash
Signed-off-by: NNicky <nicky.xj.lin@gmail.com>

* update.
Signed-off-by: Nxiaojun.lin <xiaojun.lin@zilliz.com>

* lint pass
Signed-off-by: Nxiaojun.lin <xiaojun.lin@zilliz.com>

Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1724 Remove unused unittests
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part2
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part3
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part4
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

* #1724 Remove unused unittests - part5
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>