* add NGT index
Signed-off-by: Nfenglv <fenglv15@mails.ucas.ac.cn>

* Add web server interface
Signed-off-by: Nfishpenguin <kun.yu@zilliz.com>

* Add unittest/server
Signed-off-by: Nfishpenguin <kun.yu@zilliz.com>

* Add web server ut
Signed-off-by: Nfishpenguin <kun.yu@zilliz.com>

* update change log and make clang-format
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* remove sq8nr_nm
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* update changelog
Signed-off-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Nsahuang <xiaohai.xu@zilliz.com>
Co-authored-by: Nshengjun.li <shengjun.li@zilliz.com>

* combine the hnsw's implemention of faiss and hnswlib
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* transplant the datastructure of hnsw from hnswlib 2 faiss
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* basic work finished, pass compile, to be tested
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* rhnswflat, rhnswsq, rhnswpq pass ut
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* remove AssertAnns of RHNSWPQ because PQ has accuracy loss
Signed-off-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Nshengjun.li <shengjun.li@zilliz.com>

* clean code first stage
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* rename some files
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* rename
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* typo
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix update index size
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* add GetSize() interface 4 SPTAG
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix index size of index hnsw, annoy and nsg
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix clang
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* add sdk 4 non-ivf index test
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* remove std::cout and make clang-format
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix cout
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* checkout sdk
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix binary ivf
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* fix hnsw
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Nshengjun.li <shengjun.li@zilliz.com>

* modify for SQ8
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* add hnsw-sq8-support
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* make clang-format and update changelog
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix lint error
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* hide unittest error temporary
Signed-off-by: Ncmli <chengming.li@zilliz.com>

* fix ut error
Signed-off-by: Ncmli <chengming.li@zilliz.com>
Co-authored-by: Nshengjun.li <shengjun.li@zilliz.com>
Co-authored-by: Ncmli <chengming.li@zilliz.com>

* replace table with collection in http module
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add search_by_ids in http module
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add API
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add new API and unittest
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Update endpoint in http module(#2186); change vector id to string format(2185)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* allow filter when show partition
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* move constant variables defination to .cpp
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* rename table to collection
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* rename collection
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* rename
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* Update change log
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>
Co-authored-by: NJinHai-CN <hai.jin@zilliz.com>

* fix stash conflict
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Log config information and device information (fix #1893)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Add index annoy into http module (fix #1882)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* Refactor log on search and insert request (fix #1886)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* use vsnprintf to avoid oom
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix PR Quality problem & remove surplus comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* code format
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* replace strlen with strnlen & remove some surplus comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* format
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add sub/super-structure in http module
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update http test case
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add Superstructure/Substructure in http module (fix #1784)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add sign-off
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add index HNSW in http module
Signed-off-by: NYhz <yinghao.zou@zilliz.com>
Co-authored-by: NJin Hai <hai.jin@zilliz.com>

* add new http api
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [DOC] modify comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* allow get whole tables & partitions
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add test case
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update changlog (fix #1461)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* format
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix cpu build issue
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix unittest fail on cpu version
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix get system config bug
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix crash when show tables
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix check server restart fail
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* remove some comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add count field into segment ids
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* optimize code fixing codegacy
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add default response string value
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* finish configure modifiable and some take effect runtime
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* move test file to unittet folder
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add test case for cofig
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix format issue
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* optimize callback
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix error when get config by http in CPU mode
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update callback map
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* correct typo
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update callback register
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add identity in registers
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add identity in FaissPass class
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add comments at cmd test if fail
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* remove some comments and add test for validate storage path
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* format pass
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* remove endpoint info and update CORS
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add test case in web module to test drop a non-existent table
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* optimize config store
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add check code in config
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add scheduler gpu handler
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update optimizer faiss pass
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add default value of gpu_enable_ in GpuCacheMgr
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* optimize code: remove comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* format pass
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add gpu macro in optimizer handler module to fix compile bug on cpu version
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* change cache setting unit  bytes
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* rename variables
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* #1240 Update license declaration of each files
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* #1240 Update CHANGELOG
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* change gpu resources invoke way to cmd()

* set advanced config name add DEFAULT

* change config setting to cmd

* modify ..

* optimize code

* assign TableDto' count default value 0 (fix #995)

* check if table exists when show partitions (fix #1028)

* check table exists when drop partition (fix #1029)

* check if partition name is legal (fix #1022)

* modify status code when partition tag is illegal

* update changlog

* add info to /system url

* add binary index and add bin uri & handler method(not completed)

* optimize http insert and search time(fix #1066) | add binary vectors support(fix #1067)

* fix test partition bug

* fix test bug when check insert records

* add binary vectors test

* add default for offset and page_size

* fix uinttest bug

* [skip ci] remove comments

* optimize web code for PR comments

* add new folder named utils
Co-authored-by: Njielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: NJackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: NCai Yudong <yudong.cai@zilliz.com>

* refactoring(create_table done)

* refactoring

* refactor server delivery (insert done)

* refactoring server module (count_table done)

* server refactor done

* cmake pass

* refactor server module done.

* set grpc response status correctly

* format done.

* fix redefine ErrorMap()

* optimize insert reducing ids data copy

* optimize grpc request with reducing data copy

* clang format

* [skip ci] Refactor server module done. update changlog. prepare for PR

* remove explicit and change int32_t to int64_t

* add web server

* [skip ci] add license in web module

* modify header include & comment oatpp environment config

* add port configure & create table in handler

* modify web url

* simple url complation done & add swagger

* make sure web url

* web functionality done. debuging

* add web unittest

* web test pass

* add web server port

* add web server port in template

* update unittest cmake file

* change web server default port to 19121

* rename method in web module & unittest pass

* add search case in unittest for web module

* rename some variables

* fix bug

* unittest pass

* web prepare

* fix cmd bug(check server status)

* update changlog

* add web port validate & default set

* clang-format pass

* add web port test in unittest

* add CORS & redirect root to swagger ui

* add web status

* web table method func cascade test pass

* add config url in web module

* modify thirdparty cmake to avoid building oatpp test

* clang format

* update changlog

* add constants in web module

* reserve Config.cpp

* fix constants reference bug

* replace web server with async module

* modify component to support async

* format

* developing controller & add test clent into unittest

* add web port into demo/server_config

* modify thirdparty cmake to allow build test

* remove  unnecessary comment

* add endpoint info in controller

* finish web test(bug here)

* clang format

* add web test cpp to lint exclusions

* check null field in GetConfig

* add macro RETURN STATUS DTo

* fix cmake conflict

* fix crash when exit server

* remove surplus comments & add http param check

* add uri /docs to direct swagger

* format

* change cmd to system

* add default value & unittest in web module

* add macros to judge if GPU supported

* add macros in unit & add default in index dto & print error message when bind http port fail

* format (fix #788)

* fix cors bug (not completed)

* comment cors

* change web framework to simple api

* comments optimize

* change to simple API

* remove comments in controller.hpp

* remove EP_COMMON_CMAKE_ARGS in oatpp and oatpp-swagger

* add ep cmake args to sqlite

* clang-format

* change a format

* test pass

* change name to

* fix compiler issue(oatpp-swagger depend on oatpp)

* add & in start_server.h

* specify lib location with oatpp and oatpp-swagger

* add comments

* add swagger definition

* [skip ci] change http method options status code

* remove oatpp swagger(fix #970)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* [skip ci] Fix some broken links (#960)

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken link

* [skip ci] Fix broken links

* fix issue 373 (#964)

* fix issue 373

* Adjustment format

* Adjustment format

* Adjustment format

* change readme

* #966 update NOTICE.md (#967)

* remove comments

* check Start web behavior

* add default to cpu_cache_capacity

* remove swagger component.hpp & /docs url

* remove /docs info

* remove /docs in unittest

* remove space in test rpc

* remove repeate info in CHANGLOG

* change cache_insert_data default value as a constant

* adjust web port cofig place

* rename web_port variable

* set advanced config name add DEFAULT
Co-authored-by: Njielinxu <52057195+jielinxu@users.noreply.github.com>
Co-authored-by: NJackLCL <53512883+JackLCL@users.noreply.github.com>
Co-authored-by: NCai Yudong <yudong.cai@zilliz.com>