提交 · 450573849b9e88825da5c1d6d7945713509f5138 · BaiXuePrincess / milvus

23 3月, 2020 1 次提交

#267 Improve search performance: reduce delay (#1717) · 45057384

由 Jin Hai 提交于 3月 23, 2020

* #267 Improve search performance: reduce delay
Signed-off-by: Njinhai <haijin.chn@gmail.com>

* #267 Improve search performance: reduce delay - update CHANGELOG
Signed-off-by: Njinhai <haijin.chn@gmail.com>

* #267 Update
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* #267 Update
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* #267 Update
Signed-off-by: Njinhai <hai.jin@zilliz.com>

* #267 Update format
Signed-off-by: NJinHai-CN <hai.jin@zilliz.com>

45057384

21 3月, 2020 1 次提交
- J
  #1719 Remove unused log (#1720) · 9443af3e
  由 Jin Hai 提交于 3月 21, 2020
```
Signed-off-by: Njinhai <hai.jin@zilliz.com>
```
  9443af3e
20 3月, 2020 3 次提交

Mishards 070 (#1699) · 3c3617fd

由 BossZou 提交于 3月 20, 2020

* update mishards to 0.7.0
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update mishards to 0.7.0
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix search bug and example pass
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add new api
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add segment stat
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix table info issue
Signed-off-by: Nyhz <413554850@qq.com>

* fix mishards api issue
Signed-off-by: Nyhz <413554850@qq.com>

* update mishards
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update all_in_one docker images
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix delete_by_id param parser & remove some comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update yaml config file
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update all_in_one config
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* remove delete_by_range comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update cmd api
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add warning when search
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update service_handler
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update shrads requiremtns
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* [skip ci] remove surplus log info
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

3c3617fd

#1686 API search_in_files cannot work correctly when vectors is store… (#1701) · fe2595fa

由 groot 提交于 3月 20, 2020

* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition
Signed-off-by: Nyhmo <yihua.mo@zilliz.com>

* #1686 API search_in_files cannot work correctly when vectors is stored in certain non-default partition
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

fe2595fa

#1678 remove CUSTOMIZATION macro (#1707) · 5950dedd

由 Cai Yudong 提交于 3月 20, 2020

* #1678 remove CUSTOMIZATION macro
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* disable faiss_benchmark
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

5950dedd

19 3月, 2020 5 次提交

Caiyd refactor knowhere (#1687) · 588ef95d

由 Cai Yudong 提交于 3月 19, 2020

* add new knowhere
Signed-off-by: NNicky <nicky.xj.lin@gmail.com>

* build pass
Signed-off-by: Nxiaojun.lin <xiaojun.lin@zilliz.com>

* update
Signed-off-by: NNicky <nicky.xj.lin@gmail.com>

* update
Signed-off-by: NNicky <nicky.xj.lin@gmail.com>

* rename algo
Signed-off-by: NNicky <nicky.xj.lin@gmail.com>

* update...
Signed-off-by: Nxiaojun.lin <xiaojun.lin@zilliz.com>

* add archive
Signed-off-by: NNicky <nicky.xj.lin@gmail.com>

* add new APIs: GetVectorById/SearchVectorById/SetBlacklist/GetBlacklist

* update unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* all unittest pass
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* test_binary pass
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* move knowhere into namespace milvus
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update hnsw
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update ConfAdapterMgr
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update ExecutionEngineImpl
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* move SetBlacklist/GetBlacklist to VecIndex
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update VectorAdapter and rename SearchById to QueryById
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update interface in ExecutionEngineImpl
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* milvus build pass
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* milvus IDMAP sdk_simple pass
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix test_server
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix test_schedule
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix CPU version Milvus build issue
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update BinaryIVF BuildAll
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update VecIndexFactory
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update ConfAdapter
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix clang-format
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix clang-format
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* update changelog
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix knowhere unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix SPTAG unittest

* fix clang-format
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix CPU version unittest build issue
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix db_test
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix test_engine
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix test_delete
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix CPU version build issue
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* change BinarySet key back
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* change IndexType to string, and add compatible API for 0.7.0
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix IndexHNSW build warning
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix clang-format
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix test_cache
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix write_index error
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* code clean
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* fix unittest
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>
Co-authored-by: NNicky <nicky.xj.lin@gmail.com>
Co-authored-by: Nxiaojun.lin <xiaojun.lin@zilliz.com>

588ef95d

S
modify bitset from deque to vector (#1696) · 72ad100a
由 shengjun.li 提交于 3月 19, 2020
```
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>
```
72ad100a

#1660 support IVFPQ CPU delete (#1695) · fdd51400

由 op-hunter 提交于 3月 19, 2020

* support IVFPQ CPU delete
Signed-off-by: Nlichengming <chengming.li@zilliz.com>

* update CHANGELOG.md
Signed-off-by: Nlichengming <chengming.li@zilliz.com>
Co-authored-by: Nlichengming <chengming.li@zilliz.com>

fdd51400

Optimize config cpu_cache_capacity / gpu_cache_capacity setter (#1572) (#1629) · 504a9e30

由 BossZou 提交于 3月 19, 2020

* add gpu cache config handler
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* remove cpu/gpu cache mgr from Config class by using cache config handler (fix #1572)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* remove 0.8.0 from config version map
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* clean config header reference
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix bug in web readme
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* reduce gpu config handler to gpu resources handler
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* add engine config
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* modify handler hook(fix #1572)
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* update changlog
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* initalize value in handler by config default
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* code style format
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* fix compile error in release mode
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* resolve faiss blas threshold init in DBWrapper
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* modify cache header
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* remove comments
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* order headers
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* convert gpu res config to lower case
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* CI retry
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* adjust header order in cpu cache mar file
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* improve config test case
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

* code format
Signed-off-by: NYhz <yinghao.zou@zilliz.com>

504a9e30

Add more information to INSTALL.md (#1694) · 616fd136

由 Lutkin Wang 提交于 3月 19, 2020

* [skip ci] Update README_CN.md
Signed-off-by: NLutkin Wang <lu.wang@zilliz.com>

* [skip ci] Update INSTALL.md.
Signed-off-by: NLutkin Wang <lu.wang@zilliz.com>

616fd136

18 3月, 2020 2 次提交

#1653 IndexFlat performance improvement for NQ < thread_number (#1690) · 1543f8dc

由 Xiaohai Xu 提交于 3月 18, 2020

* optimize sse
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* optimizer BinaryDistance
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* fix superstructure
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>
Co-authored-by: Nshengjun.li <shengjun.li@zilliz.com>
Co-authored-by: NJin Hai <hai.jin@zilliz.com>

1543f8dc

#1663 PQ index parameter m validation (#1677) · 55ecfd59

由 groot 提交于 3月 18, 2020

* #1663 PQ index parameter m validation
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* typo
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix unittest failure
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* fix unittest failure
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

55ecfd59

17 3月, 2020 5 次提交

L
[skip ci] Update README_CN.md (#1684) · 40044635
由 Lutkin Wang 提交于 3月 17, 2020
```
Signed-off-by: NLutkin Wang <lu.wang@zilliz.com>
```
40044635
X
[skip ci](shards): fix #1679 (#1681) · b520e60b
由 XuPeng-SH 提交于 3月 17, 2020
```
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>
```
b520e60b

#1656 Add timeout for whole Jenkins job (#1676) · 8644d341

由 quicksilver 提交于 3月 17, 2020

* Increase memory limit in Jenkins CI
Signed-off-by: Nquicksilver <zhifeng.zhang@zilliz.com>

* Add pod tolerations to slave pods

* Refactor ci/scripts/build.sh

* Refactor ci/scripts/build.sh

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Add timeout for whole Jenkins job

* cuda yum repository temporarily disabled

8644d341

fix: shards/requirements.txt to reduce vulnerabilities (#1680) · bb6ce0ab

由 Snyk bot 提交于 3月 17, 2020

The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-URLLIB3-559452

bb6ce0ab

X
[skip ci](shards): fix low concurrency issue (#1672) · 41736260
由 XuPeng-SH 提交于 3月 17, 2020
```
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>
```
41736260

16 3月, 2020 6 次提交

Add structure cases (#1675) · 21c7b8f0

由 del-zhenwu 提交于 3月 16, 2020

* enable nsg case
Signed-off-by: Nzhenwu <zw@zilliz.com>

* enable sub/superstructure
Signed-off-by: Nzhenwu <zw@zilliz.com>

21c7b8f0

#1653 IndexFlat performance improvement for NQ < thread_number (#1674) · 59dab6cb

由 Xiaohai Xu 提交于 3月 16, 2020

* Optimize index flat L2/IP for SSE
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* parallel optimization
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* fix threshold
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* add changelog
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>

* add changelog
Signed-off-by: Nsahuang <xiaohai.xu@zilliz.com>
Co-authored-by: Nsahuang <xiaohai.xu@zilliz.com>

59dab6cb

#1619 (#1620) · 3de34d38

由 Zhiru Zhu 提交于 3月 16, 2020

* update
Signed-off-by: NZhiru Zhu <zzhu@fandm.edu>

* update
Signed-off-by: NZhiru Zhu <zzhu@fandm.edu>

* update
Signed-off-by: NZhiru Zhu <zzhu@fandm.edu>

3de34d38

D
enable nsg case (#1670) · 51cfc897
由 del-zhenwu 提交于 3月 16, 2020
```
Signed-off-by: Nzhenwu <zw@zilliz.com>
```
51cfc897

Add GUI link to readme (#1669) · 332de079

由 Lutkin Wang 提交于 3月 16, 2020

* [skip ci] Update README.md.
Signed-off-by: NLutkin Wang <lu.wang@zilliz.com>

* [skip ci] Update README_CN.md.
Signed-off-by: NLutkin Wang <lu.wang@zilliz.com>

* [skip ci] Update README_JP.md.
Signed-off-by: NLutkin Wang <lu.wang@zilliz.com>

332de079

#1651 Check validity of dimension when collection metric type is binary one (#1666) · 802d62eb

由 groot 提交于 3月 16, 2020

* #1648 The cache cannot be used all when the type is binary
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1651 Check validity of dimension when collection metric type is binary one
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* typo
Signed-off-by: Nyhmo <yihua.mo@zilliz.com>

802d62eb

15 3月, 2020 1 次提交

#1648 The cache cannot be used all when the type is binary (#1648) · 6c826c13

由 groot 提交于 3月 15, 2020

* #1648 The cache cannot be used all when the type is binary
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

* #1646 The cache cannot be used all when the type is binary
Signed-off-by: Ngroot <yihua.mo@zilliz.com>

6c826c13

14 3月, 2020 4 次提交

Refactor CI workflow (#1657) · 1b60e3bc

由 quicksilver 提交于 3月 14, 2020

* Increase memory limit in Jenkins CI
Signed-off-by: Nquicksilver <zhifeng.zhang@zilliz.com>

* Add pod tolerations to slave pods

* Refactor ci/scripts/build.sh

* Refactor ci/scripts/build.sh

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

* Refactor CI

1b60e3bc

#1649 fix Milvus crash on old cpu (#1652) · 512fe623

由 Cai Yudong 提交于 3月 14, 2020

* #1649 fix Milvus crash on old cpu
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* #1649 update debug log
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

* retry CI
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>

512fe623

[skip ci] (shards) Upgrade Mishards for #1569 (#1570) · 5f2f8bdc

由 XuPeng-SH 提交于 3月 14, 2020

* [skip ci](shards): export MAX_WORKERS as configurable parameter
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): skip mishards .env git info
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): support more robust static discovery host configuration
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): update static provider that terminate server if connection to downstream server error during startup
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add topology.py
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add connection pool
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add topology test
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): refactory using topo
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): refactory static discovery using topo
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): refactory kubernetes discovery using topo
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): add more test for connection pool
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): export 19541 and 19542 for all_in_one demo
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): check version on new connection
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): mock connections
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

* [skip ci](shards): update tests
Signed-off-by: Npeng.xu <peng.xu@zilliz.com>

5f2f8bdc

#1603 BinaryFlat add 2 Metrics: Substructure and Superstructure (#1647) · 4088f5e9

由 shengjun.li 提交于 3月 14, 2020

* add substructure & superstructure
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* support c++sdk by lin.xiaojun
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

* optimizer omp for BinaryFlat; add tutorial
Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>

4088f5e9

13 3月, 2020 4 次提交

skip some cases in http mode (#1633) · b1f0e51d

由 del-zhenwu 提交于 3月 13, 2020

* skip some cases in http mode
Signed-off-by: Ndel-zhenwu <zw@zilliz.com>

* reset config
Signed-off-by: Ndel-zhenwu <zw@zilliz.com>

* fix case for http mode
Signed-off-by: Ndel-zhenwu <zw@zilliz.com>

b1f0e51d

check table lsn (#1622) · 7c3a673b

由 shengjun.li 提交于 3月 13, 2020

Signed-off-by: Nshengjun.li <shengjun.li@zilliz.com>
Co-authored-by: NJin Hai <hai.jin@zilliz.com>

7c3a673b

B
fix demo bug in HTTP doc (fix #1634) (#1640) · dfa25f88
由 BossZou 提交于 3月 13, 2020
```
Signed-off-by: NYhz <yinghao.zou@zilliz.com>
```
dfa25f88
J
Merge pull request #1639 from dvzubarev/fix-crashes · 24c39535
由 Jin Hai 提交于 3月 13, 2020
```
Fix crashes with sptag index
```
24c39535

12 3月, 2020 8 次提交
- D
  fix crashes · 05504188
  由 denin 提交于 3月 12, 2020
```
Signed-off-by: Ndenin <dvzubarev@yandex.ru>
```
  05504188
- J
  Merge pull request #1585 from cydrain/caiyd_1548_move_store · 45c66b3c
  由 Jin Hai 提交于 3月 12, 2020
```
Caiyd 1548 move store
```
  45c66b3c
- Y
  
  Merge remote-tracking branch 'main/master' into caiyd_1548_move_store · 4cf2b2b3
  由 yudong.cai 提交于 3月 12, 2020
  
  4cf2b2b3
- J
  Merge pull request #1638 from youny626/fix#1635 · cedfc84d
  由 Jin Hai 提交于 3月 12, 2020
```
Fix#1635
```
  cedfc84d
- Z
  update · 7ec0444d
  由 Zhiru Zhu 提交于 3月 12, 2020
```
Signed-off-by: NZhiru Zhu <zzhu@fandm.edu>
```
  7ec0444d
- Z
  update · 7ac4e95e
  由 Zhiru Zhu 提交于 3月 12, 2020
```
Signed-off-by: NZhiru Zhu <zzhu@fandm.edu>
```
  7ac4e95e
- Z
  update · 04f00bbe
  由 Zhiru Zhu 提交于 3月 12, 2020
```
Signed-off-by: NZhiru Zhu <zzhu@fandm.edu>
```
  04f00bbe
- Y
  update header file · 058c993a
  由 yudong.cai 提交于 3月 12, 2020
```
Signed-off-by: Nyudong.cai <yudong.cai@zilliz.com>
```
  058c993a

BaiXuePrincess / milvus 与 Fork 源项目一致

BaiXuePrincess / milvus
与 Fork 源项目一致