README.md 5.5 KB
Newer Older
J
jielin.xu 已提交
1
# Welcome to Milvus
G
groot 已提交
2

J
jielin.xu 已提交
3
Firstly, welcome, and thanks for your interest in [Milvus](https://milvus.io)! No matter who you are, what you do, we greatly appreciate your contribution to help us reinvent data science with Milvus.
Z
zhiru 已提交
4

J
jielin.xu 已提交
5
## What is Milvus
Z
zhiru 已提交
6

J
jielin.xu 已提交
7 8 9 10
Milvus is an open source vector search engine that makes incredibly fast querying speed enhancement over current solutions of massive vector processing. Built on optimized indexing algorithm, it is compatible with major AI/ML models.

Milvus was developed by researchers and engineers in ZILLIZ, a tech startup that intends to reinvent data science, with the purpose of providing enterprises with efficient and scalable similarity search and analysis of feature vectors and unstructured data. 

J
jielin.xu 已提交
11
Milvus provides stable Python and C++ APIs, as well as RESTful API.
J
jielin.xu 已提交
12

J
jielin.xu 已提交
13
Keep up-to-date with newest releases and latest updates by reading [Releases](milvus-io/doc/master/releases).
J
jielin.xu 已提交
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48

- GPU-accelerated search engine

  Milvus is designed for the largest scale of vector index. CPU/GPU heterogeneous computing architecture allows you to process data at a speed 1000 times faster.

- Intelligent index

  With a “Decide Your Own Algorithm” approach, you can embed machine learning and advanced algorithms into Milvus without the headache of complex data engineering or migrating data between disparate systems. Milvus is built on optimized indexing algorithm based on quantization indexing, tree-based and graph indexing methods.

- Strong scalability

  The data is stored and computed on a distributed architecture. This lets you scale data sizes up and down without redesigning the system.

## Get started

### Install and start Milvus server

#### Use Docker

Use Docker to install Milvus is a breeze. See the [Milvus install guide](doc/master/userguide/install_milvus.md) for details.

#### Use source code

##### Compilation

###### Step 1 Install necessary tools

```shell
# Install tools
Centos7 : 
$ yum install gfortran qt4 flex bison mysql-devel mysql
    
Ubuntu16.04 : 
$ sudo apt-get install gfortran qt4-qmake flex bison libmysqlclient-dev mysql-client
       
Z
zhiru 已提交
49
```
J
jielin.xu 已提交
50 51 52 53 54 55

Verify the existence of `libmysqlclient_r.so`:

```shell
# Verify existence
$ locate libmysqlclient_r.so
Z
zhiru 已提交
56
```
G
groot 已提交
57

J
jielin.xu 已提交
58
If not, you need to create a symbolic link:
Z
zhiru 已提交
59

J
jielin.xu 已提交
60 61 62 63
```shell
# Create symbolic link
$ sudo ln -s /path/to/libmysqlclient.so /path/to/libmysqlclient_r.so
```
G
groot 已提交
64

J
jielin.xu 已提交
65
###### Step 2 Build
X
MS-154  
xj.lin 已提交
66

J
jielin.xu 已提交
67 68 69 70 71 72 73
```shell
TBD
cd [Milvus sourcecode path]/cpp/thirdparty
git clone git@192.168.1.105:megasearch/knowhere.git
cd knowhere
./build.sh -t Debug
or ./build.sh -t Release
Z
zhiru 已提交
74

J
jielin.xu 已提交
75 76 77 78 79 80
cd [sourcecode path]/cpp
./build.sh -t Debug
or ./build.sh -t Release
```

When the build is completed, all the stuff that you need in order to run Milvus will be installed under `[Milvus root path]/cpp/milvus`.
Z
zhiru 已提交
81

J
jielin.xu 已提交
82 83
If you encounter the following error message,
`protocol https not supported or disabled in libcurl`
Z
zhiru 已提交
84

J
jielin.xu 已提交
85
please reinstall CMake with curl:
Z
zhiru 已提交
86

J
jielin.xu 已提交
87 88
1. Install curl development files:
   ```shell
J
jielin.xu 已提交
89 90 91 92
   CentOS 7:   
   $ yum install curl-devel
   Ubuntu 16.04: 
   $ sudo apt-get install libcurl4-openssl-dev
Z
zhiru 已提交
93
   ```
J
jielin.xu 已提交
94 95 96 97 98 99

2. Install [CMake 3.14](https://github.com/Kitware/CMake/releases/download/v3.14.6/cmake-3.14.6.tar.gz): 
   ```shell
   $ ./bootstrap --system-curl 
   $ make 
   $ sudo make install
Z
zhiru 已提交
100 101
   ```

J
jielin.xu 已提交
102 103 104 105 106 107 108
##### Run unit test

```shell
$ ./build.sh -u
or
$ ./build.sh --unittest
```
Z
zhiru 已提交
109

J
jielin.xu 已提交
110
##### Run code coverage
Z
zhiru 已提交
111

J
jielin.xu 已提交
112 113 114 115 116 117 118 119
```shell
CentOS 7:   
$ yum install lcov
Ubuntu 16.04: 
$ sudo apt-get install lcov
    
$ ./build.sh -u -c
```
G
groot 已提交
120

J
jielin.xu 已提交
121
##### Launch Milvus server
G
groot 已提交
122

J
jielin.xu 已提交
123 124 125
```shell
$ cd [Milvus root path]/cpp/milvus
```
G
groot 已提交
126

J
jielin.xu 已提交
127
Add `lib/` directory to `LD_LIBRARY_PATH`
Z
zhiru 已提交
128 129

```
J
jielin.xu 已提交
130 131 132 133 134
$ export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/path/to/milvus/lib
```

Then start Milvus server:

Z
zhiru 已提交
135
```
J
jielin.xu 已提交
136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204
$ cd scripts
$ ./start_server.sh
```

To stop Milvus server, run:

```shell
$ ./stop_server.sh
```

To edit Milvus settings in `conf/server_config.yaml` and `conf/log_config.conf`, please read [Milvus Configuration](milvus-io/milvus/doc/master/reference/milvus_config.md).

### Try your first Milvus program

#### Run Python example code

Make sure [Python 3.4](https://www.python.org/downloads/) or higher is already installed and in use.

Install Milvus Python SDK.

```shell
# Install Milvus Python SDK
$ pip install pymilvus==0.2.0
```

Create a new file `example.py`, and add [Python example code](https://github.com/milvus-io/pymilvus/blob/branch-0.3.1/examples/AdvancedExample.py) to it.

Run the example code.

```python
# Run Milvus Python example
$ python3 example.py
```

#### Run C++ example code

```shell
 # Run Milvus C++ example
 $ cd [Milvus root path]/cpp/milvus/bin
 $ ./sdk_simple
```

## Contribution guidelines

Contributions are welcomed and greatly appreciated. If you want to contribute to Milvus, please read the [contribution guidelines](CONTRIBUTING.md). This project adheres to the [code of conduct](CODE OF CONDUCT.md) of Milvus. By participating, you are expected to uphold this code.

We use [GitHub issues] to track issues and bugs. For general questions and discussions, please go to [Milvus Forum]. 

## Join the Milvus community

For public discussion of Milvus, please join our [discussion group]. 

## Milvus Roadmap

Please read our [roadmap](milvus-io/milvus/doc/master/roadmap.md) to learn about upcoming features.

## Resources

[Milvus official website](https://milvus.io)

[Milvus docs](https://www.milvus.io/docs/en/QuickStart/)

[Milvus blog](https://www.milvus.io/blog/)

[Milvus CSDN](https://mp.csdn.net/mdeditor/100041006#)

[Milvus roadmap](milvus-io/milvus/doc/master/roadmap.md)

[Milvus white paper]
Z
zhiru 已提交
205

J
jielin.xu 已提交
206
## License
J
jinhai 已提交
207

J
jielin.xu 已提交
208
[Apache 2.0 license](milvus-io/milvus/LICENSE.md)