PaddlePaddle in Docker Containers ================================= Docker container is currently the only officially-supported way to running PaddlePaddle. This is reasonable as Docker now runs on all major operating systems including Linux, Mac OS X, and Windows. Please be aware that you will need to change `Dockers settings `_ to make full use of your hardware resource on Mac OS X and Windows. Development Using Docker ------------------------ Developers can work on PaddlePaddle using Docker. This allows developers to work on different platforms -- Linux, Mac OS X, and Windows -- in a consistent way. The general development workflow with Docker and Bazel is as follows: 1. Get the source code of Paddle: .. code-block:: bash git clone --recursive https://github.com/PaddlePaddle/Paddle.git Here **git clone --recursive is required** as we have a submodule `warp-ctc `_. If you have used :code:`git clone https://github.com/PaddlePaddle/Paddle` and find that the directory :code:`warp-ctc` is empty, please use the following command to get the submodule. .. code-block:: bash git submodule update --init --recursive 2. Build a development Docker image :code:`paddle:dev` from the source code. This image contains all the development tools and dependencies of PaddlePaddle. .. code-block:: bash cd paddle docker build -t paddle:dev -f paddle/scripts/docker/Dockerfile . 3. Run the image as a container and mounting local source code directory into the container. This allows us to change the code on the host and build it within the container. .. code-block:: bash docker run \ -d \ --name paddle \ -p 2022:22 \ -v $PWD:/paddle \ -v $HOME/.cache/bazel:/root/.cache/bazel \ paddle:dev where :code:`-d` makes the container running in background, :code:`--name paddle` allows us to run a nginx container to serve documents in this container, :code:`-p 2022:22` allows us to SSH into this container, :code:`-v $PWD:/paddle` shares the source code on the host with the container, :code:`-v $HOME/.cache/bazel:/root/.cache/bazel` shares Bazel cache on the host with the container. 4. SSH into the container: .. code-block:: bash ssh root@localhost -p 2022 5. We can edit the source code in the container or on this host. Then we can build using cmake .. code-block:: bash cd /paddle # where paddle source code has been mounted into the container mkdir -p build cd build cmake -DWITH_TESTING=ON .. make -j `nproc` CTEST_OUTPUT_ON_FAILURE=1 ctest or Bazel in the container: .. code-block:: bash cd /paddle bazel test ... CPU-only and GPU Images ----------------------- For each version of PaddlePaddle, we release 2 Docker images, a CPU-only one and a CUDA GPU one. We do so by configuring `dockerhub.com `_ automatically runs the following commands: .. code-block:: bash docker build -t paddle:cpu -f paddle/scripts/docker/Dockerfile . docker build -t paddle:gpu -f paddle/scripts/docker/Dockerfile.gpu . To run the CPU-only image as an interactive container: .. code-block:: bash docker run -it --rm paddledev/paddle:cpu-latest /bin/bash or, we can run it as a daemon container .. code-block:: bash docker run -d -p 2202:22 paddledev/paddle:cpu-latest and SSH to this container using password :code:`root`: .. code-block:: bash ssh -p 2202 root@localhost An advantage of using SSH is that we can connect to PaddlePaddle from more than one terminals. For example, one terminal running vi and another one running Python interpreter. Another advantage is that we can run the PaddlePaddle container on a remote server and SSH to it from a laptop. Above methods work with the GPU image too -- just please don't forget to install CUDA driver and let Docker knows about it: .. code-block:: bash export CUDA_SO="$(\ls /usr/lib64/libcuda* | xargs -I{} echo '-v {}:{}') $(\ls /usr/lib64/libnvidia* | xargs -I{} echo '-v {}:{}')" export DEVICES=$(\ls /dev/nvidia* | xargs -I{} echo '--device {}:{}') docker run ${CUDA_SO} ${DEVICES} -it paddledev/paddle:gpu-latest UBUNTU MIRROR ------------- Building Paddle Docker image hits some wrong with apt-get update, you can use other UBUNTU MIRROR instead of the default .. code-block:: bash cd ~ git clone https://github.com/PaddlePaddle/Paddle.git cd Paddle git submodule update --init --recursive docker build --build-arg UBUNTU_MIRROR="http://mirrors.163.com" -t paddle:cpu-avx -f paddle/scripts/docker/Dockerfile . docker build --build-arg UBUNTU_MIRROR="http://mirrors.163.com" -t paddle:gpu-avx -f paddle/scripts/docker/Dockerfile.gpu . Non-AVX Images -------------- Please be aware that the CPU-only and the GPU images both use the AVX instruction set, but old computers produced before 2008 do not support AVX. The following command checks if your Linux computer supports AVX: .. code-block:: bash if cat /proc/cpuinfo | grep -i avx; then echo Yes; else echo No; fi If it doesn't, we will need to build non-AVX images manually from source code: .. code-block:: bash cd ~ git clone https://github.com/PaddlePaddle/Paddle.git cd Paddle git submodule update --init --recursive docker build --build-arg WITH_AVX=OFF -t paddle:cpu-noavx -f paddle/scripts/docker/Dockerfile . docker build --build-arg WITH_AVX=OFF -t paddle:gpu-noavx -f paddle/scripts/docker/Dockerfile.gpu . Documentation ------------- Paddle Docker images include an HTML version of C++ source code generated using `woboq code browser `_. This makes it easy for users to browse and understand the C++ source code. As long as we give the Paddle Docker container a name, we can run an additional Nginx Docker container to serve the volume from the Paddle container: .. code-block:: bash docker run -d --name paddle-cpu-doc paddle:cpu docker run -d --volumes-from paddle-cpu-doc -p 8088:80 nginx Then we can direct our Web browser to the HTML version of source code at http://localhost:8088/paddle/