README.md 10.0 KB
Newer Older
Q
qingqing01 已提交
1

L
LielinJiang 已提交
2
English | [简体中文](./README_cn.md)
3

L
LielinJiang 已提交
4 5
# PaddleGAN

L
LielinJiang 已提交
6
PaddleGAN provides developers with high-performance implementation of classic and SOTA Generative Adversarial Networks, and supports developers to quickly build, train and deploy GANs for academic, entertainment and industrial usage.
7

L
LielinJiang 已提交
8
GAN-Generative Adversarial Network, was praised by "the Father of Convolutional Networks"  **Yann LeCun (Yang Likun)**  as **[One of the most interesting ideas in the field of computer science in the past decade]**. It's the one research area in deep learning that AI researchers are most concerned about.
L
LielinJiang 已提交
9

Q
qingqing01 已提交
10
<div align='center'>
L
LaraStuStu 已提交
11
  <img src='./docs/imgs/ppgan.jpg'>
Q
qingqing01 已提交
12
</div>
L
LielinJiang 已提交
13

L
LaraStuStu 已提交
14
[![License](https://img.shields.io/badge/license-Apache%202-red.svg)](LICENSE)![python version](https://img.shields.io/badge/python-3.6+-orange.svg)
L
LielinJiang 已提交
15

16
## 🎪 Hot Activities
L
LaraStuStu 已提交
17

18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43
- 🔥 **2021.7.9-2021.9** 🔥

  **💙 AI Creation Camp 💙**

  **You can implement any abilities in PaddleGAN with Wechaty to create your own chat robot 🤖 !**

  **A plenty of gifts 🎁 waiting for you!**

  **💰First Prize: 30,000RMB**

  **🎮 Second Prize: PS5**

  **🕶 Third Prize: VR Glass**

  **🏵 Most Popular Prize: 3D Printer**

  **Still hezitating? Click here and sign up!**  **https://aistudio.baidu.com/aistudio/competition/detail/98**

- 2021.4.15~4.22

  GAN 7 Days Course Camp: Baidu Senior Research Developers help you learn the basic and advanced GAN knowledge in 7 days!

  **Courses videos and related materials: https://aistudio.baidu.com/aistudio/course/introduce/16651**

## 🚀 Recent Updates

Y
YixinKristy 已提交
44 45 46 47 48 49 50 51 52
- 👩‍🚀**A Space Odyssey :[LapStyle](./docs/zh_CN/tutorials/lap_style.md) image translation take you travel around the universe**👨‍🚀

  - **[Online Toturials](https://aistudio.baidu.com/aistudio/projectdetail/2343740?contributionType=1)**

    <div align='center'>
      <img src='https://user-images.githubusercontent.com/48054808/133392621-9a552c46-841b-4fe4-bb24-7b0cbf86616c.gif' width='250'/>
      <img src='https://user-images.githubusercontent.com/48054808/133392630-c5329c4c-bc10-406e-a853-812a2b1f0fa6.gif' width='250'/>
      <img src='https://user-images.githubusercontent.com/48054808/133392652-f4811b1e-0676-4402-808b-a4c96c611368.gif' width='250'/>
    </div>
Y
YixinKristy 已提交
53

Y
YixinKristy 已提交
54
- 🧙‍♂️**Latest Creative Project:create magic/dynamic profile for your student ID in Hogwarts** 🧙‍♀️
Y
YixinKristy 已提交
55

Y
YixinKristy 已提交
56
  - **[Online Toturials](https://aistudio.baidu.com/aistudio/projectdetail/2288888?channelType=0&channel=0)**
Y
YixinKristy 已提交
57

Y
YixinKristy 已提交
58 59 60 61
    <div align='center'>
      <img src='https://ai-studio-static-online.cdn.bcebos.com/da1c51844ac048aa8d4fa3151be95215eee75d8bb488409d92ec17285b227c2c' width='250'/>
    </div>
    
62 63 64 65 66 67 68 69 70 71 72 73
- **💞Add Face Morphing function💞: you can perfectly merge any two faces and make the new face get any facial expressions!**

  - Tutorials: https://aistudio.baidu.com/aistudio/projectdetail/2254031

    <div align='center'>
      <img src='https://user-images.githubusercontent.com/48054808/128299870-66a73bb3-57a4-4985-aadc-8ddeab048145.gif' width='300'/>
    </div>

- **Publish a new version of First Oder Motion model by having two impressive features:**
  - High resolution 512x512 
  - Face Enhancement
  - Tutorials: https://github.com/PaddlePaddle/PaddleGAN/blob/develop/docs/zh_CN/tutorials/motion_driving.md 
Y
YixinKristy 已提交
74 75 76 77 78 79 80 81
  
- **New image translation ability--transfer photo into oil painting style:**

  - Complete tutorials for deployment: https://github.com/wzmsltw/PaintTransformer

    <div align='center'>
      <img src='https://user-images.githubusercontent.com/48054808/129904830-8b87e310-ea51-4aff-b29b-88920ee82447.png' width='700'/>
    </div>
L
LaraStuStu 已提交
82

L
LielinJiang 已提交
83
## Quick Start
L
LielinJiang 已提交
84

L
LielinJiang 已提交
85
* Please refer to the [installation document](./docs/en_US/install.md) to make sure you have installed PaddlePaddle and PaddleGAN correctly.
L
LaraStuStu 已提交
86

L
LielinJiang 已提交
87
* Get started through ppgan.app interface:
Q
qingqing01 已提交
88

L
LielinJiang 已提交
89 90 91 92 93 94 95 96
   ```python
   from ppgan.apps import RealSRPredictor
   sr = RealSRPredictor()
   sr.run("docs/imgs/monarch.png")
   ```
* More applications, please refer to [ppgan.apps apis](./docs/en_US/apis/apps.md)
* More tutorials:
  - [Data preparation](./docs/en_US/data_prepare.md)
97
  - [Training/Evaluating/Testing basic usage](./docs/en_US/get_started.md)
Q
qingqing01 已提交
98

L
LielinJiang 已提交
99
## Model Tutorial
Q
qingqing01 已提交
100

L
LielinJiang 已提交
101 102
* [Pixel2Pixel](./docs/en_US/tutorials/pix2pix_cyclegan.md)
* [CycleGAN](./docs/en_US/tutorials/pix2pix_cyclegan.md)
W
wangna11BD 已提交
103
* [LapStyle](./docs/en_US/tutorials/lap_style.md)
L
LielinJiang 已提交
104
* [PSGAN](./docs/en_US/tutorials/psgan.md)
105
* [First Order Motion Model](./docs/en_US/tutorials/motion_driving.md)
L
LielinJiang 已提交
106 107 108
* [FaceParsing](./docs/en_US/tutorials/face_parse.md)
* [AnimeGANv2](./docs/en_US/tutorials/animegan.md)
* [U-GAT-IT](./docs/en_US/tutorials/ugatit.md)
Q
qingqing01 已提交
109
* [Photo2Cartoon](./docs/en_US/tutorials/photo2cartoon.md)
L
lijianshe02 已提交
110
* [Wav2Lip](./docs/en_US/tutorials/wav2lip.md)
W
wangna11BD 已提交
111 112
* [Single Image Super Resolution(SISR)](./docs/en_US/tutorials/single_image_super_resolution.md)
* [Video Super Resolution(VSR)](./docs/en_US/tutorials/video_super_resolution.md)
L
LielinJiang 已提交
113
* [StyleGAN2](./docs/en_US/tutorials/styleganv2.md)
W
wangna11BD 已提交
114
* [Pixel2Style2Pixel](./docs/en_US/tutorials/pixel2style2pixel.md)
L
LielinJiang 已提交
115

Q
qingqing01 已提交
116

L
LielinJiang 已提交
117
## Composite Application
L
LaraStuStu 已提交
118

W
wangna11BD 已提交
119
* [Video restore](./docs/en_US/tutorials/video_restore.md)
L
LaraStuStu 已提交
120

121 122 123 124 125 126
## Online Tutorial

You can run those projects in the [AI Studio](https://aistudio.baidu.com/aistudio/projectoverview/public/1?kw=paddlegan) to learn how to use the models above:

|Online Tutorial      |    link  |
|--------------|-----------|
127
|Motion Driving-multi-personal "Mai-ha-hi" | [Click and Try](https://aistudio.baidu.com/aistudio/projectdetail/1603391) |
128
|Restore the video of Beijing hundreds years ago|[Click and Try](https://aistudio.baidu.com/aistudio/projectdetail/1161285)|
129
|Motion Driving-When "Su Daqiang" sings "unravel" |[Click and Try](https://aistudio.baidu.com/aistudio/projectdetail/1048840)|
130

L
LielinJiang 已提交
131
## Examples
L
LielinJiang 已提交
132

Y
YixinKristy 已提交
133
### Face Morphing 
134 135 136 137 138

<div align='center'>
  <img src='https://user-images.githubusercontent.com/48054808/129020371-75de20d1-705b-44b1-8254-e09710124244.gif'width='700' />
</div>

L
LielinJiang 已提交
139
### Image Translation
L
LaraStuStu 已提交
140 141

<div align='center'>
142
  <img src='https://user-images.githubusercontent.com/48054808/119464966-d5c1c000-bd75-11eb-9696-9bb75357229f.gif'width='700' height='200'/>
L
LaraStuStu 已提交
143 144
</div>

145

L
LielinJiang 已提交
146
### Old video restore
L
LaraStuStu 已提交
147
<div align='center'>
148
  <img src='https://user-images.githubusercontent.com/48054808/119469496-fc81f580-bd79-11eb-865a-5e38482b1ae8.gif' width='700'/>
L
LaraStuStu 已提交
149 150 151
</div>


152

L
LielinJiang 已提交
153
### Motion driving
L
LaraStuStu 已提交
154
<div align='center'>
155
  <img src='https://user-images.githubusercontent.com/48054808/119469551-0a377b00-bd7a-11eb-9117-e4871c8fb9c0.gif' width='700'>
L
LaraStuStu 已提交
156 157
</div>

158

L
LielinJiang 已提交
159
### Super resolution
L
LaraStuStu 已提交
160 161

<div align='center'>
162
  <img src='https://user-images.githubusercontent.com/48054808/119469753-3e12a080-bd7a-11eb-9cde-4fa01b3201ab.png'width='700' height='250'/>
L
LaraStuStu 已提交
163 164 165
</div>


166

L
LielinJiang 已提交
167
### Makeup shifter
L
LaraStuStu 已提交
168 169

<div align='center'>
170
  <img src='https://user-images.githubusercontent.com/48054808/119469834-4ff44380-bd7a-11eb-93b6-05b705dcfbf2.png'width='700' height='250'/>
L
LielinJiang 已提交
171 172 173
</div>


174

L
LielinJiang 已提交
175
### Face cartoonization
L
LielinJiang 已提交
176 177

<div align='center'>
178
  <img src='https://user-images.githubusercontent.com/48054808/119469952-6bf7e500-bd7a-11eb-89ad-9a78b10bd4ab.png'width='700' height='250'/>
L
LaraStuStu 已提交
179 180
</div>

H
haoqiang 已提交
181

182

H
haoqiang 已提交
183 184 185
### Realistic face cartoonization

<div align='center'>
186
  <img src='https://user-images.githubusercontent.com/48054808/119470028-7f0ab500-bd7a-11eb-88e9-78a6b9e2e319.png'width='700' height='250'/>
H
haoqiang 已提交
187 188 189
</div>


190

L
LielinJiang 已提交
191
### Photo animation
Q
qingqing01 已提交
192 193

<div align='center'>
194
  <img src='https://user-images.githubusercontent.com/48054808/119470099-9184ee80-bd7a-11eb-8b12-c9400fe01266.png'width='700' height='250'/>
Q
qingqing01 已提交
195
</div>
Q
qingqing01 已提交
196

L
lijianshe02 已提交
197

198

L
lijianshe02 已提交
199 200 201
### Lip-syncing

<div align='center'>
202
  <img src='https://user-images.githubusercontent.com/48054808/119470166-a6618200-bd7a-11eb-9f98-58052ce21b14.gif'width='700'>
L
lijianshe02 已提交
203 204 205
</div>


206

L
LielinJiang 已提交
207
## Changelog
Q
qingqing01 已提交
208 209

- v0.1.0 (2020.11.02)
L
LielinJiang 已提交
210 211
  - Release first version, supported models include Pixel2Pixel, CycleGAN, PSGAN. Supported applications include video frame interpolation, super resolution, colorize images and videos, image animation.
  - Modular design and friendly interface.
L
LielinJiang 已提交
212

L
LielinJiang 已提交
213
## Community
L
LaraStuStu 已提交
214

L
LielinJiang 已提交
215
Scan OR Code below to join [PaddleGAN QQ Group:1058398620], you can get offical technical support  here and communicate with other developers/friends. Look forward to your participation!
L
LaraStuStu 已提交
216 217 218 219

<div align='center'>
  <img src='./docs/imgs/qq.png'width='250' height='300'/>
</div>
L
LielinJiang 已提交
220

L
LielinJiang 已提交
221
### PaddleGAN Special Interest Group(SIG)
L
LielinJiang 已提交
222

L
LielinJiang 已提交
223
It was first proposed and used by [ACM(Association for Computing Machinery)](https://en.wikipedia.org/wiki/Association_for_Computing_Machinery) in 1961. Top International open source organizations including [Kubernates](https://kubernetes.io/) all adopt the form of SIGs, so that members with the same specific interests can share, learn knowledge and develop projects. These members do not need to be in the same country/region or the same organization, as long as they are like-minded, they can all study, work, and play together with the same goals~
L
LielinJiang 已提交
224

L
LielinJiang 已提交
225
PaddleGAN SIG is such a developer organization that brings together people who interested in GAN. There are frontline developers of PaddlePaddle, senior engineers from the world's top 500, and students from top universities at home and abroad.
L
LielinJiang 已提交
226

L
LielinJiang 已提交
227
We are continuing to recruit developers interested and capable to join us building this project and explore more useful and interesting applications together.
Q
qingqing01 已提交
228

L
LielinJiang 已提交
229
SIG contributions:
Q
qingqing01 已提交
230

L
LielinJiang 已提交
231 232 233
- [zhen8838](https://github.com/zhen8838): contributed to AnimeGANv2.
- [Jay9z](https://github.com/Jay9z): contributed to DCGAN and updated install docs, etc.
- [HighCWu](https://github.com/HighCWu): contributed to c-DCGAN and WGAN. Support to use `paddle.vision.datasets`.
Q
qingqing01 已提交
234
- [hao-qiang](https://github.com/hao-qiang) & [ minivision-ai ](https://github.com/minivision-ai): contributed to the photo2cartoon project.
Q
qingqing01 已提交
235

L
LielinJiang 已提交
236

L
LielinJiang 已提交
237
## Contributing
Q
qingqing01 已提交
238

L
LielinJiang 已提交
239 240 241
Contributions and suggestions are highly welcomed. Most contributions require you to agree to a [Contributor License Agreement (CLA)](https://cla-assistant.io/PaddlePaddle/PaddleGAN) declaring.
When you submit a pull request, a CLA-bot will automatically determine whether you need to provide a CLA. Simply follow the instructions provided by the bot. You will only need to do this once across all repos using our CLA.
For more, please reference [contribution guidelines](docs/en_US/contribute.md).
L
LaraStuStu 已提交
242

L
LielinJiang 已提交
243 244
## License
PaddleGAN is released under the [Apache 2.0 license](LICENSE).