Face Sketch to Image Generation using GAN

An image generation system using GAN to turn face sketches into realistic photos

Install requirements

pip install -r requirements.txt

Keras-contrib installation

• git clone https://www.github.com/keras-team/keras-contrib.git
• cd keras-contrib
• python setup.py install

Or you can refer to this link https://medium.com/@kegui/how-to-install-keras-contrib-7b75334ab742

Data Augmentation

First of all, you need to do data augmentation using this notebook

Start Training

Start training GAN model with this notebook

Performance Measurement

Calculate SSIM (Structural Similarity Index) and Verification Accuracy (L2-norm) using this notebook

Testing

Generate single image with this notebook

References

[1] X. Wang and X. Tang. (2009). Face Photo-Sketch Synthesis and Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI), 31(11), 1955-1967.

[2] W. Zhang, X. Wang and X. Tang. (2011). Coupled Information-Theoretic Encoding for Face Photo-Sketch Recognition. Proceedings of IEEE Conference on Computer Vision and Pattern Recognition (CVPR).