mirror of https://github.com/ZHKKKe/MODNet.git
77 lines
4.1 KiB
Markdown
77 lines
4.1 KiB
Markdown
<h2 align="center">MODNet: Is a Green Screen Really Necessary for Real-Time Portrait Matting?</h2>
|
|
|
|
<img src="doc/gif/homepage_demo.gif" width="100%">
|
|
|
|
<p align="center">
|
|
<a href="https://arxiv.org/pdf/2011.11961.pdf">Arxiv Preprint</a> |
|
|
<a href="https://youtu.be/PqJ3BRHX3Lc">Supplementary Video</a>
|
|
</p>
|
|
|
|
<p align="center">
|
|
WebCam Video Demo [<a href="demo/video_matting/webcam">Offline</a>][<a href="https://colab.research.google.com/drive/1Pt3KDSc2q7WxFvekCnCLD8P0gBEbxm6J?usp=sharing">Colab</a>] | Custom Video Demo [<a href="demo/video_matting/custom">Offline</a>] |
|
|
Image Demo [<a href="https://gradio.app/g/modnet">WebGUI</a>][<a href="https://colab.research.google.com/drive/1GANpbKT06aEFiW-Ssx0DQnnEADcXwQG6?usp=sharing">Colab</a>]
|
|
</p>
|
|
|
|
<div align="center">This is the official project of our paper <b>Is a Green Screen Really Necessary for Real-Time Portrait Matting?</b></div>
|
|
<div align="center">MODNet is a <b>trimap-free</b> model for portrait matting in <b>real time</b> under <b>changing scenes</b>.</div>
|
|
|
|
|
|
---
|
|
|
|
|
|
## News
|
|
- [Dec 25 2020] ***Merry Christmas!*** :christmas_tree: Release Custom Video Matting Demo [[Offline](demo/video_matting/custom)] for user videos.
|
|
- [Dec 15 2020] A cool [WebGUI](https://gradio.app/g/modnet) for image matting based on MODNet is built by the [Gradio](https://github.com/gradio-app/gradio) team!
|
|
- [Dec 10 2020] Release WebCam Video Matting Demo [[Offline](demo/video_matting/webcam)][[Colab](https://colab.research.google.com/drive/1Pt3KDSc2q7WxFvekCnCLD8P0gBEbxm6J?usp=sharing)] and Image Matting Demo [[WebGUI](https://gradio.app/g/modnet)][[Colab](https://colab.research.google.com/drive/1GANpbKT06aEFiW-Ssx0DQnnEADcXwQG6?usp=sharing)].
|
|
- [Nov 24 2020] Release [Arxiv Preprint](https://arxiv.org/pdf/2011.11961.pdf) and [Supplementary Video](https://youtu.be/PqJ3BRHX3Lc).
|
|
|
|
|
|
## Video Matting Demo
|
|
We provide two real-time portrait video matting demos based on WebCam. When using the demo, you can move the WebCam around at will.
|
|
If you have an Ubuntu system, we recommend you to try the [offline demo](demo/video_matting/webcam) to get a higher *fps*. Otherwise, you can access the [online Colab demo](https://colab.research.google.com/drive/1Pt3KDSc2q7WxFvekCnCLD8P0gBEbxm6J?usp=sharing).
|
|
We also provide an [offline demo](demo/video_matting/custom) that allows you to process custom videos.
|
|
|
|
<img src="doc/gif/video_matting_demo.gif" width='60%'>
|
|
|
|
|
|
|
|
## Image Matting Demo
|
|
We provide an [online Colab demo](https://colab.research.google.com/drive/1GANpbKT06aEFiW-Ssx0DQnnEADcXwQG6?usp=sharing) for portrait image matting.
|
|
It allows you to upload portrait images and predict/visualize/download the alpha mattes.
|
|
|
|
<img src="doc/gif/image_matting_demo.gif" width='40%'>
|
|
|
|
You can also use this [WebGUI](https://gradio.app/g/modnet) (hosted on [Gradio](https://github.com/gradio-app/gradio)) for portrait image matting from your browser without any code!
|
|
|
|
<img src="https://i.ibb.co/9gLxFXF/modnet.gif" width='40%'>
|
|
|
|
|
|
## TO DO
|
|
- Release training code (scheduled in **Jan. 2021**)
|
|
- Release PPM-100 validation benchmark (scheduled in **Feb. 2021**)
|
|
|
|
|
|
## License
|
|
This project (code, pre-trained models, demos, *etc.*) is released under the [Creative Commons Attribution NonCommercial ShareAlike 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/legalcode) license.
|
|
|
|
|
|
## Acknowledgement
|
|
We thank [City University of Hong Kong](https://www.cityu.edu.hk/) and [SenseTime](https://www.sensetime.com/) for their support to this project.
|
|
We thank the [Gradio](https://github.com/gradio-app/gradio) team for their contributions to building the demos.
|
|
## Citation
|
|
If this work helps your research, please consider to cite:
|
|
|
|
```bibtex
|
|
@article{MODNet,
|
|
author = {Zhanghan Ke and Kaican Li and Yurou Zhou and Qiuhua Wu and Xiangyu Mao and Qiong Yan and Rynson W.H. Lau},
|
|
title = {Is a Green Screen Really Necessary for Real-Time Portrait Matting?},
|
|
journal={ArXiv},
|
|
volume={abs/2011.11961},
|
|
year = {2020},
|
|
}
|
|
```
|
|
|
|
## Contact
|
|
This project is currently maintained by Zhanghan Ke ([@ZHKKKe](https://github.com/ZHKKKe)).
|
|
If you have any questions, please feel free to contact `kezhanghan@outlook.com`.
|