imagine

Replace anything you can see with anything you imagine, enabled by the power AR/VR video prompting via "Segment Anything" and "ControlNet".

ControlNet:

Neural network structure to control diffusion models by adding extra conditions.

Segment Anything:

The Segment Anything model produces high quality object masks from input prompts such as points or boxes, and it can be used to generate masks for all objects in an image.

Name		Name	Last commit message	Last commit date
Latest commit History 8 Commits
frames		frames
research		research
.DS_Store		.DS_Store
.gitignore		.gitignore
IMG_5298.heic		IMG_5298.heic
IMG_5298.jpg		IMG_5298.jpg
README.md		README.md
astronaut_rides_horse.png		astronaut_rides_horse.png
automatic.ipynb		automatic.ipynb
bladerunner2049walking.mp4		bladerunner2049walking.mp4
bladerunner2049walkingshort.mp4		bladerunner2049walkingshort.mp4
blur.ipynb		blur.ipynb
fusing.ipynb		fusing.ipynb
hugging.ipynb		hugging.ipynb
hugging.py		hugging.py
pipeline_stable_diffusion_controlnet_inpaint.py		pipeline_stable_diffusion_controlnet_inpaint.py
pleasework.ipynb		pleasework.ipynb
pt2-1.ipynb		pt2-1.ipynb
todo.py		todo.py
utils.py		utils.py

Provide feedback