Slip or Not? Unsupervised Learning to Understand Physical Scene Using Multimodal Variational Physics Inference Network Zhengxuan Wu; Xiyu Zhang Stanford University
pytorch
python trainMVAE.py --visualize
You can generative datasets using this simulation engine. https://github.com/frankaging/2d-static-friction-simulation
This model is based on MVAE. It could be used to do multimodal physics scene understandings.