SoleCoach: SoleCoach: Sole Pressure and IMU-based MLLMs for Skill Coaching

Overview of SoleCoach. SoleCoach generates coaching feedback directly from insole sensor data (foot pressure and IMUs) using a multimodal large language model, without requiring external cameras or body-mounted motion capture. We collected a dataset of 26 alpine skiers with 387 expert coaching comments and built a training and generation pipeline to enable accurate and context-aware feedback.

Reference

@inproceedings{hirano2026solecoach,
  author = {Hirano, Toshihiro and Yoshihara, Hitoshi and Peng, Yichen and Liao, Chen-Chieh and Wu, Erwin and Koike, Hideki},
  title = {SoleCoach: Sole Pressure and IMU-based MLLMs for Skill Coaching},
  year = {2026},
  isbn = {9798400722783},
  publisher = {Association for Computing Machinery},
  address = {New York, NY, USA},
  url = {https://doi.org/10.1145/3772318.3791181},
  doi = {10.1145/3772318.3791181},
  booktitle = {Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems},
  articleno = {1429},
  numpages = {17},
  keywords = {skiing, coaching, 3D body pose, foot pressure, insole sensor},
  location = {},
  series = {CHI '26}
}