README.md

Unity_HandTracking_DeepLearning

• Updated with gitignore (~ 22.12.15)
  https://kin.naver.com/qna/detail.naver?d1id=1&dirId=10401&docId=393404499&qb=Q1JMRg==&enc=utf8&section=kin.qna&rank=4&search_sort=0&spq=0

• Additionally updated without ignore(22.12.16)

• Additional update for unity_build (~22.12.22)

About project

Realtime HandTrack

1	2

Game Playing

1	2	3	4	5	6

• This project is a Unity3D Project
  
• You can draw pictures using certain hand gestures.
  
• A trained deep learning model will tell you what your drawing is.

Unity

How to run (the built game is in the unity_build folder)

1. First, ensure you have Git LFS.

   git lfs install  
   

2. Then, clone this repo.

   git clone https://github.com/jiho-00/Unity_HandTracking_DeepLearning   
   

3. All of project files are in unity/Assets. This folder includes all scripts and assets to run the project excluding python files.

Unity demo scenes

Scene name	Scene	Scene
Main
Room
Drawing

Python

Dataset

• Google quickdraw dataset

How to run

1. Preparing your datasets

   ├── data
     ├── txtfiles
     │   ├── 30categories.txt

2. Making train/test datasets

   python DataUtils.download_data.py
   

3. Main Training

   python main.py
   

4. Inference & Socket communication

   python InferenceOneImage.py