top of page

Google Teachable Machine + Unity3D

TEACHABLE MACHINE + UNITY3D

Anchor 1

_environment

​

_role

 

_tools

​

_description

 

_code

NYU ITP Machine Learning for Web

Software Developer

Unity3D, C#, Javascript, Teachable Machine by Google

This project combines both machine learning and gameplay to create a unique control interface for gameplay.  I used different gestures of my hand to train an image classification model and then integrated that with Unity WebGL. 

github

demo (uses webcam, white/light gray background necessary)

_process

gather data

IMG_2103_edited.png

class: UP

IMG_2107_edited.png

class: DOWN

IMG_2105_edited.png

class: LEFT

IMG_2106_edited.png

class:  RIGHT

train model

noun_Neural%20Network_1503825_edited.png

  Teachable Machine. 

export model

import assets

low%20poly%20assets_edited.jpg

Low Poly Game Kit

modify scripts

#

noun_page_2292330.png

adjusted player control script to receive external directional inputs

  Unity3D  

read webcam feed

ML4wHand.gif

make prediction using model

send result to Unity

move character

gamecontrol.gif

  Javascript/WebGL  

_demo_Video

bottom of page