Topic

Have you wondered how gestures are loaded into a computer?

Or are you questioning if transcribing our movements is even possible?

Well, it is possible... But not without its own unique set of problems.

This talk touches on everything in the transcription process from the client side to the server side.

So how did we do it? 

We used Mediapipe's machine-learning neural net library to transcribe our movements and gestures to XYZ coordinates. We then created a web crawler to transcribe all of the data from the American Sign Language (ASL) website. We are in process of normalizing this data based on angles related to one another.

The next step of the process, transcribing live gestures and movements is still in development, so let's talk about it!