A downloadable tool

Wouldn't it be nice if ASL speakers had an easier time using video calls? We set out to do this with HandSlate.

HandSlate is a virtual sign language interpreter that takes input from your webcam and translates it in real time. It can translate incoming and outgoing Zoom calls, as well!

This project was made for the HenHacks hackathon and won first place in the Machine Learning catagory. We used OpenCV, Tensorflow, Kaggle, and SciKit-Learn to train a VGG16 convolutional neural network to detect and translate sign language from any video feed. 

Here's the demo video we created for our hackathon submission:

Check out the github page to try handslate for yourself, and take a loot at the devpost page to learn more about the HenHacks hackathon.

Leave a comment

Log in with itch.io to leave a comment.