A newer version of the Gradio SDK is available:
6.1.0
title: Sign Language Interpreter
emoji: 👋
colorFrom: yellow
colorTo: gray
sdk: gradio
sdk_version: 4.36.0
python_version: 3.10.4
app_file: main.py
license: gpl-3.0
pinned: false
Sign Language Interpreter
Many people around the world use sign language to communicate. Communication occurs only when a message is sent and also received. Sign-language users are able to efficiently converse when the observer understands sign-language. This is usually not the case in reality. Hence, this tool would be extremely helpful to interpret and pronounce sign language to the listener. The tool would allow sign-language users to communicate with more people and enable them to more easily take part in society.
Table of Contents
About
Sign-Language-Interpreter aims to allow a fluent sign-language user to sign into a camera and have the user's message be spoken aloud.
Currently this project has been implemented as a demo website running on HugggingFace. To reach a wider audience and eliminate dependency on internet availability, this AndroidJS build is being developed
Built With
Sign-Language-Interpreter was built with these technologies and libraries:
Usage
The user may sign into a camera and have the signed letters detected by the program.
Fingerspelling is supported as including many signs in the model would require more resources. Fingerspelling is simply using a standard set of stationary signs as letters and making words from the ground up.
A complete word based implementation is planned. Sign-language ommits many auxiliary words of English and mostly consists of nouns and verbs. The detected words may not make complete sense if directly pronounced. Hence, an LLM model will help to fill in the missing words or restructure the sentence by inferring its intended meaning. The restructured sentence will be spoken.
License
This project is licensed under the GPL v3 or greater.