A modern, real-time American Sign Language (ASL) letter recognition game and web application powered by deep learning and computer vision.
This project uses a webcam and a trained neural network to recognize ASL letters in real time. Users play a word game by signing each letter of a word, with instant feedback and scoring. The app is built with Python, Flask, TensorFlow/Keras, and MediaPipe.
- Real-time ASL letter recognition using your webcam
- Interactive word game with categories (Animals, Food, Colors, Simple Words)
- Visual feedback, progress bar, and scoring
- Robust backend with smoothed prediction logic for reliability
- Clean, responsive web interface
- Clone the repository:
git clone https://github.com/yourusername/ASLgame.git cd ASLgame - Install dependencies:
pip install -r requirements.txt
- Download or train a model:
- Place your trained model file (e.g.,
new_asl_model.h5) in the project root. - (Optional) Use the provided scripts to preprocess data and train your own model.
- Place your trained model file (e.g.,
- Run the web app:
python web_game.py
- Open your browser:
- Go to
http://localhost:5000to play the game!
- Go to
- Show your hand sign clearly in the camera.
- Hold the sign steady until it's detected.
- Complete the word by signing each letter in sequence.
- Get points for each completed word.
Contributions are welcome! Please open an issue or submit a pull request for improvements, bug fixes, or new features.
This project is licensed under the MIT License. See LICENSE for details.