The inability to communicate effectively because of communication barriers severely restricts deaf and mute individuals from getting in touch with those who do not know sign language. A new web-based system has been developed to provide an effortless communication solution between users who are deaf, mute and Sign language users. The system implements Django as its backend framework collected with text- to- Sign language conversion and speech-to-text capabilities towards establish successful communication. Through the application users have the option to provide text or audio content that gets translated into American Sign language (ASL) animations through hand gesture visualization from MediaPipe. The system enables automatic speech recognition through the Speech Recognition library and functions as an ASR tool to convert spoken words into text. The Google Translator API enables native language translation of this recorded text which expands communication possibilities to different user groups. From datasets obtained through Kaggle the training of a Convolutional Neural Network model reaches 99% accuracy for sign recognition leading to accurate communication. The application creates a manageable interface which enables people with speech and hearing difficulties to get real-time Sign language animations as visual outputs. The novel system surpasses typical assistive communication solutions because it cuts out the requirement for human Sign language interpreters to provide inclusive communication channels. This proposed web application will increase accessible interactions thus promoting more social integration opportunities for both deaf and mute users. The system will be improved through language expansion of Sign language interpretation and a mobile app adaptation for maximized accessibility. The system incorporates components related to Communication accessibility, Sign language recognition, speech-to-text, ASL animation and employs CNN models in conjunction with Django framework.
100
75
43
100
75
43
100
75
43
Copyright © 2025, This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC-BY-NY-SA). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.
*Corresponding Author: KONDA HARI KRISHNA, khk396@gmail.com
Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.
Conflict of interest: The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.
Publisher’s note: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.
Or share your Opinion
Blockchain technology with its promise of decentralized, transparent, and tamper-proof systems, it unquestionably captured the imagination of the...
The inability to communicate effectively because of communication barriers severely restricts deaf and mute This paper highlights the...
The current paper concentrates on the data of food safety sensors on four key environmental parameters, including the...
Applications in Vehicular Networks : With the increase of Internet of Things (IoT) devices applications area, widespread deployment...
Smart education empowered by AI is transforming the conventional learning environment by utilizing advanced technologies to deliver customized,...
Comments(0)