Inspired by his grandparents’ struggles with modern technology due to motor tremors, high school junior Dhanvin Ganeshkumar is developing an assistive app called Swype AI. The application aims to make computers more accessible for people with motor disabilities, such as those caused by Parkinson’s disease or ALS. Swype AI will allow a user to control their computer through a free smartphone app, using simple gestures or voice commands, bypassing the need for a traditional mouse or keyboard which can be difficult for some to operate.

Ganeshkumar is developing the app as a for-profit startup, a decision he made after realizing a non-profit model would be harder to scale. However, his primary mission is to ensure the technology is widely available. The plan is to offer the core functionality of Swype AI for free, making it accessible to underprivileged communities that cannot afford expensive assistive devices, which can often cost over $1,000. The company will generate revenue through optional in-app purchases for advanced customization features.

Built using Python and advanced hand-tracking technology, the project faced a significant technical hurdle during development. Early versions of the app had a noticeable lag, and the unsteady hand movements of users with tremors would cause the on-screen cursor to be erratic and difficult to control. To solve this, the team integrated a sophisticated smoothing filter, a mathematical tool that intelligently predicts the user’s intended motion and filters out the “noise” from involuntary shakes. By fine-tuning this system, they were able to create a highly responsive and accurate cursor that moves smoothly in real-time, providing a reliable and frustration-free user experience.

Currently in beta testing, Swype AI has already gained significant traction. Ganeshkumar has consulted with over 15 accessibility organizations to refine the app and has secured around $7,500 in funding and awards to cover initial production costs. He is using coding skills learned at his STEM-focused high school and research experience to build the app, with plans for a public launch within the next few months. He hopes his journey encourages other young people to develop and share their innovative ideas.

Watch the video below to see some quick demos of how Swype AI works and head to their website to learn more about Swype AI.

Source (1): ARL Now, Source (2): DevPost

The post Swype AI: High Schooler Develops AI App That Turns Your Hand into a Computer Mouse appeared first on Assistive Technology Blog.