WordFinder App: AI-Powered Aphasia Communication Aid
WordFinder is a mobile application leveraging AWS generative AI to assist individuals with aphasia, a communication disorder affecting speech and language comprehension. Developed by QARC and a person with aphasia, it addresses the communication challenges faced by over 140,000 Australians. The app’s core functionality centers around image recognition and semantic word association. Users upload an image, and Amazon Rekognition identifies objects within it, providing an initial word list. This list is then enhanced by Amazon Bedrock, using Anthropic’s Claude model, to generate semantically related words, aiding in alternative communication methods. Built with React Native and Expo for cross-platform compatibility, WordFinder uses Amplify for backend infrastructure, including Amazon Cognito for secure authentication and Amazon S3 for image storage. API Gateway and Lambda functions handle secure communication and prompt engineering with Bedrock. The app boasts a user-friendly interface, guiding users through image selection, object identification, and exploration of related words. This visual approach aligns with aphasia therapy techniques. While the app offers a significant advancement in communication support for aphasia, potential drawbacks could include reliance on internet connectivity and the accuracy of AI-generated word associations, which may need refinement. Future developments could include a caching layer to optimize performance and reduce reliance on AWS services. The app showcases the potential of AI in improving the lives of people with aphasia, promoting independence and connection.
The WordFinder app represents a breakthrough in ai automation communication technology, specifically designed to help individuals with aphasia express themselves more effectively.
Unlike a generic chatgpt automation app, WordFinder is specifically designed to address the unique communication challenges faced by individuals with aphasia.
