Autistic Kids Companion: An Automatic Exercise Assessment and Companion for Autistic Kids and Motor
Dysfunction Patients Using ML
Background
Autism Spectrum Disorder (ASD) affects millions worldwide, making motor coordination and daily activities
challenging. Innovative solutions leveraging artificial intelligence and machine learning can provide much-needed
assistance. The Autistic Kids Companion is one such revolutionary tool designed to help autistic children and
motor dysfunction patients with exercise assessment and progress monitoring.
Autism affects nearly 75 million people globally, including over 468,000 individuals in Bangladesh. Existing
exercise-assessment solutions rely on expensive kinetic sensors and high computational power, making them
inaccessible to many. The need for an affordable, intelligent, and interactive solution led to the development of
this app.
How the App Works
The Autistic Kids Companion utilizes camera-based pose detection and machine learning algorithms to analyze
body movements during exercise. It provides real-time feedback through animations, ensuring exercises are
performed correctly and effectively.
Key Functionalities
Online and Offline Modes: Users can access assessments in real-time or review progress offline.
Pose Landmark Detection: Tracks body movements using camera input.
Exercise Knowledge Base: Offers interactive lessons for various exercises.
Data Upload & Monitoring: Stores progress data, allowing caregivers to track improvements.
Machine Learning-Based Analysis: Provides accurate assessments based on vast datasets.
Exercise Assessment and Monitoring
The app supports various exercises, including:
Hand lifting
Trunk rotation
Jumping jacks
Squats
Skipping
These exercises help improve motor functions in autistic children and those with movement disorders.
The app’s weekly progress tracking system offers insights into user improvements.
Technology Behind the App
The Autistic Kids Companion leverages advanced machine learning and computer vision technologies to provide an
accurate and effective exercise assessment for autistic children and individuals with motor dysfunction. One of
the core technologies powering the app is Google MediaPipe, a state-of-the-art framework for real-time pose
tracking. By analyzing key body landmarks, the app can determine movement accuracy, suggest corrections, and
provide meaningful feedback to users.
To ensure scalability and efficiency, the app utilizes cloud computing platforms like Amazon AWS and Google Cloud
for model training, data processing, and storage. These cloud-based solutions enable the app to handle large
volumes of data efficiently, making it easier to improve its predictive capabilities over time. Additionally, the
KIMORE Benchmark Dataset, a well-known dataset for movement analysis, is incorporated into the app’s learning
process. Using SHAP-based assessment (SHapley Additive exPlanations), the app provides interpretable machine
learning predictions, ensuring that the exercise recommendations are tailored to the specific needs of each user.
Benefits and Future Scope
The Autistic Kids Companion is designed to bridge the gap between accessibility and affordability, making advanced
therapeutic solutions available to a broader audience. Unlike traditional rehabilitation tools that rely on
expensive kinetic sensors and require high computational power, this app runs efficiently on standard devices with
a camera, making it both cost-effective and easy to use.
1. Increased engagement through animations - The app enhances user interaction with playful, animated exercises
that
make physical activities enjoyable for autistic children.
2. Accurate exercise assessments - Using AI-powered pose detection, the app ensures that exercises are performed
correctly, helping users improve their motor skills.
3. Easy-to-use interface for caregivers and therapists - The app is designed with a user-friendly interface,
making
it accessible to parents, therapists, and caregivers who monitor the child’s progress.
4. Potential expansion to other motor dysfunction conditions - While primarily designed for autistic children, the
app has the potential to assist stroke patients, elderly individuals, and individuals with other neuromuscular
disorders.
Looking ahead, future advancements in the app could include personalized AI-driven exercise plans, where the
system automatically adapts workouts based on the user's performance. Enhanced real-time feedback with more
detailed correction suggestions could further refine the training process. Additionally, integration with wearable
devices such as smartwatches and fitness trackers could provide real-time biometric feedback, making assessments
even more comprehensive and precise.
Conclusion
The Autistic Kids Companion is a groundbreaking initiative that brings together technology, healthcare, and
accessibility to create a smarter, more effective approach to rehabilitation. By combining artificial
intelligence, cloud computing, and pose tracking, the app delivers an innovative solution for autism therapy and
motor dysfunction treatment. As research in this field continues to evolve, the app holds immense potential to
transform rehabilitation and therapy, ensuring that individuals with autism and motor disorders receive the
support they need to lead healthier, more independent lives.
