Deep learning Parkinson's from smartphone data (original) (raw)

Towards Automated and Marker-less Parkinson Disease Assessment: Predicting UPDRS Scores using Sit-stand videos

2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021

This paper presents a novel deep learning enabled, video based analysis framework for assessing the Unified Parkinson’s Disease Rating Scale (UPDRS) that can be used in the clinic or at home. We report results from comparing the performance of the framework to that of trained clinicians on a population of 32 Parkinson’s disease (PD) patients. In-person clinical assessments by trained neurologists are used as the ground truth for training our framework and for comparing the performance. We find that the standard sit-to-stand activity can be used to evaluate the UPDRS sub-scores of bradykinesia (BRADY) and posture instability and gait disorders (PIGD). For BRADY we find Fl-scores of 0.75 using our framework compared to 0.50 for the video based rater clinicians, while for PIGD we find 0.78 for the framework and 0.45 for the video based rater clinicians. We believe our proposed framework has potential to provide clinically acceptable end points of PD in greater granularity without impos...

Using AI to measure Parkinson’s disease severity at home

npj Digital Medicine, 2023

We present an artificial intelligence (AI) system to remotely assess the motor performance of individuals with Parkinson's disease (PD). In our study, 250 global participants performed a standardized motor task involving finger-tapping in front of a webcam. To establish the severity of Parkinsonian symptoms based on the finger-tapping task, three expert neurologists independently rated the recorded videos on a scale of 0-4, following the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS). The inter-rater reliability was excellent, with an intra-class correlation coefficient (ICC) of 0.88. We developed computer algorithms to obtain objective measurements that align with the MDS-UPDRS guideline and are strongly correlated with the neurologists' ratings. Our machine learning model trained on these measures outperformed two MDS-UPDRS certified raters, with a mean absolute error (MAE) of 0.58 points compared to the raters' average MAE of 0.83 points. However, the model performed slightly worse than the expert neurologists (0.53 MAE). The methodology can be replicated for similar motor tasks, providing the possibility of evaluating individuals with PD and other movement disorders remotely, objectively, and in areas with limited access to neurological care.

A Deep Learning Approach for Automatic and Objective Grading of the Motor Impairment Severity in Parkinson’s Disease for Use in Tele-Assessments

Sensors

Wearable sensors provide a tool for at-home monitoring of motor impairment progression in neurological conditions such as Parkinson’s disease (PD). This study examined the ability of deep learning approaches to grade the motor impairment severity in a modified version of the Movement Disorders Society-sponsored revision of the Unified Parkinson’s Disease Rating Scale (MDS-UPDRS) using low-cost wearable sensors. We hypothesized that expanding training datasets with motion data from healthy older adults (HOAs) and initializing classifiers with weights learned from unsupervised pre-training would lead to an improvement in performance when classifying lower vs. higher motor impairment relative to a baseline deep learning model (XceptionTime). This study evaluated the change in classification performance after using expanded training datasets with HOAs and transferring weights from unsupervised pre-training compared to a baseline deep learning model (XceptionTime) using both upper extrem...

Upper limb motor pre-clinical assessment in Parkinson's disease using machine learning

Parkinsonism & Related Disorders, 2019

Introduction: Parkinson's disease (PD) is a common neurodegenerative disorder characterized by disabling motor and non-motor symptoms. For example, idiopathic hyposmia (IH), which is a reduced olfactory sensitivity, is typical in > 95% of PD patients and is a preclinical marker for the pathology. Methods: In this work, a wearable inertial device, named SensHand V1, was used to acquire motion data from the upper limbs during the performance of six tasks selected by MDS-UPDRS III. Three groups of people were enrolled, including 30 healthy subjects, 30 IH people, and 30 PD patients. Forty-eight parameters per side were computed by spatiotemporal and frequency data analysis. A feature array was selected as the most significant to discriminate among the different classes both in two-group and three-group classification. Multiple analyses were performed comparing three supervised learning algorithms, Support Vector Machine (SVM), Random Forest (RF), and Naïve Bayes, on three different datasets. Results: Excellent results were obtained for healthy vs. patients classification (F-Measure 0.95 for RF and 0.97 for SVM), and good results were achieved by including subjects with hyposmia as a separate group (0.79 accuracy, 0.80 precision with RF) within a three-group classification. Overall, RF classifiers were the best approach for this application. Conclusion: The system is suitable to support an objective PD diagnosis. Further, combining motion analysis with a validated olfactory screening test, a two-step non-invasive, low-cost procedure can be defined to appropriately analyze people at risk for PD development, helping clinicians to identify also subtle changes in motor performance that characterize PD onset.

Comparative Motor Pre-clinical Assessment in Parkinson's Disease Using Supervised Machine Learning Approaches

Annals of biomedical engineering, 2018

Millions of people worldwide are affected by Parkinson's disease (PD), which significantly worsens their quality of life. Currently, the diagnosis is based on assessment of motor symptoms, but interest toward non-motor symptoms is increasing, as well. Among them, idiopathic hyposmia (IH) is associated with an increased risk of developing PD in healthy adults. In this work, a wearable inertial device, named SensFoot V2, was used to acquire motor data from 30 healthy subjects, 30 people with IH, and 30 PD patients while performing tasks from the MDS-UPDRS III for lower limb assessment. The most significant and non-correlated extracted parameters were selected in a feature array that can identify differences between the three groups of people. A comparative classification analysis was performed by applying three supervised machine learning algorithms. The system resulted able to distinguish between healthy and patients (specificity and recall equal to 0.967), and the people with IH...

The CloudUPDRS smartphone software in Parkinson’s study: cross-validation against blinded human raters

npj Parkinson's Disease

Digital assessments of motor severity could improve the sensitivity of clinical trials and personalise treatment in Parkinson’s disease (PD) but have yet to be widely adopted. Their ability to capture individual change across the heterogeneous motor presentations typical of PD remains inadequately tested against current clinical reference standards. We conducted a prospective, dual-site, crossover-randomised study to determine the ability of a 16-item smartphone-based assessment (the index test) to predict subitems from the Movement Disorder Society-Unified Parkinson’s Disease Rating Scale part III (MDS-UPDRS III) as assessed by three blinded clinical raters (the reference-standard). We analysed data from 60 subjects (990 smartphone tests, 2628 blinded video MDS-UPDRS III subitem ratings). Subject-level predictive performance was quantified as the leave-one-subject-out cross-validation (LOSO-CV) accuracy. A pre-specified analysis classified 70.3% (SEM 5.9%) of subjects into a simila...

Quantifying Parkinson’s disease motor severity under uncertainty using MDS-UPDRS videos

Medical Image Analysis, 2021

Parkinson's disease (PD) is a brain disorder that primarily affects motor function, leading to slow movement, tremor, and stiffness, as well as postural instability and difficulty with walking/balance. The severity of PD motor impairments is clinically assessed by part III of the Movement Disorder Society Unified Parkinson's Disease Rating Scale (MDS-UPDRS), a universally-accepted rating scale. However, experts often disagree on the exact scoring of individuals. In the presence of label noise, training a machine learning model using only scores from a single rater may introduce bias, while training models with multiple noisy ratings is a challenging task due to the inter-rater variabilities. In this paper, we introduce an ordinal focal neural network to estimate the MDS-UPDRS scores from input videos, to leverage the ordinal nature of MDS-UPDRS scores and combat class imbalance. To handle multiple noisy labels per exam, the training of the network is regularized via rater confusion estimation (RCE), which encodes the rating habits and skills of raters via a confusion matrix.

Predicting the total Unified Parkinson’s Disease Rating Scale (UPDRS) based on ML techniques and cloud-based update

Journal of Cloud Computing

Nowadays, smart health technologies are used in different life and environmental areas, such as smart life, healthcare, cognitive smart cities, and social systems. Intelligent, reliable, and ubiquitous healthcare systems are a part of the modern developing technology that should be more seriously considered. Data collection through different ways, such as the Internet of things (IoT)-assisted sensors, enables physicians to predict, prevent and treat diseases. Machine Learning (ML) algorithms may lead to higher accuracy in medical diagnosis/prognosis based on health data provided by the sensors to help physicians in tracking symptom significance and treatment steps. In this study, we applied four ML methods to the data on Parkinson’s disease to assess the methods’ performance and identify the essential features that may be used to predict the total Unified Parkinson’s disease Rating Scale (UPDRS). Since accessibility and high-performance decision-making are so vital for updating phys...