Electrical Stimulation for Haptic Feedback in VR

EEG-Guided Electrical Stimulation for Immersive Virtual Reality is a project funded by NSF. In collaboration with researchers at UPitt, we are working towards developing sensory models for fingertips when stimulated with electrical current waves spatially and temporally, in order to eventually enable realistic haptic feedback for virtual and mixed reality applications where feeling of texture are essential for enhanced immersive experiences.

Skin Cancer Diagnosis

Melanoma is diagnosed in approximately 124,000 people and is responsible for about 10,000 deaths every year, in the USA. Dermatologists rely on visual and dermatoscopic examination to discriminate benign melanocytic lesions from malignant, resulting in high and highly variable benign-to-malignant Read more…

ASSIST/iROP

Retinopathy of prematurity (ROP) is a leading cause of childhood visual loss worldwide, and the social burdens of infancy-acquired blindness are enormous. Early diagnosis is critically important for successful treatment, and can prevent most cases of blindness. However, lack of Read more…

Scalable Graph Distances

Representations of real-world phenomena as graphs are ubiquitous, ranging from social and information networks, to technological, biological, chemical, and brain networks. Many graph mining tasks — including clustering, anomaly detection, nearest neighbor, similarity search, pattern recognition, and transfer learning — Read more…

Human-Robot Object Handover

Coordination of Dyadic Object Handover for Human-Robot Interactions is a project funded by NSF. In collaboration with Tunik and RIVER Labs at Northeastern, we are modeling natural human-to-human object handover dynamics in order to develop robotic behavior strategies for more human-like human-to-robot and robot-to-human object handover in human-robot teams of the future.

Estimating Protein Function From Structure

Mining for Mechanistic Information to Predict Protein Function is a project funded by NSF. In collaboration with researchers from the Chemistry Department, we are using machine learning techniques to develop computational models that can predict protein function from chemical and molecular structure. Models will also be explainable in the sense that active residues will be identified and their roles will be connected to predicted protein function.

Predicting Epileptogenesis After TBI

Multimodal Signal Analysis and Data Fusion for Post-traumatic Epilepsy Prediction is a project funded by NIH. In collaboration with researchers at USC Medical School, we are using machine learning techniques to discover features from multimodal data such as EEG, fMRI, DTI, and blood chemistry, in order to build models that can predict if a traumatic brain injury (TBI) patient is susceptible to epileptogenesis – emergence of epilepsy following TBI.

Modeling TMS-induced Motor Evoked Potentials

Understanding Motor Cortical Organization Through Engineering Innovation to TMS-Based Brain Mapping is a project funded by NSF. In collaboration with researchers at Tunik Lab and MGH, we are developing hybrid models that combine physics based partial differential equations and deep neural networks to predict transcranial magnetic stimulation (TMS) induced muscle evoked potentials (MEPs) in the upper limbs of humans. These models will then be used to develop inverse motor cortex activation imaging methods to estimate how activations of muscle groups in the arms are represented in the motor cortex. We are also exploring active learning techniques for rapid label efficient modeling in this context.

Predicting the Onset of Agression in Children with Autism Using Wearable Sensor Data Fusion

Predicting Onset of Aggression in Minimally Verbal Youth with Autism Using Biosensor Data and Machine Learning Algorithms is a project funded by Simons Foundation and US Army. In collaboration with researchers at Maine and UPitt Medical Centers we are developing sensor fusion algorithms to predict upcoming aggressive behavior onset in minimally verbal children with autism. Our algorithms will give caregivers real-time information and cues regarding the mental state of the child they are interacting with.