• Projects
  • Blog
  • Donate

Gesture recognition wearable

for compulsive behaviors

gesture-recognition-device

We have created a prototype for a wrist-worn gesture recognition device that can monitor and record body-focused repetitive behaviors (BFRBs) while also providing real-time (haptic) feedback (on the wrist) to the individual with BFRBs when they occur. The technology is the subject of U.S. Patent Application #15/816,706 filed January 26, 2018. Below is a photograph of Curt White working on an earlier version of the device:

Curt at work

Prevalence of body-focused repetitive behaviors (BFRBs)

BFRBs, symptoms of Obsessive Compulsive Disorder (OCD) and other conditions involving compulsions (e.g., Autism Spectrum Disorder) involve compulsively causing physical injury and/or damaging one’s physical appearance. BFRBs include hitting oneself, biting, pulling out hair, skin picking and cutting, as well less severe but damaging behaviors such as nail biting, thumb sucking, and nose picking [1]. These symptoms affect at least 5% of the population [1]; hair pulling alone affects 1%, or about 3 million people in the US [2]. BRFBs are highly comorbid. Studies have shown that as many as 70% of those with one BRFB will have another co-occurring BRFB [3].
While often impairing, affecting medical health and/or disfiguring, these symptoms are frequently reported but often not observed in clinical settings. This makes diagnosis, as well as treatment planning and monitoring, exceedingly difficult. Clinicians need data on BFRB frequency and timing for the purposes of diagnosis, treatment planning and monitoring, while patients need immediate, real-time feedback to make behavioral therapies more effective.

App

Testing the accuracy of the gesture recognition device

Wrist-worn inertial measurement unit (IMU) sensors and proximity sensors are routinely used to track changes in hand position, but are inadequate for identifying specific locations. In a pilot study, we tested whether the addition of thermal sensors increases the accuracy of position tracking for better detection of BFRBs. Healthy adult participants simulated BFRBs while wearing the device, which incorporates thermal sensors to monitor BFRBs. The addition of thermal sensor data significantly increased a neural network’s detection accuracy when compared against IMU and proximity sensor data alone. This study presents preliminary evidence of the advantage of including thermal sensors and the device’s potential use in BFRB diagnosis and management.

Study

Study results

Current state

As of early 2024, our gesture recognition device is currently undergoing revisions under the new name “Helios”.

References

  1. Families & Health Archived March 28, 2009, at the Wayback Machine., American Association for Marriage and Family Therapy [http://www.aamft.org:80/families/Consumer_Updates/Body-focusedRepetitiveDisorders.asp]
  2. Diefenbach GJ1, Mouton-Odum S, Stanley MA. (2002). Affective correlates of trichotillomania. Behaviour Research and Therapy, 40(11). 2002 Nov;40(11):1305-15. doi:10.1016/S0005-7967(02)00006-2
  3. Conelea, Frank & Walther, 2017

“Thermal sensors improve wrist-worn position tracking” first page thumbnail

Son JJ, Clucas JC, White C, Krishnakumar A, Vogelstein JT, Milham MP, et al. Thermal sensors improve wrist-worn position tracking. npj Digit Med. 2019 Mar 14;2(1):1–4.

Gesture recognition device pilot analysis data on Open Science Framework

octocat (GitHub)/ChildMindInstitute/tingle-pilot-study


nimh-logo
mit-logo
cri-logo
hearst-logo
hirani-logo
Contact: arno@childmind.org
© Child Mind Institute MATTER Lab 2024
  • Privacy
  • Terms
  • Conduct
  • Principles