MarLe : Markerless estimation of head pose for navigated transcranial magnetic stimulation

Renan H. Matsuda; Victor H. Souza; Petrus N. Kirsten; Risto J. Ilmoniemi; Oswaldo Baffa

doi:10.1007/s13246-023-01263-2

MarLe : Markerless estimation of head pose for navigated transcranial magnetic stimulation

Renan H. Matsuda^*, Victor H. Souza, Petrus N. Kirsten, Risto J. Ilmoniemi, Oswaldo Baffa

^*Corresponding author for this work

Department of Neuroscience and Biomedical Engineering

Research output: Contribution to journal › Article › Scientific › peer-review

3 Citations (Scopus)

48 Downloads (Pure)

Abstract

Navigated transcranial magnetic stimulation (nTMS) is a valuable tool for non-invasive brain stimulation. Currently, nTMS requires fixing of markers on the patient’s head. Head marker displacements lead to changes in coil placement and brain stimulation inaccuracy. A markerless neuronavigation method is needed to increase the reliability of nTMS and simplify the nTMS protocol. In this study, we introduce and release MarLe, a Python markerless head tracker neuronavigation software for TMS. This novel software uses computer-vision techniques combined with low-cost cameras to estimate the head pose for neuronavigation. A coregistration algorithm, based on a closed-form solution, was designed to track the patient’s head and the TMS coil referenced to the individual’s brain image. We show that MarLe can estimate head pose based on real-time video processing. An intuitive pipeline was developed to connect the MarLe and nTMS neuronavigation software. MarLe achieved acceptable accuracy and stability in a mockup nTMS experiment. MarLe allows real-time tracking of the patient’s head without any markers. The combination of face detection and a coregistration algorithm can overcome nTMS head marker displacement concerns. MarLe can improve reliability, simplify, and reduce the protocol time of brain intervention techniques such as nTMS.

Original language	English
Pages (from-to)	887–896
Journal	Physical and Engineering Sciences in Medicine
Volume	46
Issue number	2
DOIs	https://doi.org/10.1007/s13246-023-01263-2
Publication status	Published - Jun 2023
MoE publication type	A1 Journal article-refereed

Keywords

Coregistration
Face detection
Markerless tracker
Neuronavigation
Transcranial magnetic stimulation

Access to Document

10.1007/s13246-023-01263-2Licence: CC BY

MarLe - Markerless estimation of head pose for navigated transcranial magnetic stimulationFinal published version, 1.51 MBLicence: CC BY

Cite this

@article{c6e8f0b20cea4bab833b2ac7977f214a,

title = "MarLe : Markerless estimation of head pose for navigated transcranial magnetic stimulation",

abstract = "Navigated transcranial magnetic stimulation (nTMS) is a valuable tool for non-invasive brain stimulation. Currently, nTMS requires fixing of markers on the patient{\textquoteright}s head. Head marker displacements lead to changes in coil placement and brain stimulation inaccuracy. A markerless neuronavigation method is needed to increase the reliability of nTMS and simplify the nTMS protocol. In this study, we introduce and release MarLe, a Python markerless head tracker neuronavigation software for TMS. This novel software uses computer-vision techniques combined with low-cost cameras to estimate the head pose for neuronavigation. A coregistration algorithm, based on a closed-form solution, was designed to track the patient{\textquoteright}s head and the TMS coil referenced to the individual{\textquoteright}s brain image. We show that MarLe can estimate head pose based on real-time video processing. An intuitive pipeline was developed to connect the MarLe and nTMS neuronavigation software. MarLe achieved acceptable accuracy and stability in a mockup nTMS experiment. MarLe allows real-time tracking of the patient{\textquoteright}s head without any markers. The combination of face detection and a coregistration algorithm can overcome nTMS head marker displacement concerns. MarLe can improve reliability, simplify, and reduce the protocol time of brain intervention techniques such as nTMS.",

keywords = "Coregistration, Face detection, Markerless tracker, Neuronavigation, Transcranial magnetic stimulation",

author = "Matsuda, {Renan H.} and Souza, {Victor H.} and Kirsten, {Petrus N.} and Ilmoniemi, {Risto J.} and Oswaldo Baffa",

note = "Funding Information: This work has received funding from the Conselho Nacional de Desenvolvimento Cient{\'i}fico e Tecnol{\'o}gico (CNPq) (grant No. 141056/2018-5, No. 304107/2019-0, and No. 118882/2019-8) and from the European Research Council (ERC) under the European Union{\textquoteright}s Horizon 2020 research and innovation programme (grant agreement No. 810377). This article was produced as part of the activities of the FAPESP Research, Innovation and Dissemination Center for Neuromathematics (grant No. 2013/07699-0). VHS has received funding from the Academy of Finland (decision No. 349985). RM is post-doctoral fellow of FAPESP (Grant # 2022/14526-3). | openaire: EC/H2020/810377/EU//ConnectToBrain ",

year = "2023",

month = jun,

doi = "10.1007/s13246-023-01263-2",

language = "English",

volume = "46",

pages = "887–896",

journal = "Physical and Engineering Sciences in Medicine",

issn = "2662-4729",

publisher = "Springer",

number = "2",

}

TY - JOUR

T1 - MarLe : Markerless estimation of head pose for navigated transcranial magnetic stimulation

AU - Matsuda, Renan H.

AU - Souza, Victor H.

AU - Kirsten, Petrus N.

AU - Ilmoniemi, Risto J.

AU - Baffa, Oswaldo

N1 - Funding Information: This work has received funding from the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) (grant No. 141056/2018-5, No. 304107/2019-0, and No. 118882/2019-8) and from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 810377). This article was produced as part of the activities of the FAPESP Research, Innovation and Dissemination Center for Neuromathematics (grant No. 2013/07699-0). VHS has received funding from the Academy of Finland (decision No. 349985). RM is post-doctoral fellow of FAPESP (Grant # 2022/14526-3). | openaire: EC/H2020/810377/EU//ConnectToBrain

PY - 2023/6

Y1 - 2023/6

N2 - Navigated transcranial magnetic stimulation (nTMS) is a valuable tool for non-invasive brain stimulation. Currently, nTMS requires fixing of markers on the patient’s head. Head marker displacements lead to changes in coil placement and brain stimulation inaccuracy. A markerless neuronavigation method is needed to increase the reliability of nTMS and simplify the nTMS protocol. In this study, we introduce and release MarLe, a Python markerless head tracker neuronavigation software for TMS. This novel software uses computer-vision techniques combined with low-cost cameras to estimate the head pose for neuronavigation. A coregistration algorithm, based on a closed-form solution, was designed to track the patient’s head and the TMS coil referenced to the individual’s brain image. We show that MarLe can estimate head pose based on real-time video processing. An intuitive pipeline was developed to connect the MarLe and nTMS neuronavigation software. MarLe achieved acceptable accuracy and stability in a mockup nTMS experiment. MarLe allows real-time tracking of the patient’s head without any markers. The combination of face detection and a coregistration algorithm can overcome nTMS head marker displacement concerns. MarLe can improve reliability, simplify, and reduce the protocol time of brain intervention techniques such as nTMS.

AB - Navigated transcranial magnetic stimulation (nTMS) is a valuable tool for non-invasive brain stimulation. Currently, nTMS requires fixing of markers on the patient’s head. Head marker displacements lead to changes in coil placement and brain stimulation inaccuracy. A markerless neuronavigation method is needed to increase the reliability of nTMS and simplify the nTMS protocol. In this study, we introduce and release MarLe, a Python markerless head tracker neuronavigation software for TMS. This novel software uses computer-vision techniques combined with low-cost cameras to estimate the head pose for neuronavigation. A coregistration algorithm, based on a closed-form solution, was designed to track the patient’s head and the TMS coil referenced to the individual’s brain image. We show that MarLe can estimate head pose based on real-time video processing. An intuitive pipeline was developed to connect the MarLe and nTMS neuronavigation software. MarLe achieved acceptable accuracy and stability in a mockup nTMS experiment. MarLe allows real-time tracking of the patient’s head without any markers. The combination of face detection and a coregistration algorithm can overcome nTMS head marker displacement concerns. MarLe can improve reliability, simplify, and reduce the protocol time of brain intervention techniques such as nTMS.

KW - Coregistration

KW - Face detection

KW - Markerless tracker

KW - Neuronavigation

KW - Transcranial magnetic stimulation

UR - http://www.scopus.com/inward/record.url?scp=85159063727&partnerID=8YFLogxK

U2 - 10.1007/s13246-023-01263-2

DO - 10.1007/s13246-023-01263-2

M3 - Article

AN - SCOPUS:85159063727

SN - 2662-4729

VL - 46

SP - 887

EP - 896

JO - Physical and Engineering Sciences in Medicine

JF - Physical and Engineering Sciences in Medicine

IS - 2

ER -

MarLe : Markerless estimation of head pose for navigated transcranial magnetic stimulation

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

ConnectToBrain: Connecting to the Networks of the Human Brain

Studies from University of Sao Paulo Reveal New Findings on Magnetic Field Therapy (Marle: Markerless Estimation of Head Pose for Navigated Transcranial Magnetic Stimulation)

Cite this

MarLe : Markerless estimation of head pose for navigated transcranial magnetic stimulation

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Projects

ConnectToBrain: Connecting to the Networks of the Human Brain

Press/Media

Studies from University of Sao Paulo Reveal New Findings on Magnetic Field Therapy (Marle: Markerless Estimation of Head Pose for Navigated Transcranial Magnetic Stimulation)

Cite this