Model-Free Control for Dynamic-Field Acoustic Manipulation Using Reinforcement Learning

Kourosh Latifi, Artur Kopitca, Quan Zhou

Tutkimustuotos: LehtiartikkeliArticleScientificvertaisarvioitu

100 Lataukset (Pure)

Abstrakti

Dynamic-field acoustic manipulation techniques benefit numerous applications in microsystem assembly, pattern formation, biological research, tissue engineering, and lab-on-a-chip. These techniques generally rely on a theoretical dynamic model of particle motion in the acoustic field. Accordingly, success of the manipulation task highly depends on the accuracy of the employed dynamic model. However, modelling such dynamic behavior is a great challenge in more advanced acoustic manipulation devices and requires significant simplifications. Here, we introduce a model-free control method based on reinforcement learning for highly-dynamic acoustic manipulation devices. In our method, the controller does not need a prior knowledge of the acoustic field and learns the optimal control policy for each manipulation task by merely interacting with the acoustic field. As a proof-of-concept, we apply our method to a classic acoustic manipulation device, a Chladni plate consisting of a centrally-actuated vibrating plate. By employing the controller, we demonstrate successful manipulation of single and multiple particles towards target locations on the plate surface. The model-free control method is not limited to the Chladni plate and can be potentially applied to a broad range of acoustic manipulation devices as well as other forms of field-based micromanipulation systems, where accurate theoretical modelling of the field is challenging.
AlkuperäiskieliEnglanti
Sivut20597-20606
Sivumäärä10
JulkaisuIEEE Access
Vuosikerta8
DOI - pysyväislinkit
TilaJulkaistu - 24 tammikuuta 2020
OKM-julkaisutyyppiA1 Julkaistu artikkeli, soviteltu

Sormenjälki Sukella tutkimusaiheisiin 'Model-Free Control for Dynamic-Field Acoustic Manipulation Using Reinforcement Learning'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.

  • Projektit

    Autonomous Shaping and Structuring using Acoustic Field

    Zhou, Q.

    01/01/202031/12/2022

    Projekti: Academy of Finland: Other research funding

    Mikrokomponenttien ohjattu dynaaminen kokoonpano käyttäen akustista herätettä

    Tao, J., Cenev, Z., Karimi, S., Kravtcova, A., Latifi, K., Zhou, Q., Wijaya, H., Seon, J., Isitman, O. & Kopitca, A.

    01/09/201631/12/2020

    Projekti: Academy of Finland: Other research funding

    Laitteet

  • Siteeraa tätä