Projekteja vuodessa
Abstrakti
State of the art Symbolic Regression (SR) methods currently build specialized models, while the application of Large Language Models (LLMs) remains largely unexplored. In this work, we introduce the first comprehensive framework that utilizes LLMs for the task of SR. We propose In-Context Symbolic Regression (ICSR), an SR method which iteratively refines a functional form with an LLM and determines its coefficients with an external optimizer. ICSR leverages LLMs’ strong mathematical prior both to propose an initial set of possible functions given the observations and to refine them based on their errors. Our findings reveal that LLMs are able to successfully find symbolic equations that fit the given data, matching or outperforming the overall performance of the best SR baselines on four popular benchmarks, while yielding simpler equations with better out of distribution generalization.
Alkuperäiskieli | Englanti |
---|---|
Otsikko | Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop) |
Toimittajat | Xiyan Fu, Eve Fleisig |
Kustantaja | Association for Computational Linguistics |
Sivut | 589-606 |
Sivumäärä | 18 |
ISBN (elektroninen) | 9798891760974 |
Tila | Julkaistu - 2024 |
OKM-julkaisutyyppi | A4 Artikkeli konferenssijulkaisussa |
Tapahtuma | Annual Meeting of the Association for Computational Linguistics - Bangkok, Thaimaa Kesto: 11 elok. 2024 → 16 elok. 2024 Konferenssinumero: 62 |
Julkaisusarja
Nimi | Proceedings of the Annual Meeting of the Association for Computational Linguistics |
---|---|
Kustantaja | Association for Computational Linguistics |
Vuosikerta | 4 |
ISSN (painettu) | 0736-587X |
Conference
Conference | Annual Meeting of the Association for Computational Linguistics |
---|---|
Lyhennettä | ACL |
Maa/Alue | Thaimaa |
Kaupunki | Bangkok |
Ajanjakso | 11/08/2024 → 16/08/2024 |
Sormenjälki
Sukella tutkimusaiheisiin 'In-Context Symbolic Regression : Leveraging Large Language Models for Function Discovery'. Ne muodostavat yhdessä ainutlaatuisen sormenjäljen.-
CLISHEAT/Marttinen: Green and digital healthcare
Marttinen, P. (Vastuullinen tutkija), Gao, Y. (Projektin jäsen), John, T. (Projektin jäsen) & Moen, H. (Projektin jäsen)
EU The Recovery and Resilience Facility (RRF)
01/01/2023 → 31/12/2025
Projekti: Academy of Finland: Other research funding
-
-: Finnish Center for Artificial Intelligence
Kaski, S. (Vastuullinen tutkija)
01/01/2019 → 31/12/2022
Projekti: Academy of Finland: Other research funding