Attitudes towards LLM use among software engineering researchers: Results from a two-phase survey study

Wivestad, Viggo Tellefsen, & Barbala, Astri Moksnes. (2025). Attitudes towards LLM use among software engineering researchers: Results from a two-phase survey study. Paper presented at the 33rd ACM International Conference on the Foundations of Software Engineering, Trondheim, Norway. https://doi.org/10.1145/3696630.3731671

Abstract

This two-phase survey study investigates Software Engineering (SE) researchers' attitudes toward incorporating AI tools, particularly large language models (LLMs), in their workflows. Conducted at a large, independent European research institute, the study provides insights into the emerging norms and attitudes regarding AI integration within empirical SE practices, crucial insights for ensuring responsible AI use and maintaining scientific integrity in the SE field. Our findings reveal that SE researchers prefer LLM contributions when applied on small, narrowly scoped, and verifiable tasks rather than open-ended tasks, and used as a as supplementary tool to traditional methods. In contrast, it is viewed as inappropriate for evaluating others' work. Finally, we observed conflicting views regarding high-stakes tasks traditionally reflecting genuine human effort and emotional commitment.

Funder

Taighde Éireann – Research Ireland
European Union
Research Council of Norway

Publisher

Association for Computing Machinery (ACM)

Rights

CC BY

cb

Collections

Business Information Systems (Conference Papers)