Disputes
Lost at C: A User Study on the Security Implications of Large Language Model Code Assistants
A C-programming user study did not find a substantial increase in critical security bugs from AI assistance. Challenges generalisation from other experiments.[1]
[1] Lost at C: A User Study on the Security Implications of Large Language Model Code AssistantsAcademic Paper
arXiv.org · 27 Feb 2023
Passage from the sourceOur results indicate that the security impact in this setting (low-level C with pointer and array manipulations) is small: AI-assisted users produce critical security bugs at a rate no greater than 10% more than the control, indicating the use of LLMs does not introduce new security risks.