Large Language Models for Code Analysis: Do LLMs Really Do Their Job?

arXiv:2310.12357v2 Announce Type: replace-cross
Abstract: Large language models (LLMs) have demonstrated significant potential in the realm of natural language understanding and programming code processing tasks. Their capacity to comprehend and generate human-like code has spurred research into harnessing LLMs for code analysis purposes. However, the existing body of literature falls short in delivering a systematic evaluation and assessment of LLMs' effectiveness in code analysis, particularly in the context of obfuscated code.
This paper seeks to bridge this gap by offering …

analysis arxiv body code code analysis cs.cr cs.se human job language language models large llms natural natural language programming realm research understanding