大模型
arxiv.org ·
走向理解基于LLM的日志异常检测:一项关于性能、效率和鲁棒性的实证研究
该论文对基于 LLM 的日志异常检测进行系统性实证分析,覆盖三个公开日志数据集,考察不同适配策略、模型架构、参数规模和量化设置的影响。结果显示:不同适配策略间性能差异显著;模型规模扩大带来的检测增益因数据集而异;检测精度相近的模型计算成本可能差异明显;在评测配置下低比特量化基本保持检测性能。研究还考察了结构、语义和标签噪声在不同扰动程度下的鲁棒性,强调除精度外还需关注效率与鲁棒性等实际因素。
AI推荐理由 arXiv 实证研究,系统比较 LLM 日志异常检测的适配策略、模型架构、参数规模与量化设置,并考察结构/语义/标签噪声下的鲁棒性,指出同等精度下计算成本差异显著、低比特量化在评测配置下基本保持性能。信息密度高、结论具体,对日志运维与 LLM 落地有参考价值;但仅基于三个公开数据集,摘要未给出具体数值,结论的普适性有待验证。
72
正文
Computer Science > Machine Learning
arXiv:2609.31371 (cs)
[Submitted on 25 Sep 2026]
Title:Towards Understanding LLM-Based Log Anomaly Detection: An Empirical Study of Performance, Efficiency, and Robustness
Authors:Bin Li, Dongdong Wang, Siyang Lu
View a PDF of the paper titled Towards Understanding LLM-Based Log Anomaly Detection: An Empirical Study of Performance, Efficiency, and Robustness, by Bin Li and 2 other authors
View PDF
HTML (experimental)
Abstract:Large language models (LLMs) have demonstrated promising performance in log anomaly detection, yet how their adaptation strategies, architectures, and deployment configurations affect detection effectiveness remains insufficiently understood. To investigate these factors, we conduct a systematic empirical analysis across three public log datasets, examining different adaptation strategies, model architectures, parameter scales, and quantization settings. Our results reveal substantial performance differences across adaptation strategies, while model scaling yields varying detection gains across datasets. We further observe that models with comparable detection accuracy can exhibit markedly different computational costs, and that low-bit quantization largely preserves detection performance in the evaluated configurations. Finally, we examine detection robustness under structural, semantic, and label noise at different perturbation levels. These findings provide empirical insights into the performance, efficiency, and robustness of LLM-based log anomaly detection, highlighting practical considerations beyond conventional accuracy-oriented evaluation.
Comments:
Subjects:
Machine Learning (cs.LG); Cryptography and Security (cs.CR)
Cite as:
arXiv:2609.31371 [cs.LG]
(or
arXiv:2609.31371v1 [cs.LG] for this version)
https://doi.org/10.48550/arXiv.2609.31371
Focus to learn more
arXiv-issued DOI via DataCite (pending registration)
Submission history
From: Bin Li [view email]
[v1]
Fri, 25 Sep 2026 15:08:16 UTC (856 KB)
Full-text links:
Access Paper:
View a PDF of the paper titled Towards Understanding LLM-Based Log Anomaly Detection: An Empirical Study of Performance, Efficiency, and Robustness, by Bin Li and 2 other authors
View PDF
HTML (experimental)
TeX Source
view license
Current browse context:
cs.LG
new
|
recent
| 2026-09
Change to browse by:
cs
cs.CR
References & Citations
NASA ADS
Google Scholar
Semantic Scholar
export BibTeX citation
Loading...
BibTeX formatted citation
×
loading...
Data provided by:
Bookmark
Bibliographic Tools
Bibliographic and Citation Tools
Bibliographic Explorer Toggle
Bibliographic Explorer (What is the Explorer?)
Connected Papers Toggle
Connected Papers (What is Connected Papers?)
Litmaps Toggle
Litmaps (What is Litmaps?)
scite.ai Toggle
scite Smart Citations (What are Smart Citations?)
Code, Data, Media
Code, Data and Media Associated with this Article
alphaXiv Toggle
alphaXiv (What is alphaXiv?)
Links to Code Toggle
CatalyzeX Code Finder for Papers (What is CatalyzeX?)
DagsHub Toggle
DagsHub (What is DagsHub?)
GotitPub Toggle
Gotit.pub (What is GotitPub?)
Huggingface Toggle
Hugging Face (What is Huggingface?)
ScienceCast Toggle
ScienceCast (What is ScienceCast?)
Demos
Demos
Replicate Toggle
Replicate (What is Replicate?)
Spaces Toggle
Hugging Face Spaces (What is Spaces?)
Spaces Toggle
TXYZ.AI (What is TXYZ.AI?)
Related Papers
Recommenders and Search Tools
Link to Influence Flower
Influence Flower (What are Influence Flowers?)
Core recommender toggle
CORE Recommender (What is CORE?)
IArxiv recommender toggle
IArxiv Recommender
(What is IArxiv?)
Author
Venue
Institution
Topic
About arXivLabs
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Which authors of this paper are endorsers? |
Disable MathJax (What is MathJax?)