主题:AdaDetectGPT: Adaptive Detection of LLM-Generated Text with Statistical Guarantees
主讲人:朱进 英国伦敦政治经济学院
主持人:姜云卢 暨南大学
时间:2025年6月10日(周二)下午16:30-17:30
地点:暨南大学石牌校区经济学院(中惠楼)102室
摘要
We study the problem of determining whether a piece of text has been authored by a human or by a large language model (LLM). Existing state of the art logits-based detectors make use of statistics derived from the log-probability of the observed text evaluated using the distribution function of a given source LLM. However, relying solely on log probabilities can be sub-optimal. In response, we introduce AdaDetectGPT -- a novel classifier that adaptively learns a witness function from training data to enhance the performance of logits-based detectors. We provide statistical guarantees on its true positive rate, false positive rate, true negative rate and false negative rate. Extensive numerical studies show AdaDetectGPT nearly uniformly improves the state-of-the-art method in various combination of datasets and LLMs, and the improvement can reach up to 58%.
主讲人简介
朱进,伦敦政治经济学院博士后,于中山大学获得博士学位。主要研究领域包括强化学习和高维数据分析,相关成果发表在PNAS、JASA、JMLR、ICML 等期刊和会议。
欢迎感兴趣的师生参加!
校对|姜云卢
责编| 彭毅
初审| 姜云卢
终审发布| 何凌云
(来源:暨南大学经济学院微信公众号)