CausalFlip: A Benchmark for LLM Causal Judgment Beyond Semantic Matching
CausalFlip: 超越语义匹配的LLM因果判断基准
专题命中 推理评测 :CoT(abstract,abstract_cn);reasoning(abstract);chain-of-thought(abstract);分类 cs.AI
AI总结 提出CausalFlip基准,通过构建语义相似但因果答案相反的问题对和噪声前缀评估,揭示LLM依赖语义匹配而非因果推理,并验证内化因果推理方法可提升因果基础。
Comments 8 pages plus references, 3 figures, 3 tables. Under review