大模型推理能力

BDC-Adapter: Brownian Distance Covariance for Better Vision-Language Reasoning

Yi Zhang, Ce Zhang, Zihan Liao, Yushun Tang, Zhihai He

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted by BMVC 2023

Grounded Image Text Matching with Mismatched Relation Reasoning

Yu Wu, Yana Wei, Haozhe Wang, Yongfei Liu, Sibei Yang, Xuming He

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning

Hengli Li, Song-Chun Zhu, Zilong Zheng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

STEPS: A Benchmark for Order Reasoning in Sequential Tasks

Weizhi Wang, Hong Wang, Xifeng Yan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Work in Progress

True Detective: A Deep Abductive Reasoning Benchmark Undoable for GPT-3 and Challenging for GPT-4

Maksym Del, Mark Fishel

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 5 pages, to appear at *SEM

FERMAT: An Alternative to Accuracy for Numerical Reasoning

Jasivan Alex Sivakumar, Nafise Sadat Moosavi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments ACL 2023

Element-aware Summarization with Large Language Models: Expert-aligned Evaluation and Chain-of-Thought Method

Yiming Wang, Zhuosheng Zhang, Rui Wang

专题命中 推理评测 ：chain-of-thought(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2023

Benchmarks for Automated Commonsense Reasoning: A Survey

Ernest Davis

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

DiscoSense: Commonsense Reasoning with Discourse Connectives

Prajjwal Bhargava, Vincent Ng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments EMNLP 2022

Answering Numerical Reasoning Questions in Table-Text Hybrid Contents with Graph-based Encoder and Tree-based Decoder

Fangyu Lei, Shizhu He, Xiang Li, Jun Zhao, Kang Liu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted by COLING 2022

CRASS: A Novel Data Set and Benchmark to Test Counterfactual Reasoning of Large Language Models

Jörg Frohberg, Frank Binder

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 10 pages including references, plus 5 pages appendix. Edits for version 3 vs LREC 2022: Point out human baseline in abstract (also to match arxiv abstract), fix affiliation apergo.ai, and fix a recurring typo

Journal ref Proceedings of the 13th Language Resources and Evaluation Conference (LREC 2022), Marseille, France pp. 2126-2140 (2022) https://aclanthology.org/2022.lrec-1.229/

LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning

Neel Guha, Daniel E. Ho, Julian Nyarko, Christopher Ré

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments 13 pages, 7 tables

Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning

Letian Peng, Zuchao Li, Hai Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Generative Data Augmentation for Commonsense Reasoning

Yiben Yang, Chaitanya Malaviya, Jared Fernandez, Swabha Swayamdipta, Ronan Le Bras, Ji-Ping Wang, Chandra Bhagavatula, Yejin Choi, Doug Downey

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Findings of the Association for Computational Linguistics: EMNLP 2020

Relevant CommonSense Subgraphs for "What if..." Procedural Reasoning

Chen Zheng, Parisa Kordjamshidi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2022 findings short paper

Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding

Shane Storks, Qiaozi Gao, Yichi Zhang, Joyce Chai

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to Findings of EMNLP 2021

KMIR: A Benchmark for Evaluating Knowledge Memorization, Identification and Reasoning Abilities of Language Models

Daniel Gao, Yantao Jia, Lei Li, Chengzhen Fu, Zhicheng Dou, Hao Jiang, Xinyu Zhang, Lei Chen, Zhao Cao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoning

Jiaqi Chen, Jianheng Tang, Jinghui Qin, Xiaodan Liang, Lingbo Liu, Eric P. Xing, Liang Lin

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Accepted to Findings of ACL 2021

Discovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformer

Shivani Kumar, Anubhav Shrimal, Md Shad Akhtar, Tanmoy Chakraborty

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted in Knowledge-Based Systems; 34 pages, 4 figures, 15 tables

Reasoning Chain Based Adversarial Attack for Multi-hop Question Answering

Jiayu Ding, Siyuan Wang, Qin Chen, Zhongyu Wei

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 10 pages including reference, 4 figures

Answering Open-Domain Questions of Varying Reasoning Steps from Text

Peng Qi, Haejun Lee, Oghenetegiri "TG" Sido, Christopher D. Manning

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments EMNLP 2021. Peng Qi, Haejun Lee, and TG Sido contributed equally

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments First place in XCSR Leaderboard: https://inklab.usc.edu//XCSR/leaderboard. Work in progress

L2R2: Leveraging Ranking for Abductive Reasoning

Yunchang Zhu, Liang Pang, Yanyan Lan, Xueqi Cheng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments SIGIR 2020

Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability

Xin Lv, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Yichi Zhang, Zelin Dai

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models

Kaixin Ma, Filip Ilievski, Jonathan Francis, Satoru Ozaki, Eric Nyberg, Alessandro Oltramari

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments EMNLP 2021

Hybrid Reasoning Network for Video-based Commonsense Captioning

Weijiang Yu, Jian Liang, Lei Ji, Lu Li, Yuejian Fang, Nong Xiao, Nan Duan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 11 pages, 6 figures

Communicative Message Passing for Inductive Relation Reasoning

Sijie Mai, Shuangjia Zheng, Yuedong Yang, Haifeng Hu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Accepted by AAAI-2021

TIMEDIAL: Temporal Commonsense Reasoning in Dialog

Lianhui Qin, Aditya Gupta, Shyam Upadhyay, Luheng He, Yejin Choi, Manaal Faruqui

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

PROST: Physical Reasoning of Objects through Space and Time

Stéphane Aroca-Ouellette, Cory Paik, Alessandro Roncone, Katharina Kann

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to ACL-Findings 2021, 9 Pages

Temporal Reasoning on Implicit Events from Distant Supervision

Ben Zhou, Kyle Richardson, Qiang Ning, Tushar Khot, Ashish Sabharwal, Dan Roth

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted at NAACL 2021