大模型推理能力

How often are errors in natural language reasoning due to paraphrastic variability?

Neha Srikanth, Marine Carpuat, Rachel Rudinger

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments accepted to TACL 2024 (pre-MIT Press publication version)

LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning

Junchi Wang, Lei Ke

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

Comments Github: https://github.com/wangjunchi/LLMSeg

Selective Temporal Knowledge Graph Reasoning

Zhongni Hou, Xiaolong Jin, Zixuan Li, Long Bai, Jiafeng Guo, Xueqi Cheng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

FSMR: A Feature Swapping Multi-modal Reasoning Approach with Joint Textual and Visual Clues

Shuang Li, Jiahua Wang, Lijie Wen

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Effective Distillation of Table-based Reasoning Ability from LLMs

Bohao Yang, Chen Tang, Kun Zhao, Chenghao Xiao, Chenghua Lin

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs

Victor Carbune, Hassan Mansoor, Fangyu Liu, Rahul Aralikatte, Gilles Baechler, Jindong Chen, Abhanshu Sharma

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Findings of NAACL 2024

ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning

Ahmed Masry, Mehrad Shahmohammadi, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

BizBench: A Quantitative Reasoning Benchmark for Business and Finance

Rik Koncel-Kedziorski, Michael Krumdick, Viet Lai, Varshini Reddy, Charles Lovering, Chris Tanner

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Work in progress

CLEVR-POC: Reasoning-Intensive Visual Question Answering in Partially Observable Environments

Savitha Sam Abraham, Marjan Alirezaie, Luc De Raedt

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments 17 pages, 10 images, Accepted at LREC-COLING 2024 - The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation

Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism

Shuvayan Brahmachary, Subodh M. Joshi, Aniruddha Panda, Kaushik Koneripalli, Arun Kumar Sagotra, Harshil Patel, Ankush Sharma, Ameya D. Jagtap, Kaushic Kalyanaraman

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Personality-aware Human-centric Multimodal Reasoning: A New Task, Dataset and Baselines

Yaochen Zhu, Xiangqing Shen, Rui Xia

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

CR-LT-KGQA: A Knowledge Graph Question Answering Dataset Requiring Commonsense Reasoning and Long-Tail Knowledge

Willis Guo, Armin Toroghi, Scott Sanner

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 7 pages

Crimson: Empowering Strategic Reasoning in Cybersecurity through Large Language Models

Jiandong Jin, Bowen Tang, Mingxuan Ma, Xiao Liu, Yunfei Wang, Qingnan Lai, Jia Yang, Changling Zhou

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments 9 pages, 7 figures

Toward Grounded Commonsense Reasoning

Minae Kwon, Hengyuan Hu, Vivek Myers, Siddharth Karamcheti, Anca Dragan, Dorsa Sadigh

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments IEEE International Conference on Robotics and Automation 2024

BDIQA: A New Dataset for Video Question Answering to Explore Cognitive Reasoning through Theory of Mind

Yuanyuan Mao, Xin Lin, Qin Ni, Liang He

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Enhancing Large Language Model with Decomposed Reasoning for Emotion Cause Pair Extraction

Jialiang Wu, Yi Shen, Ziheng Zhang, Longjun Cai

专题命中 推理评测 ：reasoning(title)；chain-of-thought(abstract)；分类 cs.CL

Comments 13 pages, 5 figures

FinLLMs: A Framework for Financial Reasoning Dataset Generation with Large Language Models

Ziqiang Yuan, Kaiyuan Wang, Shoutai Zhu, Ye Yuan, Jingya Zhou, Yanlin Zhu, Wenqi Wei

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Under submission of IEEE Transactions

StarCraftImage: A Dataset For Prototyping Spatial Reasoning Methods For Multi-Agent Environments

Sean Kulinski, Nicholas R. Waytowich, James Z. Hare, David I. Inouye

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Published in CVPR 23'

Journal ref Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2023

Can Vision-Language Models be a Good Guesser? Exploring VLMs for Times and Location Reasoning

Gengyuan Zhang, Yurui Zhang, Kerui Zhang, Volker Tresp

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Accepted to WACV 2024

GeomVerse: A Systematic Evaluation of Large Models for Geometric Reasoning

Mehran Kazemi, Hamidreza Alvari, Ankit Anand, Jialin Wu, Xi Chen, Radu Soricut

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Evaluating the Rationale Understanding of Critical Reasoning in Logical Reading Comprehension

Akira Kawabata, Saku Sugawara

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to EMNLP 2023

Pre-training Language Models for Comparative Reasoning

Mengxia Yu, Zhihan Zhang, Wenhao Yu, Meng Jiang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments EMNLP 2023 - Camera Ready. Typos fixed

Emergent Communication for Rules Reasoning

Yuxuan Guo, Yifan Hao, Rui Zhang, Enshuai Zhou, Zidong Du, Xishan Zhang, Xinkai Song, Yuanbo Wen, Yongwei Zhao, Xuehai Zhou, Jiaming Guo, Qi Yi, Shaohui Peng, Di Huang, Ruizhi Chen, Qi Guo, Yunji Chen

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text

Wenting Zhao, Ye Liu, Tong Niu, Yao Wan, Philip S. Yu, Shafiq Joty, Yingbo Zhou, Semih Yavuz

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

SituatedGen: Incorporating Geographical and Temporal Contexts into Generative Commonsense Reasoning

Yunxiang Zhang, Xiaojun Wan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to NeurIPS 2023 Datasets and Benchmarks Track

Open-ended Commonsense Reasoning with Unrestricted Answer Scope

Chen Ling, Xuchao Zhang, Xujiang Zhao, Yanchi Liu, Wei Cheng, Mika Oishi, Takao Osaki, Katsushi Matsuda, Haifeng Chen, Liang Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Findings of EMNLP 2023

IRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection

Jingcheng Deng, Hengwei Dai, Xuewei Guo, Yuanchen Ju, Wei Peng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted by EMNLP 2022

Mastering the Task of Open Information Extraction with Large Language Models and Consistent Reasoning Environment

Ji Qi, Kaixuan Ji, Xiaozhi Wang, Jifan Yu, Kaisheng Zeng, Lei Hou, Juanzi Li, Bin Xu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Measuring reasoning capabilities of ChatGPT

Adrian Groza

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Event Prediction using Case-Based Reasoning over Knowledge Graphs

Sola Shirai, Debarun Bhattacharjya, Oktie Hassanzadeh

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments published at WWW '23: Proceedings of the ACM Web Conference 2023. Code base: https://github.com/solashirai/WWW-EvCBR