大模型推理能力 - arXivDaily 专题

2410.05983 2024-10-10 cs.CL cs.AI cs.LG 67%

Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG

Bowen Jin, Jinsung Yoon, Jiawei Han, Sercan O. Arik

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 34 pages

2407.08044 2024-09-30 cs.CL cs.AI cs.LG 67%

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization

Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2024 Findings, Codes: https://github.com/HuangOwen/RoLoRA, Models: https://huggingface.co/collections/ScarletAce/rolora-66f5f228a90681c7c4512b28

2407.21439 2024-09-26 cs.AI cs.CL cs.LG 67%

MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training

Zhanpeng Chen, Chengjin Xu, Yiyan Qi, Jian Guo

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2409.13884 2024-09-24 cs.CL cs.AI cs.CY cs.LG 67%

A Multi-LLM Debiasing Framework

Deonna M. Owens, Ryan A. Rossi, Sungchul Kim, Tong Yu, Franck Dernoncourt, Xiang Chen, Ruiyi Zhang, Jiuxiang Gu, Hanieh Deilamsalehy, Nedim Lipka

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2409.13321 2024-09-23 cs.LG cs.AI cs.CL cs.CV 67%

SLaVA-CXR: Small Language and Vision Assistant for Chest X-ray Report Automation

Jinge Wu, Yunsoo Kim, Daqian Shi, David Cliffton, Fenglin Liu, Honghan Wu

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2303.16199 2024-09-20 cs.CV cs.AI cs.CL cs.LG cs.MM 67%

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention

Renrui Zhang, Jiaming Han, Chris Liu, Peng Gao, Aojun Zhou, Xiangfei Hu, Shilin Yan, Pan Lu, Hongsheng Li, Yu Qiao

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by ICLR 2024. Code is available at https://github.com/OpenGVLab/LLaMA-Adapter

2408.12337 2024-08-23 cs.CL cs.AI cs.LG cs.SY eess.SY 67%

Fine-tuning Smaller Language Models for Question Answering over Financial Documents

Karmvir Singh Phogat, Sai Akhil Puranam, Sridhar Dasaratha, Chetan Harsha, Shashishekar Ramakrishna

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2311.09263 2024-08-21 cs.LG cs.AI cs.CL 67%

Auto-ICL: In-Context Learning without Human Supervision

Jinghan Yang, Shuming Ma, Furu Wei

专题命中其他推理：CoT(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Under review

2310.03710 2024-08-15 cs.CL cs.AI cs.LG 67%

Agent Instructs Large Language Models to be General Zero-Shot Reasoners

Nicholas Crispino, Kyle Montgomery, Fankun Zeng, Dawn Song, Chenguang Wang

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to ICML 2024

2408.00307 2024-08-02 cs.LG cs.AI cs.CL 67%

ABC Align: Large Language Model Alignment for Safety & Accuracy

Gareth Seneque, Lap-Hang Ho, Ariel Kuperman, Nafise Erfanian Saeedi, Jeffrey Molendijk

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 23 pages, 4 figures

2405.17430 2024-07-30 cs.CV cs.AI cs.CL cs.LG 67%

Matryoshka Multimodal Models

Mu Cai, Jianwei Yang, Jianfeng Gao, Yong Jae Lee

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Project Page: https://matryoshka-mm.github.io/

2302.04449 2024-07-23 cs.LG cs.AI cs.CL 67%

Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals

Yue Wu, Yewen Fan, Paul Pu Liang, Amos Azaria, Yuanzhi Li, Tom M. Mitchell

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.18676 2024-07-19 cs.CL cs.AI cs.LG 67%

Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation

Guanting Dong, Yutao Zhu, Chenghao Zhang, Zechen Wang, Zhicheng Dou, Ji-Rong Wen

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Work in progress

2406.13173 2024-07-17 cs.CV cs.AI cs.CL cs.LG 67%

Biomedical Visual Instruction Tuning with Clinician Preference Alignment

Hejie Cui, Lingjun Mao, Xin Liang, Jieyu Zhang, Hui Ren, Quanzheng Li, Xiang Li, Carl Yang

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2403.12014 2024-07-15 cs.CL cs.AI cs.LG 67%

EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents

Abhay Zala, Jaemin Cho, Han Lin, Jaehong Yoon, Mohit Bansal

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments COLM 2024; First two authors contributed equally; Project website: https://envgen-llm.github.io/

2403.10854 2024-07-12 cs.CV 67%

A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment

Tianhe Wu, Kede Ma, Jie Liang, Yujiu Yang, Lei Zhang

专题命中其他推理：reasoning(abstract)；chain-of-thought(abstract)

2402.13228 2024-07-04 cs.CL cs.AI cs.LG 67%

Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positive

Arka Pal, Deep Karkhanis, Samuel Dooley, Manley Roberts, Siddartha Naidu, Colin White

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2406.04031 2024-07-02 cs.CV cs.CR 67%

Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt

Zonghao Ying, Aishan Liu, Tianyuan Zhang, Zhengmin Yu, Siyuan Liang, Xianglong Liu, Dacheng Tao

专题命中其他推理：reasoning(abstract)；chain-of-thought(abstract)

2402.05602 2024-06-11 cs.CL cs.AI cs.CV cs.LG 67%

AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformers

Reduan Achtibat, Sayed Mohammad Vakilzadeh Hatefi, Maximilian Dreyer, Aakriti Jain, Thomas Wiegand, Sebastian Lapuschkin, Wojciech Samek

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2401.06102 2024-06-10 cs.CL cs.AI cs.LG 67%

Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models

Asma Ghandeharioun, Avi Caciularu, Adam Pearce, Lucas Dixon, Mor Geva

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICML 2024 (to appear)

2405.14863 2024-05-24 cs.CL cs.AI cs.LG 67%

A Nurse is Blue and Elephant is Rugby: Cross Domain Alignment in Large Language Models Reveal Human-like Patterns

Asaf Yehudai, Taelin Karidi, Gabriel Stanovsky, Ariel Goldstein, Omri Abend

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments CogSci

2403.19669 2024-05-13 cs.LG cs.AI cs.CL cs.CV 67%

Analyzing the Roles of Language and Vision in Learning from Limited Data

Allison Chen, Ilia Sucholutsky, Olga Russakovsky, Thomas L. Griffiths

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 8 pages, 4 figures

2402.07148 2024-04-02 cond-mat.soft cond-mat.dis-nn cs.AI cs.CL cs.LG q-bio.QM 67%

X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Design

Eric L. Buehler, Markus J. Buehler

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2403.18406 2024-03-28 cs.CV cs.AI cs.CL cs.LG 67%

An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM

Wonkyun Kim, Changin Choi, Wonseok Lee, Wonjong Rhee

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Our code is available at https://github.com/imagegridworth/IG-VLM

2403.10949 2024-03-27 cs.CL cs.AI cs.LG 67%

SelfIE: Self-Interpretation of Large Language Model Embeddings

Haozhe Chen, Carl Vondrick, Chengzhi Mao

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2305.11490 2024-03-19 cs.CV cs.AI cs.CL cs.LG 67%

LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation

Suhyeon Lee, Won Jun Kim, Jinho Chang, Jong Chul Ye

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 21 pages, 8 figures; ICLR 2024 (poster)

2402.16038 2024-02-27 cs.CL cs.AI cs.LG 67%

Deep Learning Approaches for Improving Question Answering Systems in Hepatocellular Carcinoma Research

Shuning Huo, Yafei Xiang, Hanyi Yu, Mengran Zhu, Yulu Gong

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2311.09114 2024-02-27 cs.CL cs.AI cs.LG 67%

Ever: Mitigating Hallucination in Large Language Models through Real-Time Verification and Rectification

Haoqiang Kang, Juntong Ni, Huaxiu Yao

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.07069 2024-02-13 cs.LG cs.AI cs.CL 67%

Using Large Language Models to Automate and Expedite Reinforcement Learning with Reward Machine

Shayan Meshkat Alsadat, Jean-Raphael Gaglione, Daniel Neider, Ufuk Topcu, Zhe Xu

专题命中其他推理：chain-of-thought(abstract)；分类 cs.CL、cs.AI、cs.LG

2402.00070 2024-02-02 cs.NE cs.AI cs.CL cs.LG 67%

EvoMerge: Neuroevolution for Large Language Models

Yushu Jiang

专题命中其他推理：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The current submission is the first draft, published for the sole purpose of sharing an idea and encouraging community effort. A more consolidated version may come later

1. 其他推理 5804 篇

Long-Context LLMs Meet RAG: Overcoming Challenges for Long Inputs in RAG

RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization

MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training

A Multi-LLM Debiasing Framework

SLaVA-CXR: Small Language and Vision Assistant for Chest X-ray Report Automation

LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init Attention

Fine-tuning Smaller Language Models for Question Answering over Financial Documents

Auto-ICL: In-Context Learning without Human Supervision

Agent Instructs Large Language Models to be General Zero-Shot Reasoners

ABC Align: Large Language Model Alignment for Safety & Accuracy

Matryoshka Multimodal Models

Read and Reap the Rewards: Learning to Play Atari with the Help of Instruction Manuals

Understand What LLM Needs: Dual Preference Alignment for Retrieval-Augmented Generation

Biomedical Visual Instruction Tuning with Clinician Preference Alignment

EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents

A Comprehensive Study of Multimodal Large Language Models for Image Quality Assessment

Smaug: Fixing Failure Modes of Preference Optimisation with DPO-Positive

Jailbreak Vision Language Models via Bi-Modal Adversarial Prompt

AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformers

Patchscopes: A Unifying Framework for Inspecting Hidden Representations of Language Models

A Nurse is Blue and Elephant is Rugby: Cross Domain Alignment in Large Language Models Reveal Human-like Patterns

Analyzing the Roles of Language and Vision in Learning from Limited Data

X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Design

An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM

SelfIE: Self-Interpretation of Large Language Model Embeddings

LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation

Deep Learning Approaches for Improving Question Answering Systems in Hepatocellular Carcinoma Research

Ever: Mitigating Hallucination in Large Language Models through Real-Time Verification and Rectification

Using Large Language Models to Automate and Expedite Reinforcement Learning with Reward Machine

EvoMerge: Neuroevolution for Large Language Models