语言大模型 / LLM - arXivDaily 专题

2410.16257 2024-10-22 cs.CV 82%

Elucidating the design space of language models for image generation

Xuantong Liu, Shaozhe Hao, Xianbiao Qi, Tianyang Hu, Jun Wang, Rong Xiao, Yuan Yao

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)

Comments Project page: https://pepper-lll.github.io/LMforImageGeneration/

2410.14509 2024-10-21 cs.CV 82%

CLIP-VAD: Exploiting Vision-Language Models for Voice Activity Detection

Andrea Appiani, Cigdem Beyan

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)

2410.09141 2024-10-15 cs.CL cs.AI cs.IR cs.LG 82%

ACER: Automatic Language Model Context Extension via Retrieval

Luyu Gao, Yunyi Zhang, Jamie Callan

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2406.01020 2024-10-08 cs.CV 82%

ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretraining

Daekyu Kwon, Dongyoung Kim, Sehwan Ki, Younghyun Jo, Hyong-Euk Lee, Seon Joo Kim

专题命中预训练与数据：pretraining(title,abstract)；language model(abstract)

2311.16201 2024-09-26 cs.CV cs.AI cs.CL cs.LG 82%

Pre-trained Language Models Do Not Help Auto-regressive Text-to-Image Generation

Yuhui Zhang, Brandon McKinzie, Zhe Gan, Vaishaal Shankar, Alexander Toshev

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published at EMNLP 2024 Main Conference

2405.20462 2024-09-25 cs.CV 82%

Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining

Yi Wang, Conrad M Albrecht, Xiao Xiang Zhu

专题命中预训练与数据：pretraining(title,abstract)；foundation model(abstract)

Comments Accepted by IEEE Transactions on Geoscience and Remote Sensing. 16 pages, 10 figures

2409.14329 2024-09-24 cs.SE 82%

ISC4DGF: Enhancing Directed Grey-box Fuzzing with LLM-Driven Initial Seed Corpus Generation

Yijiang Xu, Hongrui Jia, Liguo Chen, Xin Wang, Zhengran Zeng, Yidong Wang, Qing Gao, Jindong Wang, Wei Ye, Shikun Zhang, Zhonghai Wu

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)

Comments 15 pages, 2 figures

2402.04648 2024-09-24 cs.CV 82%

OV-NeRF: Open-vocabulary Neural Radiance Fields with Vision and Language Foundation Models for 3D Semantic Understanding

Guibiao Liao, Kaichen Zhou, Zhenyu Bao, Kanglin Liu, Qing Li

专题命中预训练与数据：foundation model(title,abstract)；pretraining(abstract)

Comments IEEE TCSVT 2024: https://ieeexplore.ieee.org/document/10630553

2409.09427 2024-09-17 cs.MM 82%

Prototypical Prompting for Text-to-image Person Re-identification

Shuanglin Yan, Jun Liu, Neng Dong, Liyan Zhang, Jinhui Tang

专题命中预训练与数据：prompting(title,abstract)；pretraining(abstract)

Comments Accepted by ACM MM2024

2404.09942 2024-09-17 cs.CV 82%

Knowledge-enhanced Visual-Language Pretraining for Computational Pathology

Xiao Zhou, Xiaoman Zhang, Chaoyi Wu, Ya Zhang, Weidi Xie, Yanfeng Wang

专题命中预训练与数据：pretraining(title,abstract)；language model(abstract)

Comments ECCV2024(Oral)

2403.09307 2024-09-17 cs.CV 82%

Annotation Free Semantic Segmentation with Vision Foundation Models

Soroush Seifi, Daniel Olmeda Reino, Fabien Despinoy, Rahaf Aljundi

专题命中预训练与数据：foundation model(title,abstract)；language model(abstract)

2409.07239 2024-09-12 cs.CV 82%

PiTe: Pixel-Temporal Alignment for Large Video-Language Model

Yang Liu, Pengxiang Ding, Siteng Huang, Min Zhang, Han Zhao, Donglin Wang

专题命中预训练与数据：language model(title,abstract)；large language model(abstract)

2408.07852 2024-08-16 cs.CL cs.AI cs.LG 82%

Training Language Models on the Knowledge Graph: Insights on Hallucinations and Their Detectability

Jiri Hron, Laura Culp, Gamaleldin Elsayed, Rosanne Liu, Ben Adlam, Maxwell Bileschi, Bernd Bohnet, JD Co-Reyes, Noah Fiedel, C. Daniel Freeman, Izzeddin Gur, Kathleen Kenealy, Jaehoon Lee, Peter J. Liu, Gaurav Mishra, Igor Mordatch, Azade Nova, Roman Novak, Aaron Parisi, Jeffrey Pennington, Alex Rizkowsky, Isabelle Simpson, Hanie Sedghi, Jascha Sohl-dickstein, Kevin Swersky, Sharad Vikram, Tris Warkentin, Lechao Xiao, Kelvin Xu, Jasper Snoek, Simon Kornblith

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Published at COLM 2024. 16 pages, 11 figures

2404.01536 2024-08-09 cs.CL cs.AI cs.LG 82%

Laying Anchors: Semantically Priming Numerals in Language Modeling

Mandar Sharma, Rutuja Murlidhar Taware, Pravesh Koirala, Nikhil Muralidhar, Naren Ramakrishnan

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to the findings of NAACL 2024

2311.08817 2024-08-09 cs.CL cs.AI cs.LG 82%

MAP's not dead yet: Uncovering true language model modes by conditioning away degeneracy

Davis Yoshida, Kartik Goyal, Kevin Gimpel

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 52 pages, 5 figures, ACL version

2408.03706 2024-08-08 cs.CL cs.AI cs.LG 82%

Local Topology Measures of Contextual Language Model Latent Spaces With Applications to Dialogue Term Extraction

Benjamin Matthias Ruppik, Michael Heck, Carel van Niekerk, Renato Vukovic, Hsien-chin Lin, Shutong Feng, Marcus Zibrowius, Milica Gašić

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted as a long paper to SIGDIAL 2024. 9 pages, 2 figures, 3 tables

2405.15750 2024-08-08 cs.CL cs.AI cs.LG 82%

Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidence

Abhinav Patil, Jaap Jumelet, Yu Ying Chiu, Andy Lapastora, Peter Shen, Lexie Wang, Clevis Willrich, Shane Steinert-Threlkeld

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Forthcoming in Transactions of the Association for Computational Linguistics (TACL). This is a pre-MIT Press publication version. For code and trained models, see http://github.com/CLMBRs/corpus-filtering

2309.14402 2024-07-17 cs.CL cs.AI cs.LG 82%

Physics of Language Models: Part 3.2, Knowledge Manipulation

Zeyuan Allen-Zhu, Yuanzhi Li

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments V2 polishes writing and includes additional Llama/Mistral experiments and larger data; but the conclusions remain unchanged

2407.01784 2024-07-04 cs.CL cs.AI cs.LG 82%

Analyzing Persuasive Strategies in Meme Texts: A Fusion of Language Models with Paraphrase Enrichment

Kota Shamanth Ramanath Nayak, Leila Kosseim

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 15 pages, 8 figures, 1 table, Proceedings of 5th International Conference on Natural Language Processing and Applications (NLPA 2024)

Journal ref Computer Science & Information Technology (CS & IT), ISSN : 2231 - 5403, Volume 14, Number 11, June 2024

2406.15209 2024-06-24 eess.AS 82%

Prompting Whisper for QA-driven Zero-shot End-to-end Spoken Language Understanding

Mohan Li, Simon Keizer, Rama Doddipatla

专题命中预训练与数据：prompting(title)；large language model(abstract)；language model(abstract)

Comments Accepted to Interspeech 2024

2406.03714 2024-06-07 cs.SD eess.AS 82%

Retrieval Augmented Generation in Prompt-based Text-to-Speech Synthesis with Context-Aware Contrastive Language-Audio Pretraining

Jinlong Xue, Yayue Deng, Yingming Gao, Ya Li

专题命中预训练与数据：pretraining(title)；large language model(abstract)；language model(abstract)

Comments Accepted by Interspeech 2024

2311.09109 2024-06-07 cs.CL cs.AI cs.LG 82%

Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion?

Yusuke Sakai, Hidetaka Kamigaito, Katsuhiko Hayashi, Taro Watanabe

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted at NAACL 2024 main oral, 15 pages, 10 figures

2405.18812 2024-05-30 cs.CV 82%

MindSemantix: Deciphering Brain Visual Experiences with a Brain-Language Model

Ziqi Ren, Jie Li, Xuetong Xue, Xin Li, Fan Yang, Zhicheng Jiao, Xinbo Gao

专题命中预训练与数据：language model(title,abstract)；LLM(abstract)

Comments 13 pages, 6 figures

2310.08566 2024-05-28 cs.LG cs.AI cs.CL math.ST stat.ML stat.TH 82%

Transformers as Decision Makers: Provable In-Context Reinforcement Learning via Supervised Pretraining

Licong Lin, Yu Bai, Song Mei

专题命中预训练与数据：pretraining(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2305.16958 2024-05-28 cs.CL cs.AI cs.LG 82%

MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies

Shiyue Zhang, Shijie Wu, Ozan Irsoy, Steven Lu, Mohit Bansal, Mark Dredze, David Rosenberg

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ACL 2023 (22 pages)

2404.12192 2024-04-19 cs.CV 82%

Aligning Actions and Walking to LLM-Generated Textual Descriptions

Radu Chivereanu, Adrian Cosma, Andy Catruna, Razvan Rughinis, Emilian Radoi

专题命中预训练与数据：LLM(title)；large language model(abstract)；language model(abstract)

Comments Accepted at 2nd Workshop on Learning with Few or without Annotated Face, Body and Gesture Data

2404.08078 2024-04-15 cs.CL cs.AI cs.LG 82%

SQBC: Active Learning using LLM-Generated Synthetic Data for Stance Detection in Online Political Discussions

Stefan Sylvius Wagner, Maike Behrendt, Marc Ziegele, Stefan Harmeling

专题命中预训练与数据：LLM(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2404.06244 2024-04-10 cs.CV 82%

Anchor-based Robust Finetuning of Vision-Language Models

Jinwei Han, Zhiwen Lin, Zhongyisun Sun, Yingguo Gao, Ke Yan, Shouhong Ding, Yuan Gao, Gui-Song Xia

专题命中预训练与数据：language model(title,abstract)；pretraining(abstract)

Comments CVPR2024

2404.05405 2024-04-09 cs.CL cs.AI cs.LG 82%

Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws

Zeyuan Allen-Zhu, Yuanzhi Li

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2404.05090 2024-04-09 cs.LG cs.AI cs.CL 82%

How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse

Mohamed El Amine Seddik, Suei-Wen Chen, Soufiane Hayou, Pierre Youssef, Merouane Debbah

专题命中预训练与数据：language model(title,abstract)；分类 cs.CL、cs.AI、cs.LG

1. 预训练与数据 12393 篇

Elucidating the design space of language models for image generation

CLIP-VAD: Exploiting Vision-Language Models for Voice Activity Detection

ACER: Automatic Language Model Context Extension via Retrieval

ATTIQA: Generalizable Image Quality Feature Extractor using Attribute-aware Pretraining

Pre-trained Language Models Do Not Help Auto-regressive Text-to-Image Generation

Multi-Label Guided Soft Contrastive Learning for Efficient Earth Observation Pretraining

ISC4DGF: Enhancing Directed Grey-box Fuzzing with LLM-Driven Initial Seed Corpus Generation

OV-NeRF: Open-vocabulary Neural Radiance Fields with Vision and Language Foundation Models for 3D Semantic Understanding

Prototypical Prompting for Text-to-image Person Re-identification

Knowledge-enhanced Visual-Language Pretraining for Computational Pathology

Annotation Free Semantic Segmentation with Vision Foundation Models

PiTe: Pixel-Temporal Alignment for Large Video-Language Model

Training Language Models on the Knowledge Graph: Insights on Hallucinations and Their Detectability

Laying Anchors: Semantically Priming Numerals in Language Modeling

MAP's not dead yet: Uncovering true language model modes by conditioning away degeneracy

Local Topology Measures of Contextual Language Model Latent Spaces With Applications to Dialogue Term Extraction

Filtered Corpus Training (FiCT) Shows that Language Models can Generalize from Indirect Evidence

Physics of Language Models: Part 3.2, Knowledge Manipulation

Analyzing Persuasive Strategies in Meme Texts: A Fusion of Language Models with Paraphrase Enrichment

Prompting Whisper for QA-driven Zero-shot End-to-end Spoken Language Understanding

Retrieval Augmented Generation in Prompt-based Text-to-Speech Synthesis with Context-Aware Contrastive Language-Audio Pretraining

Does Pre-trained Language Model Actually Infer Unseen Links in Knowledge Graph Completion?

MindSemantix: Deciphering Brain Visual Experiences with a Brain-Language Model

Transformers as Decision Makers: Provable In-Context Reinforcement Learning via Supervised Pretraining

MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies

Aligning Actions and Walking to LLM-Generated Textual Descriptions

SQBC: Active Learning using LLM-Generated Synthetic Data for Stance Detection in Online Political Discussions

Anchor-based Robust Finetuning of Vision-Language Models

Physics of Language Models: Part 3.3, Knowledge Capacity Scaling Laws

How Bad is Training on Synthetic Data? A Statistical Analysis of Language Model Collapse