语言大模型 / LLM

Knesset-DictaBERT: A Hebrew Language Model for Parliamentary Proceedings

Gili Goldin, Shuly Wintner

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Comments 3 pages, 1 table

Dream2Real: Zero-Shot 3D Object Rearrangement with Vision-Language Models

Ivan Kapelyukh, Yifei Ren, Ignacio Alzugaray, Edward Johns

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.LG

Comments ICRA 2024. Project webpage with robot videos: https://www.robot-learning.uk/dream2real

Strong Copyright Protection for Language Models via Adaptive Model Fusion

Javier Abad, Konstantin Donhauser, Francesco Pinto, Fanny Yang

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.LG

Leveraging Foundation Models for Zero-Shot IoT Sensing

Dinghao Xue, Xiaoran Fan, Tao Chen, Guohao Lan, Qun Song

专题命中 预训练与数据 ：foundation model(title,abstract)；分类 cs.AI

[Call for Papers] The 2nd BabyLM Challenge: Sample-efficient pretraining on a developmentally plausible corpus

Leshem Choshen, Ryan Cotterell, Michael Y. Hu, Tal Linzen, Aaron Mueller, Candace Ross, Alex Warstadt, Ethan Wilcox, Adina Williams, Chengxu Zhuang

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.CL

In-Context Learning Improves Compositional Understanding of Vision-Language Models

Matteo Nulli, Anesa Ibrahimi, Avik Pal, Hoshe Lee, Ivona Najdenkoska

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.AI

Distilling Vision-Language Foundation Models: A Data-Free Approach via Prompt Diversification

Yunyi Xuan, Weijie Chen, Shicai Yang, Di Xie, Luojun Lin, Yueting Zhuang

专题命中 预训练与数据 ：foundation model(title,abstract)；分类 cs.AI

Comments Accepted by ACMMM 2023

AlcLaM: Arabic Dialectal Language Model

Murtadha Ahmed, Saghir Alfasly, Bo Wen, Jamaal Qasem, Mohammed Ahmed, Yunfeng Liu

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Comments Accepted by ArabicNLP 2024, presented in ACL 2024

A Language Modeling Approach to Diacritic-Free Hebrew TTS

Amit Roth, Arnon Turetzky, Yossi Adi

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Comments Accepted at Interspeech24

Position: Considerations for Differentially Private Learning with Large-Scale Public Pretraining

Florian Tramèr, Gautam Kamath, Nicholas Carlini

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments Full and unabridged version of paper ICML 2024

Ancient Korean Archive Translation: Comparison Analysis on Statistical phrase alignment, LLM in-context learning, and inter-methodological approach

Sojung Lucia Kim, Taehong Jang, Joonmo Ahn

专题命中 预训练与数据 ：LLM(title,abstract)；分类 cs.CL

Comments ACL2024 submitted

Self-supervised Pretraining for Partial Differential Equations

Varun Madhavan, Amal S Sebastian, Bharath Ramsundar, Venkatasubramanian Viswanathan

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

BAMBINO-LM: (Bilingual-)Human-Inspired Continual Pretraining of BabyLM

Zhewen Shen, Aditya Joshi, Ruey-Cheng Chen

专题命中 预训练与数据 ：pretraining(title)；language model(abstract)；分类 cs.CL

Comments 5 pages + references; Selected at CMCL Workshop@ACL 2024

Pretraining End-to-End Keyword Search with Automatically Discovered Acoustic Units

Bolaji Yusuf, Jan "Honza" Černocký, Murat Saraçlar

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.CL

Comments Interspeech 2024. KWS code at: https://github.com/bolajiy/golden-retriever; AUD code at https://github.com/beer-asr/beer/tree/master/recipes/hshmm

Compact Speech Translation Models via Discrete Speech Units Pretraining

Tsz Kin Lam, Alexandra Birch, Barry Haddow

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.CL

Comments 11 pages, accepted at IWSLT 2024

InstructPatentGPT: Training patent language models to follow instructions with human feedback

Jieh-Sheng Lee

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Comments 41 pages. Artif Intell Law (2024)

Reducing Privacy Risks in Online Self-Disclosures with Language Models

Yao Dou, Isadora Krsek, Tarek Naous, Anubha Kabra, Sauvik Das, Alan Ritter, Wei Xu

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Comments Accepted at ACL 2024

Protecting Privacy Through Approximating Optimal Parameters for Sequence Unlearning in Language Models

Dohyun Lee, Daniel Rim, Minseok Choi, Jaegul Choo

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Comments Accepted to ACL2024 findings

Pretraining Strategy for Neural Potentials

Zehua Zhang, Zijie Li, Amir Barati Farimani

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

GFM4MPM: Towards Geospatial Foundation Models for Mineral Prospectivity Mapping

Angel Daruna, Vasily Zadorozhnyy, Georgina Lukoczki, Han-Pang Chiu

专题命中 预训练与数据 ：foundation model(title)；pretraining(abstract)；分类 cs.LG

Comments 12 pages, 16 figures, 7 tables

Taiyi-Diffusion-XL: Advancing Bilingual Text-to-Image Generation with Large Vision-Language Model Support

Xiaojun Wu, Dixiang Zhang, Ruyi Gan, Junyu Lu, Ziwei Wu, Renliang Sun, Jiaxing Zhang, Pingjian Zhang, Yan Song

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

Comments Taiyi-Diffusion-XL Tech Report

Benchmarking Zero-Shot Recognition with Vision-Language Models: Challenges on Granularity and Specificity

Zhenlin Xu, Yi Zhu, Tiffany Deng, Abhay Mittal, Yanbei Chen, Manchen Wang, Paolo Favaro, Joseph Tighe, Davide Modolo

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.AI

Comments CVPR2024 MMFM workshop

Fewer Tokens and Fewer Videos: Extending Video Understanding Abilities in Large Vision-Language Models

Shimin Chen, Yitian Yuan, Shaoxiang Chen, Zequn Jie, Lin Ma

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.AI

The Curse of Popularity: Popular Entities have Catastrophic Side Effects when Deleting Knowledge from Language Models

Ryosuke Takahashi, Go Kamoda, Benjamin Heinzerling, Keisuke Sakaguchi, Kentaro Inui

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.CL

MLIP: Efficient Multi-Perspective Language-Image Pretraining with Exhaustive Data Utilization

Yu Zhang, Qi Zhang, Zixuan Gong, Yiwei Shi, Yepeng Liu, Duoqian Miao, Yang Liu, Ke Liu, Kun Yi, Wei Fan, Liang Hu, Changwei Wang

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.AI

Comments ICML 2024

Position: Graph Foundation Models are Already Here

Haitao Mao, Zhikai Chen, Wenzhuo Tang, Jianan Zhao, Yao Ma, Tong Zhao, Neil Shah, Mikhail Galkin, Jiliang Tang

专题命中 预训练与数据 ：foundation model(title,abstract)；分类 cs.LG

Comments 23 pages, 2 figures

Evaluating Vision-Language Models on Bistable Images

Artemis Panagopoulou, Coby Melkin, Chris Callison-Burch

专题命中 预训练与数据 ：language model(title,abstract)；分类 cs.AI

FaultFormer: Pretraining Transformers for Adaptable Bearing Fault Classification

Anthony Zhou, Amir Barati Farimani

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments 10 pages, 6 figures

Journal ref in IEEE Access, vol. 12, pp. 70719-70728, 2024

A Study on Self-Supervised Pretraining for Vision Problems in Gastrointestinal Endoscopy

Edward Sanderson, Bogdan J. Matuszewski

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Analysis of Atom-level pretraining with Quantum Mechanics (QM) data for Graph Neural Networks Molecular property models

Jose Arjona-Medina, Ramil Nugmanov

专题命中 预训练与数据 ：pretraining(title,abstract)；分类 cs.LG

Comments 6 pages + 11 Supplement Materials