Taking a Deep Breath: Enhancing Language Modeling of Large Language Models with Sentinel Tokens
深呼吸:通过哨兵令牌增强大语言模型的语言建模
Weiyao Luo, Suncong Zheng, Heming Xia, Weikang Wang, Yan Lei, Tianyu Liu, Shuang Chen, Zhifang Sui
机构
*
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,北京大学计算机学院)
;
School of Software & Microelectronics, Peking University(北京大学软件与微电子学院)
;
Tencent Hunyuan(腾讯文言)
;
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系)
;
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
;
Alibaba Group(阿里巴巴集团)
专题命中
领域大模型
:large language model(title,abstract);language model(title,abstract);分类 cs.CL
Agreement Between Large Language Models, Human Reviewers, and Authors in Evaluating STROBE Checklists for Observational Studies in Rheumatology
大型语言模型、人类评审员和作者在评估风湿病学观察性研究的STROBE检查表中的一致性
Emre Bilgin, Ebru Ozturk, Meera Shah, Lisa Traboco, Rebecca Everitt, Ai Lyn Tan, Marwan Bukhari, Vincenzo Venerito, Latika Gupta
机构
*
Sakarya University, Faculty of Medicine, Department of Internal Medicine, Division of Rheumatology(萨克森大学医学院内科学系风湿病科)
;
St Luke’s Medical Center (Global City), Philippines(菲律宾St Luke’s医疗中心(全球城))
;
New Cross Hospital, The Royal Wolverhampton Trust, Wolverhampton, United Kingdom(英国伍尔弗汉普顿皇家信托新交叉医院)
;
Lancaster University Medical School, Lancaster University, Lancaster, United Kingdom(英国兰卡斯特大学医学学院,兰卡斯特大学,兰卡斯特,英国)
;
Department of Rheumatology, Royal Lancaster Infirmary, Lancaster, United Kingdom(英国兰卡斯特皇家医院风湿病科,兰卡斯特,英国)
;
Department of Rheumatology, Royal Wolverhampton Hospitals NHS Trust, Wolverhampton, UK(英国伍尔弗汉普顿皇家医院 NHS信托风湿病科,伍尔弗汉普顿,英国)
专题命中
领域大模型
:large language model(title,abstract);language model(title,abstract);分类 cs.AI
Dementia-R1: Reinforced Pretraining and Reasoning from Unstructured Clinical Notes for Real-World Dementia Prognosis
Dementia-R1: 从无结构临床笔记中通过强化预训练和推理进行真实世界痴呆症预后预测
Choonghan Kim, Hyunmin Hwang, Hangeol Chang, Jaemin Kim, Jinse Park, Jae-Sung Lim, Jong Chul Ye
机构
*
Graduate School of AI, KAIST, Republic of Korea(韩国科学技术院人工智能研究生院)
;
Haeundae Paik Hospital, Inje University, Republic of Korea(韩国延世大学海云台医院)
;
Asan Medical Center, University of Ulsan College of Medicine, Republic of Korea(韩国釜山大学医学院阿桑医院)
专题命中
领域大模型
:pretraining(title);LLM(abstract);large language model(abstract);language model(abstract)
Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers
可扩展的跨设施联邦学习用于多超级计算机上的科学基础模型
Yijiang Li, Zilinghan Li, Kyle Chard, Ian Foster, Todd Munson, Ravi Madduri, Kibaek Kim
机构
*
Mathematics and Computer Science Division, Argonne National Laboratory(阿贡国家实验室数学与计算机科学 division)
;
Data Science and Learning Division, Argonne National Laboratory(阿贡国家实验室数据科学与学习 division)
;
Department of Computer Science, University of Chicago(芝加哥大学计算机科学系)
专题命中
领域大模型
:foundation model(title);large language model(abstract);language model(abstract);分类 cs.LG
ReXInTheWild: A Unified Benchmark for Medical Photograph Understanding
ReXInTheWild:医疗照片理解的统一基准
Oishi Banerjee, Sung Eun Kim, Alexandra N. Willauer, Julius M. Kernbach, Abeer Rihan Alomaish, Reema Abdulwahab S. Alghamdi, Hassan Rayhan Alomaish, Mohammed Baharoon, Xiaoman Zhang, Julian Nicolas Acosta, Christine Zhou, Pranav Rajpurkar
机构
*
Department of Biomedical Informatics, Harvard Medical School(哈佛医学院生物医学信息学系)
;
National Strategic Technology Research Institute, Seoul National University Hospital(首尔国立大学医院国家战略技术研究所)
;
Department of Medicine, Division of Gastroenterology, Massachusetts General Hospital(麻省总医院内科与消化内科部门)
;
Department of Neuroradiology, Heidelberg University Hospital(海德堡大学医院神经放射科部门)
;
King Abdulaziz Medical City, National Guard Health Affairs(国王阿卜杜勒-阿齐兹医疗城,国民守卫健康事务局)
;
Division of Pulmonary, Critical Care, and Sleep Medicine, University of Cincinnati(辛辛那提大学肺科、重症医学及睡眠医学部门)
专题命中
领域大模型
:large language model(abstract);language model(abstract);分类 cs.LG
FB-CLIP: Fine-Grained Zero-Shot Anomaly Detection with Foreground-Background Disentanglement
FB-CLIP:基于前景-背景解耦的细粒度零样本异常检测
Ming Hu, Yongsheng Huo, Mingyu Dou, Jianfu Yin, Peng Zhao, Yao Wang, Cong Hu, Bingliang Hu, Quan Wang
机构
*
Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences(西安光学精密机械研究所,中国科学院)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
Xi’an Jiaotong University(西安交通大学)
;
Zhongnan Hospital of Wuhan University(武汉大学中南医院)
On the Cone Effect and Modality Gap in Medical Vision-Language Embeddings
关于医学视觉-语言嵌入中的锥效应与模态间隙
David Restrepo, Miguel L Martins, Chenwei Wu, Luis Filipe Nakayama, Diego M Lopez, Stergios Christodoulidis, Maria Vakalopoulou, Enzo Ferrante
机构
*
CentraleSupélec, Université Paris-Saclay, France(中央理工巴黎高等学院,巴黎萨克雷大学,法国)
;
University of Porto, Portugal(葡萄牙波尔图大学)
;
University of Michigan, USA(美国密歇根大学)
;
Federal University of São Paulo, Brazil(巴西圣保罗联邦大学)
;
Universidad del Cauca, Colombia(哥伦比亚考卡大学)
;
Universidad de Buenos Aires, Argentina(阿根廷布宜诺斯艾利斯大学)
机构
*
Wangxuan Institute of Computer Technology, Peking University, Beijing, China(北京大学王轩计算机技术研究院,北京,中国)
;
University of Chinese Academy of Sciences, Beijing, China(中国科学院大学,北京,中国)
;
School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China(华中科技大学人工智能与自动化学院,武汉,中国)