Neuro-Symbolic Predictive Process Monitoring
神经符号预测性过程监控
Axel Mezini, Elena Umili, Ivan Donadello, Fabrizio Maria Maggi, Matteo Mancanelli, Fabio Patrizi
AI总结 提出一种结合数据驱动学习与时序逻辑先验知识的神经符号方法,通过可微逻辑损失函数训练自回归序列预测器,以提升业务过程管理中后缀预测的准确性和逻辑一致性。
详情
本文通过提出一种神经符号预测性过程监控(PPM)方法,解决了业务流程管理(BPM)中的后缀预测问题,该方法将数据驱动学习与时序逻辑先验知识相结合。尽管最近的方法利用深度学习模型进行后缀预测,但由于训练过程中缺乏领域知识的显式集成,它们常常无法满足甚至基本的逻辑约束。我们提出了一种新颖方法,将有限迹上的线性时序逻辑(LTLf)融入自回归序列预测器的训练过程。我们的方法引入了一个可微的逻辑损失函数,该函数使用LTLf语义的软近似和Gumbel-Softmax技巧定义,可以与标准预测损失结合。这确保了模型学习生成既准确又逻辑一致的后缀。在三个真实世界数据集上的实验评估表明,我们的方法提高了后缀预测的准确性和对时序约束的遵从性。我们还引入了逻辑损失的两种变体(局部和全局),并展示了它们在噪声和现实环境下的有效性。虽然是在BPM背景下开发的,我们的框架适用于任何符号序列生成任务,并有助于推进神经符号人工智能。
This paper addresses the problem of suffix prediction in Business Process Management (BPM) by proposing a Neuro-Symbolic Predictive Process Monitoring (PPM) approach that integrates data-driven learning with temporal logic-based prior knowledge. While recent approaches leverage deep learning models for suffix prediction, they often fail to satisfy even basic logical constraints due to the lack of explicit integration of domain knowledge during training. We propose a novel method to incorporate Linear Temporal Logic over finite traces (LTLf) into the training process of autoregressive sequence predictors. Our approach introduces a differentiable logical loss function, defined using a soft approximation of LTLf semantics and the Gumbel-Softmax trick, which can be combined with standard predictive losses. This ensures that the model learns to generate suffixes that are both accurate and logically consistent. Experimental evaluation on three real-world datasets shows that our method improves suffix prediction accuracy and compliance with temporal constraints. We also introduce two variants of the logic loss (local and global) and demonstrate their effectiveness under noisy and realistic settings. While developed in the context of BPM, our framework is applicable to any symbolic sequence generation task and contributes to advancing Neuro-Symbolic AI.