Jun 19, 2024 � This paper proposes SynCheck, a lightweight monitor that leverages fine-grained decoding dynamics including sequence likelihood, uncertainty quantification,�...

Figure 1: (a) An illustration of SYNCHECK, a fine-grained faithfulness checker for RALMs. SYNCHECK aggre- gates real-time decoding dynamics to accurately�...

Synchronous Faithfulness Monitoring for Trustworthy Retrieval-Augmented Generation ... Enhancing Robustness of Retrieval-Augmented Language Models with In�...

Jun 20, 2024 � This paper presents a novel "Synchronous Faithfulness Monitoring" framework to improve the trustworthiness of retrieval-augmented language models.

Synchronous Faithfulness Monitoring for Trustworthy Retrieval-Augmented Generation. D Wu, JC Gu, F Yin, N Peng, KW Chang. arXiv preprint arXiv:2406.13692�...

In this paper, we introduce a multimodal retrieval-augmented generation benchmark, MRAG-Bench, in which we systematically identify and categorize scenarios�...

In this paper, we introduce a multimodal retrieval-augmented generation ... Synchronous Faithfulness Monitoring for Trustworthy Retrieval-Augmented Generation.

Leveraging SynCheck, we further introduce FOD, a faithfulness-oriented decoding algorithm guided by beam search for long-form retrieval-augmented generation.

Leveraging SynCheck, we further introduce FOD, a faithfulness-oriented decoding algorithm guided by beam search for long-form retrieval-augmented generation.

Yixin Wan, Di Wu, Haoran Wang, and Kai-Wei Chang. EMNLP, 2024 [Paper] [Code] � Synchronous Faithfulness Monitoring for Trustworthy Retrieval-Augmented�...