Aug 30, 2024 � We propose SYNTHEVAL, a hybrid behavioral testing framework that leverages large language models (LLMs) to generate a wide range of test types for a�...

Sep 7, 2024 � SYNTHEVAL first generates sentences via LLMs using controlled generation, and then identifies challenging examples by comparing the predictions�...

Sep 1, 2024 � Overview � Traditional NLP model evaluation relies on static test sets, which can overestimate performance and lack comprehensive assessment.

Aug 30, 2024 � SYNTHEVAL: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists. Warning: This paper contains language that readers may find�...

Contribute to Loreley99/SynthEval_CheckList development by creating an account on GitHub.

Article "SYNTHEVAL: Hybrid Behavioral Testing of NLP Models with Synthetic CheckLists" Detailed information of the J-GLOBAL is an information service�...

Sep 1, 2024 � 在本研究中，我们提出了SYNTHEVAL，这是一种混合行为测试框架，利用大型语言模型（LLMs）生成广泛的测试类型，以全面评估NLP模型。SYNTHEVAL首先通过LLMs使用受�...

May 8, 2020 � This work proposes SYNTHEVAL, a hybrid behavioral testing framework that leverages large language models (LLMs) to generate a wide range of�...

SYNTHEVAL first generates sentences via LLMs using controlled generation, and then identifies challenging examples by comparing the predictions made by LLMs�...

In this work, we propose SYNTHEVAL, a hybrid behavioral testing framework that leverages large language models (LLMs) to generate a wide range of test types for�...