research
∙
09/19/2023
MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback
To solve complex tasks, large language models (LLMs) often require multi...
share
research
∙
09/08/2023
Measuring and Improving Chain-of-Thought Reasoning in Vision-Language Models
Vision-language models (VLMs) have recently demonstrated strong efficacy...
research
∙
07/21/2023
Making Pre-trained Language Models both Task-solvers and Self-calibrators
Pre-trained language models (PLMs) serve as backbones for various real-w...
research
∙
06/07/2023
Revisiting Out-of-distribution Robustness in NLP: Benchmark, Analysis, and LLMs Evaluations
This paper reexamines the research on out-of-distribution (OOD) robustne...
research
∙
05/29/2023
From Adversarial Arms Race to Model-centric Evaluation: Motivating a Unified Automatic Robustness Evaluation Framework
Textual adversarial attacks can discover models' weaknesses by adding se...
research
∙
10/31/2022
A Close Look into the Calibration of Pre-trained Language Models
Pre-trained language models (PLMs) achieve remarkable performance on man...
research
∙
10/19/2022
Why Should Adversarial Perturbations be Imperceptible? Rethink the Research Paradigm in Adversarial NLP
Textual adversarial samples play important roles in multiple subfields o...
research
∙
06/17/2022
A Unified Evaluation of Textual Backdoor Learning: Frameworks and Benchmarks
Textual backdoor attacks are a kind of practical threat to NLP systems. ...
research
∙
04/11/2022
Exploring the Universal Vulnerability of Prompt-based Learning Paradigm
Prompt-based learning paradigm bridges the gap between pre-training and ...
research
∙
10/28/2021
Bridge the Gap Between CV and NLP! A Gradient-based Textual Adversarial Attack Framework
Despite great success on many machine learning tasks, deep neural networ...
research
∙
10/15/2021
Textual Backdoor Attacks Can Be More Harmful via Two Simple Tricks
Backdoor attacks are a kind of emergent security threat in deep learning...
research
∙
10/14/2021
Mind the Style of Text! Adversarial and Backdoor Attacks Based on Text Style Transfer
Adversarial attacks and backdoor attacks are two common security threats...
research
∙
09/09/2021
Multi-granularity Textual Adversarial Attack with Behavior Cloning
Recently, the textual adversarial attack models become increasingly popu...
research
∙
05/26/2021
Automatic Construction of Sememe Knowledge Bases via Dictionaries
A sememe is defined as the minimum semantic unit in linguistics. Sememe ...
research
∙
05/26/2021
Hidden Killer: Invisible Textual Backdoor Attacks with Syntactic Trigger
Backdoor attacks are a kind of insidious security threat against machine...
research
∙
11/20/2020