Increasing Adverse Drug Events extraction robustness on social media: case study on negation and speculation

by   Simone Scaboro, et al.

In the last decade, an increasing number of users have started reporting Adverse Drug Events (ADE) on social media platforms, blogs, and health forums. Given the large volume of reports, pharmacovigilance has focused on ways to use Natural Language Processing (NLP) techniques to rapidly examine these large collections of text, detecting mentions of drug-related adverse reactions to trigger medical investigations. However, despite the growing interest in the task and the advances in NLP, the robustness of these models in face of linguistic phenomena such as negations and speculations is an open research question. Negations and speculations are pervasive phenomena in natural language, and can severely hamper the ability of an automated system to discriminate between factual and nonfactual statements in text. In this paper we take into consideration four state-of-the-art systems for ADE detection on social media texts. We introduce SNAX, a benchmark to test their performance against samples containing negated and speculated ADEs, showing their fragility against these phenomena. We then introduce two possible strategies to increase the robustness of these models, showing that both of them bring significant increases in performance, lowering the number of spurious entities predicted by the models by 60


NADE: A Benchmark for Robust Adverse Drug Events Extraction in Face of Negations

Adverse Drug Event (ADE) extraction models can rapidly examine large col...

Improving Adverse Drug Event Extraction with SpanBERT on Different Text Typologies

In recent years, Internet users are reporting Adverse Drug Events (ADE) ...

Mining the Web for Pharmacovigilance: the Case Study of Duloxetine and Venlafaxine

Adverse reactions caused by drugs following their release into the marke...

Selection of pseudo-annotated data for adverse drug reaction classification across drug groups

Automatic monitoring of adverse drug events (ADEs) or reactions (ADRs) i...

Mining Adverse Drug Reactions from Unstructured Mediums at Scale

Adverse drug reactions / events (ADR/ADE) have a major impact on patient...

The King is Naked: on the Notion of Robustness for Natural Language Processing

There is growing evidence that the classical notion of adversarial robus...

From narrative descriptions to MedDRA: automagically encoding adverse drug reactions

The collection of narrative spontaneous reports is an irreplaceable sour...

Please sign up or login with your details

Forgot password? Click here to reset