Modulating Language Models with Emotions

08/17/2021
by   Ruibo Liu, et al.
11

Generating context-aware language that embodies diverse emotions is an important step towards building empathetic NLP systems. In this paper, we propose a formulation of modulated layer normalization – a technique inspired by computer vision – that allows us to use large-scale language models for emotional response generation. In automatic and human evaluation on the MojiTalk dataset, our proposed modulated layer normalization method outperforms prior baseline methods while maintaining diversity, fluency, and coherence. Our method also obtains competitive performance even when using only 10 available training data.

READ FULL TEXT

Please sign up or login with your details

Forgot password? Click here to reset