research
∙
09/06/2023
Everyone Deserves A Reward: Learning Customized Human Preferences
Reward models (RMs) are crucial in aligning large language models (LLMs)...
share
research
∙
08/25/2023
Chunk, Align, Select: A Simple Long-sequence Processing Method for Transformers
Although dominant in natural language processing, transformer-based mode...
research
∙
05/24/2023
Flan-MoE: Scaling Instruction-Finetuned Language Models with Sparse Mixture of Experts
The explosive growth of language models and their applications have led ...
research
∙
02/17/2022
Designing Effective Sparse Expert Models
Scale has opened new frontiers in natural language processing – but at a...
research
∙
12/13/2021
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Scaling language models with more data, compute and parameters has drive...
research
∙
09/03/2021
Finetuned Language Models Are Zero-Shot Learners
This paper explores a simple method for improving the zero-shot learning...
research
∙
12/31/2018
