research
∙
05/24/2023
Dynamic Masking Rate Schedules for MLM Pretraining
Most works on transformers trained with the Masked Language Modeling (ML...
share
research
∙
06/23/2022
Non-Determinism and the Lawlessness of ML Code
Legal literature on machine learning (ML) tends to focus on harms, and a...
research
∙
02/29/2020
Training BatchNorm and Only BatchNorm: On the Expressive Power of Random Features in CNNs
Batch normalization (BatchNorm) has become an indispensable tool for tra...
research
∙
12/11/2019
