news

Dec 11, 2024 I will be joining Meta AI Research (FAIR) as a research intern in summer 2025!
Dec 6, 2024 New blog post on why does the chosen and the rejected log-probs is decreased during DPO and why it is to some extent beneficial for alignment.
Oct 4, 2024 New preprint on how to train on heavily imbalanced datasets!!
Apr 7, 2024 I will be staying at Johns Hopkins University for my PhD, working with Prof. Daniel Khashabi!
Jan 15, 2024 Error Norm Truncation has been accepted to ICLR 2024 (spotlight) !!
Nov 8, 2023 New blog post on latest advances on balanced training for Multilingual Machine Translation!
Oct 2, 2023 New preprint on truncating noisy data for training text generation models!!
Jul 31, 2023 New blog post on estimating data utility.
Jun 12, 2023 One paper accepted to ACL 2023 (Findings) :smile: