Dec 11, 2024 | I will be joining Meta AI Research (FAIR) as a research intern in summer 2025! |
Dec 6, 2024 | New blog post on why does the chosen and the rejected log-probs is decreased during DPO and why it is to some extent beneficial for alignment. |
Oct 4, 2024 | New preprint on how to train on heavily imbalanced datasets!! |
Apr 7, 2024 | I will be staying at Johns Hopkins University for my PhD, working with Prof. Daniel Khashabi! |
Jan 15, 2024 | Error Norm Truncation has been accepted to ICLR 2024 (spotlight) !! |
Nov 8, 2023 | New blog post on latest advances on balanced training for Multilingual Machine Translation! |
Oct 2, 2023 | New preprint on truncating noisy data for training text generation models!! |
Jul 31, 2023 | New blog post on estimating data utility. |
Jun 12, 2023 | One paper accepted to ACL 2023 (Findings) |