Announcement_8
New preprint with Simin Fan and Martin Jaggi: OptiSelect: How does the Optimizer Shape Data Curriculum? — optimizer-aware data selection and training recipes for efficient LLM pretraining.
New preprint with Simin Fan and Martin Jaggi: OptiSelect: How does the Optimizer Shape Data Curriculum? — optimizer-aware data selection and training recipes for efficient LLM pretraining.