Youtor
GPU Accelerated Data Curation for LLMs Ryan Wolf DE4AI
>> YOUR LINK HERE: ___ http://youtube.com/watch?v=Ld4xz0Yascw
//Abstract • Scaling large language models is a well-discussed topic in the machine learning community. Providing LLMs with equally scaled, well-curated data is less discussed but incredibly important. We will examine how to curate high quality datasets, and how GPUs allow us to effectively scale datasets to trillions of tokens with NeMo Curator. • //Bio • Ryan is a Deep Learning Algorithm Engineer at NVIDIA, focusing on data curation for foundation models. Previously, he graduated from UIUC and worked on AI systems at the healthcare technology company Advent Health Partners. Right now he is focused on the development of NeMo Curator, an open-source library that enables GPU-accelerated data curation. • A big thank you to our Premium Sponsors @Databricks, @tecton8241, @onehouseHQfor their generous support!
#############################
