Moin Nadeem (MIT): The extraordinary future of natural language models - Machine Learning Engineered

Episode 11

Moin Nadeem (MIT): The extraordinary future of natural language models

Moin Nadeem is a masters student at MIT, where he studies natural language generation. His research interests broadly include natural language processing, information retrieval, and software systems for machine learning.

Learn more about Moin:

Want to level-up your skills in machine learning and software engineering? Join the ML Engineered Newsletter:

Comments? Questions? Submit them here:

Follow Charlie on Twitter:

Take the Giving What We Can Pledge:

Subscribe to ML Engineered:


01:35 Follow Charlie on Twitter (

03:10 How Moin got started in computer science

05:50 Using ML to identify depression on Twitter in high school

11:00 Building a system to track phone locations on MIT’s campus

14:35 Specializing in NLP

17:20 Building an end-to-end fact-checking system (

25:15 Predicting statement stance with neural multi-task learning (

27:20 Is feature engineering in NLP dead?

29:40 Reconciling language models with existing knowledge graphs

35:20 How advances in AI hardware will affect NLP research (crazy!)

47:25 Moin’s research into sampling algorithms for natural language generation (

57:10 Under-rated areas of ML research

01:00:10 How research works at MIT CSAIL

01:04:35 How Moin keeps up in such a fast-moving field

01:11:30 Starting the MIT Machine Intelligence Community

01:16:30 Rapid Fire Questions


FAKTA: An Automatic End-to-End Fact Checking System

StereoSet: Measuring stereotypical bias in pretrained language models

Neural Multi-Task Learning for Stance Prediction

Rich Sutton - The Bitter Lesson

A Systematic Characterization of Sampling Algorithms for Open-ended Language Generation

Strategies for Pre-training Graph Neural Networks

Transformers For Image Recognition at Scale

Cerebras CS-1

Klarity: AI for Law Contract Review

Jacob Andreas

Jure Leskovec

Shoe Dog




The Innovators

About the Podcast

Show artwork for Machine Learning Engineered
Machine Learning Engineered
Helping you bring ML out of the lab and into products that people love.

About your host

Profile picture for Charlie You

Charlie You

Charlie currently works as a Machine Learning Engineer at Workday. He graduated from RPI with a B.S. in Computer Science and taught himself ML through online courses and projects. In his free time, Charlie enjoys investing and trading, playing poker, and training Brazilian Jiu-Jitsu.