2024  2

April  1

Diffusion Models for Video Generation

Date: April 12, 2024 | Estimated Reading Time: 20 min | Author: Lilian Weng

February  1

Thinking about High-Quality Human Data

Date: February 5, 2024 | Estimated Reading Time: 21 min | Author: Lilian Weng

2023  5

October  1

Adversarial Attacks on LLMs

Date: October 25, 2023 | Estimated Reading Time: 33 min | Author: Lilian Weng

June  1

LLM Powered Autonomous Agents

Date: June 23, 2023 | Estimated Reading Time: 31 min | Author: Lilian Weng

March  1

Prompt Engineering

Date: March 15, 2023 | Estimated Reading Time: 21 min | Author: Lilian Weng

January  2

The Transformer Family Version 2.0

Date: January 27, 2023 | Estimated Reading Time: 46 min | Author: Lilian Weng

Large Transformer Model Inference Optimization

Date: January 10, 2023 | Estimated Reading Time: 9 min | Author: Lilian Weng

2022  4

September  1

Some Math behind Neural Tangent Kernel

Date: September 8, 2022 | Estimated Reading Time: 17 min | Author: Lilian Weng

June  1

Generalized Visual Language Models

Date: June 9, 2022 | Estimated Reading Time: 25 min | Author: Lilian Weng

April  1

Learning with not Enough Data Part 3: Data Generation

Date: April 15, 2022 | Estimated Reading Time: 28 min | Author: Lilian Weng

February  1

Learning with not Enough Data Part 2: Active Learning

Date: February 20, 2022 | Estimated Reading Time: 22 min | Author: Lilian Weng

2021  6

December  1

Learning with not Enough Data Part 1: Semi-Supervised Learning

Date: December 5, 2021 | Estimated Reading Time: 26 min | Author: Lilian Weng

September  1

How to Train Really Large Models on Many GPUs?

Date: September 24, 2021 | Estimated Reading Time: 21 min | Author: Lilian Weng

July  1

What are Diffusion Models?

Date: July 11, 2021 | Estimated Reading Time: 32 min | Author: Lilian Weng

May  1

Contrastive Representation Learning

Date: May 31, 2021 | Estimated Reading Time: 39 min | Author: Lilian Weng

March  1

Reducing Toxicity in Language Models

Date: March 21, 2021 | Estimated Reading Time: 23 min | Author: Lilian Weng

January  1

Controllable Neural Text Generation

Date: January 2, 2021 | Estimated Reading Time: 42 min | Author: Lilian Weng

2020  5

October  1

How to Build an Open-Domain Question Answering System?

Date: October 29, 2020 | Estimated Reading Time: 33 min | Author: Lilian Weng

August  1

Neural Architecture Search

Date: August 6, 2020 | Estimated Reading Time: 32 min | Author: Lilian Weng

June  1

Exploration Strategies in Deep Reinforcement Learning

Date: June 7, 2020 | Estimated Reading Time: 36 min | Author: Lilian Weng

April  1

The Transformer Family

Date: April 7, 2020 | Estimated Reading Time: 25 min | Author: Lilian Weng

January  1

Curriculum for Reinforcement Learning

Date: January 29, 2020 | Estimated Reading Time: 24 min | Author: Lilian Weng

2019  6

November  1

Self-Supervised Representation Learning

Date: November 10, 2019 | Estimated Reading Time: 38 min | Author: Lilian Weng

September  1

Evolution Strategies

Date: September 5, 2019 | Estimated Reading Time: 22 min | Author: Lilian Weng

June  1

Meta Reinforcement Learning

Date: June 23, 2019 | Estimated Reading Time: 22 min | Author: Lilian Weng

May  1

Domain Randomization for Sim2Real Transfer

Date: May 5, 2019 | Estimated Reading Time: 15 min | Author: Lilian Weng

March  1

Are Deep Neural Networks Dramatically Overfitted?

Date: March 14, 2019 | Estimated Reading Time: 22 min | Author: Lilian Weng

January  1

Generalized Language Models

Date: January 31, 2019 | Estimated Reading Time: 36 min | Author: Lilian Weng

2018  9

December  1

Object Detection Part 4: Fast Detection Models

Date: December 27, 2018 | Estimated Reading Time: 19 min | Author: Lilian Weng

November  1

Meta-Learning: Learning to Learn Fast

Date: November 30, 2018 | Estimated Reading Time: 30 min | Author: Lilian Weng

October  1

Flow-based Deep Generative Models

Date: October 13, 2018 | Estimated Reading Time: 21 min | Author: Lilian Weng

August  1

From Autoencoder to Beta-VAE

Date: August 12, 2018 | Estimated Reading Time: 21 min | Author: Lilian Weng

June  1

Attention? Attention!

Date: June 24, 2018 | Estimated Reading Time: 21 min | Author: Lilian Weng

May  1

Implementing Deep Reinforcement Learning Models with Tensorflow + OpenAI Gym

Date: May 5, 2018 | Estimated Reading Time: 13 min | Author: Lilian Weng

April  1

Policy Gradient Algorithms

Date: April 8, 2018 | Estimated Reading Time: 52 min | Author: Lilian Weng

February  1

A (Long) Peek into Reinforcement Learning

Date: February 19, 2018 | Estimated Reading Time: 31 min | Author: Lilian Weng

January  1

The Multi-Armed Bandit Problem and Its Solutions

Date: January 23, 2018 | Estimated Reading Time: 10 min | Author: Lilian Weng

2017  10

December  2

Object Detection for Dummies Part 3: R-CNN Family

Date: December 31, 2017 | Estimated Reading Time: 13 min | Author: Lilian Weng

Object Detection for Dummies Part 2: CNN, DPM and Overfeat

Date: December 15, 2017 | Estimated Reading Time: 7 min | Author: Lilian Weng

October  2

Object Detection for Dummies Part 1: Gradient Vector, HOG, and SS

Date: October 29, 2017 | Estimated Reading Time: 15 min | Author: Lilian Weng

Learning Word Embedding

Date: October 15, 2017 | Estimated Reading Time: 18 min | Author: Lilian Weng

September  1

Anatomize Deep Learning with Information Theory

Date: September 28, 2017 | Estimated Reading Time: 9 min | Author: Lilian Weng

August  2

From GAN to WGAN

Date: August 20, 2017 | Estimated Reading Time: 21 min | Author: Lilian Weng

How to Explain the Prediction of a Machine Learning Model?

Date: August 1, 2017 | Estimated Reading Time: 18 min | Author: Lilian Weng

July  2

Predict Stock Prices Using RNN: Part 2

Date: July 22, 2017 | Estimated Reading Time: 9 min | Author: Lilian Weng

Predict Stock Prices Using RNN: Part 1

Date: July 8, 2017 | Estimated Reading Time: 12 min | Author: Lilian Weng

June  1

An Overview of Deep Learning for Curious People

Date: June 21, 2017 | Estimated Reading Time: 12 min | Author: Lilian Weng