Deep Learning

Deep dives into AI, research, coding, and other topics.

Review - Perceiver: General Perception with Iterative Attention
Review - Perceiver: General Perception with Iterative Attention

This week’s Deep Learning Paper Review is Perceiver: General Perception with Iterative Attention.

Reinforcement Learning With (Deep) Q-Learning Explained
Reinforcement Learning With (Deep) Q-Learning Explained

In this video, we learn about Reinforcement Learning and (Deep) Q-Learning.

Machine Learning Concepts for Beginners
Machine Learning Concepts for Beginners

This Machine Learning for Beginners course is designed to introduce you to basic Machine Learning and Deep Learning concepts.

What is Weight Initialization for Neural Networks?
What is Weight Initialization for Neural Networks?

In this video, we learn about Weight Initialization for Deep Feedforward Neural Networks.

Review - data2vec: A General Framework for Self-supervised Learning in Speech, Vision, and Language
Review - data2vec: A General Framework for Self-supervised Learning in Speech, Vision, and Language

This week's Deep Learning Paper Review is data2vec: A General Framework for Self-supervised Learning in Speech, Vision, and Language.

Unsupervised Machine Learning For Beginners
Unsupervised Machine Learning For Beginners

In this video tutorial, we learn about Unsupervised Machine Learning.

How to Evaluate Machine Learning Models
How to Evaluate Machine Learning Models

In this video, we will learn about the most commonly used evaluation metrics for Machine Learning models.

Supervised Machine Learning For Beginners
Supervised Machine Learning For Beginners

In this video, we learn about Supervised Machine Learning, which is arguably the most important type of Machine Learning.

What is BERT and How Does It Work?
What is BERT and How Does It Work?

BERT is a versatile language model that can be easily fine-tuned to many language tasks. But how does it work?

Kaldi Speech Recognition for Beginners - A Simple Tutorial
Kaldi Speech Recognition for Beginners - A Simple Tutorial

Want to learn how to use Kaldi for Speech Recognition? Check out this simple tutorial to start transcribing audio in minutes.

Introduction to Variational Autoencoders Using Keras
Introduction to Variational Autoencoders Using Keras

The complete guide to understanding and implementing Variational Autoencoders with Keras

Review - JUST: 
Joint Unsupervised and Supervised Training For Multilingual ASR
Review - JUST: Joint Unsupervised and Supervised Training For Multilingual ASR

This week's Deep Learning Paper Review is JUST: Joint Unsupervised and Supervised Training For Multilingual ASR.

Review - VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning
Review - VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning

This week's Deep Learning Paper Review is VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning.

PyTorch Lightning for Dummies - A Tutorial and Overview
PyTorch Lightning for Dummies - A Tutorial and Overview

The ultimate PyTorch Lightning tutorial. Learn how it compares with vanilla PyTorch, and how to build and train models with PyTorch Lightning.

Transformers for Beginners - An Introduction
Transformers for Beginners - An Introduction

What are Transformers and how do they work? How are they different from other Deep Learning models like RNNs, LSTMs? Explore the answers in this video!

Review - SimCLS and RefSum - Summarization Techniques
Review - SimCLS and RefSum - Summarization Techniques

This week’s Deep Learning research papers are SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization and RefSum: Refactoring Neural Summarization.

Review - Speech processing Universal Performance Benchmark Review
Review - Speech processing Universal Performance Benchmark Review

This week’s Deep Learning Research paper is “SUPERB: Speech processing Universal PERformance Benchmark Review”

Text Segmentation - Approaches, Datasets, and Evaluation Metrics
Text Segmentation - Approaches, Datasets, and Evaluation Metrics

In this post, we give an overview of the best approaches, datasets, and evaluation metrics commonly used for the task of Text Segmentation.

An Overview of Transducer Models for ASR
An Overview of Transducer Models for ASR

In recent years, Transducers have become the dominant ASR model architecture, surpassing CTC and LAS model architectures. In this article, we will examine the Transducer architecture more closely, and compare it to the more common CTC model architecture.

Deep Shallow Fusion for RNN-T Personalization
Deep Shallow Fusion for RNN-T Personalization

This week’s Deep Learning Research paper is “Deep Shallow Fusion for RNN-T Personalization.”

Deep Learning in 5 Minutes
Deep Learning in 5 Minutes

In this video, we will take a closer look into Deep Learning. We will learn what deep learning is, where in the world of Artificial Intelligence it stands, why it has been very successful in becoming part of our lives and how it compares to more traditional machine learning algorithms.

Review - A Graph Convolutional Neural Network for Emotion Recognition in Conversation
Review - A Graph Convolutional Neural Network for Emotion Recognition in Conversation

In this week's Deep Learning Paper Review, we look at the following paper: DialogueGCN: A Graph Convolutional Neural Network for Emotion Recognition in Conversation.

Review - Pretraining Representations for Data-Efficient Reinforcement Learning
Review - Pretraining Representations for Data-Efficient Reinforcement Learning

In recent years, pretraining has proved to be an essential ingredient for success in the fields of NLP and computer vision. In this week's Deep Learning Paper Review, we look at "Pretraining Representations for Data-Efficient Reinforcement Learning".

How to Train Large Deep Learning Models as a Startup
How to Train Large Deep Learning Models as a Startup

Training large deep learning models is expensive and slow. Yet, startups are all about iterating fast. In this post, we share the lessons we've learned over the past few years.

Review - Text-Free Prosody-Aware Generative Spoken Language Modeling
Review - Text-Free Prosody-Aware Generative Spoken Language Modeling

In this week's Deep Learning Paper Review, we look at the following paper: Text-Free Prosody-Aware Generative Spoken Language Modeling.