Packt

Sequence Modeling, Transformers, and Transfer Learning

Packt

Sequence Modeling, Transformers, and Transfer Learning

Included with Coursera Plus

Gain insight into a topic and learn the fundamentals.
Intermediate level

Recommended experience

1 week to complete
at 10 hours a week
Flexible schedule
Learn at your own pace
Gain insight into a topic and learn the fundamentals.
Intermediate level

Recommended experience

1 week to complete
at 10 hours a week
Flexible schedule
Learn at your own pace

What you'll learn

  • Understand the fundamentals of sequence modeling using RNNs, LSTMs, and GRUs.

  • Master the transformer architecture and attention mechanisms for NLP tasks.

  • Apply transfer learning to fine-tune pre-trained models for custom tasks.

  • Work on hands-on projects using RNNs, transformers, and transfer learning for text generation, translation, and summarization.

Details to know

Shareable certificate

Add to your LinkedIn profile

Recently updated!

February 2026

Assessments

5 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

 logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

There are 3 modules in this course

In this module, we will explore the world of sequence modeling with Recurrent Neural Networks (RNNs). You'll learn about the architecture of RNNs, including how backpropagation through time works. We also cover advanced models like LSTMs and GRUs, and teach you how to preprocess text data and apply RNNs to sequence-to-sequence tasks. The module concludes with a hands-on project to implement RNNs for text generation or sentiment analysis.

What's included

7 videos2 readings1 assignment

In this module, we introduce you to the transformative power of attention mechanisms in deep learning models. You’ll explore the architecture of transformers, learning about self-attention, multi-head attention, and positional encoding. With hands-on demonstrations of pre-trained transformer models like BERT and GPT, this section equips you to apply advanced NLP techniques to real-world projects like text summarization and translation.

What's included

7 videos1 assignment

In this module, we dive into the concept of transfer learning, a powerful technique that leverages pre-trained models for a wide range of applications. You will learn how to use transfer learning for both computer vision and natural language processing (NLP), including fine-tuning strategies and domain adaptation. The section concludes with a project where you will fine-tune a model for a custom task, helping you apply these techniques to solve real-world problems.

What's included

7 videos1 reading3 assignments

Instructor

Packt - Course Instructors
Packt
1,471 Courses 392,127 learners

Offered by

Packt

Why people choose Coursera for their career

Felipe M.

Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Coursera Plus

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Frequently asked questions