This course covers the fundamentals and advanced applications of BERT and GPT models. You will learn how BERT processes text, including tokenization and vectorization, and practice fine-tuning BERT for tasks such as sequence classification, token classification, and question answering. The course also explains how GPT generates text, adapts to different writing styles, and can be fine-tuned for tasks like translating English to code. Additional topics include semantic search using Siamese BERT and multi-task learning with GPT through prompt engineering. By the end of the course, you will have the practical skills and theoretical understanding needed to apply BERT and GPT to various natural language processing problems.
Introduction to Transformer Models for NLP: Unit 2
This Labor Day, enjoy $120 off Coursera Plus. Unlock access to 10,000+ programs. Save today.
Introduction to Transformer Models for NLP: Unit 2
This course is part of Introduction to Transformer Models for NLP Specialization
Instructor: Pearson
Included with 
Gain insight into a topic and learn the fundamentals.
Intermediate level
Recommended experience
8 hours to complete
Flexible schedule
Learn at your own pace
What you'll learn
Master the architectures and core mechanisms of BERT and GPT for natural language understanding and generation.
Fine-tune pre-trained models for advanced NLP tasks such as classification, question answering, and semantic search.
Apply hands-on techniques to customize BERT and GPT for specific domains and writing styles.
Utilize prompt engineering and few-shot learning to solve multiple NLP tasks efficiently.
Skills you'll gain
Details to know
Shareable certificate
Add to your LinkedIn profile
Recently updated!
August 2025
Assessments
6 assignments
Taught in English
See how employees at top companies are mastering in-demand skills
Build your subject-matter expertise
This course is part of the Introduction to Transformer Models for NLP Specialization
When you enroll in this course, you'll also be enrolled in this Specialization.
- Learn new concepts from industry experts
- Gain a foundational understanding of a subject or tool
- Develop job-relevant skills with hands-on projects
- Earn a shareable career certificate
There is 1 module in this course
This module provides a comprehensive exploration of modern transformer-based models for natural language processing. It covers the foundational architectures and mechanisms of BERT and GPT, delving into their pre-training, fine-tuning, and practical applications. Through hands-on lessons, learners engage with real-world tasks such as sequence and token classification, question answering, semantic search, and text generation. The module emphasizes both theoretical understanding and practical skills, enabling students to leverage BERT and GPT for a wide range of NLP challenges, including multi-task learning and adapting models to new domains or writing styles.
What's included
24 videos6 assignments
Earn a career certificate
Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.
Explore more from Machine Learning
Why people choose Coursera for their career
Felipe M.
Learner since 2018
"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."
Jennifer J.
Learner since 2020
"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."
Larry W.
Learner since 2021
"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."
Chaitanya A.
"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."
Open new doors with Coursera Plus
Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription
Advance your career with an online degree
Earn a degree from world-class universities - 100% online
Join over 3,400 global companies that choose Coursera for Business
Upskill your employees to excel in the digital economy
Frequently asked questions
Yes, you can preview the first video and view the syllabus before you enroll. You must purchase the course to access content not included in the preview.
If you decide to enroll in the course before the session start date, you will have access to all of the lecture videos and readings for the course. You’ll be able to submit assignments once the session starts.
Once you enroll and your session begins, you will have access to all videos and other resources, including reading items and the course discussion forum. You’ll be able to view and submit practice assessments, and complete required graded assignments to earn a grade and a Course Certificate.
More questions
Financial aid available,