Python Project for Data Engineering

Seize the savings! Get 40% off 3 months of Coursera Plus and full access to thousands of courses.

Python Project for Data Engineering

This course is part of multiple programs.

Instructors: Ramesh Sannareddy

70,609 already enrolled

Included with

Learn more

3 modules

Gain insight into a topic and learn the fundamentals.

844 reviews

Intermediate level

Recommended experience

Flexible schedule

1 week at 10 hours a week

Learn at your own pace

90%

Most learners liked this course

3 modules

Gain insight into a topic and learn the fundamentals.

844 reviews

Intermediate level

Recommended experience

Flexible schedule

1 week at 10 hours a week

Learn at your own pace

90%

Most learners liked this course

What you'll learn

Demonstrate your skills in Python for working with and manipulating data
Implement webscraping and use APIs to extract data with Python
Play the role of a Data Engineer working on a real project to extract, transform, and load data
Use Jupyter notebooks and IDEs to complete your project

Skills you'll gain

Tools you'll learn

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

4 assignments¹

AI Graded see disclaimer

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is available as part of

When you enroll in this course, you'll also be asked to select a specific program.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate

There are 3 modules in this course

Showcase your Python skills in this Data Engineering Project! This short course is designed to apply your basic Python skills through the implementation of various techniques for gathering and manipulating data.

You will take on the role of a Data Engineer by extracting data from multiple sources, and converting the data into specific formats and making it ready for loading into a database for analysis. You will also demonstrate your knowledge of web scraping and utilizing APIs to extract data. By the end of this hands-on project, you will have shown your proficiency with important skills to Extract Transform and Load (ETL) data using an IDE, and of course, Python Programming. Upon completion of this course, you will also have a great new addition to your portfolio! PRE-REQUISITE: **Python for Data Science, AI and Development** course from IBM is a pre-requisite for this project course. Please ensure that before taking this course you have either completed the Python for Data Science, AI and Development course from IBM or have equivalent proficiency in working with Python and data. NOTE: This course is not intended to teach you Python and does not have too much new instructional content. It is intended for you to mostly apply prior Python knowledge.

Module 1 introduces you to Extract, Transform, and Load operations basics. You will learn to extract required information from web pages using web scraping techniques and APIs. You will also access databases using Python and save the processed information as a table in a database.

What's included

5 videos3 readings2 assignments4 app items1 plugin

5 videos Total 25 minutes

Course Introduction 3 minutes
Demo: Working with an IDE 6 minutes
Extract, Transform, Load (ETL) 7 minutes
(Optional) Web Scraping 5 minutes
[Optional] REST APIs & HTTP Requests 5 minutes

3 readings Total 13 minutes

Helpful Tips for Course Completion 2 minutes
Pre-requisites and Course Syllabus 10 minutes
Module Summary: Extract, Transform, Load (ETL) 1 minute

2 assignments Total 25 minutes

Graded Quiz: Extract, Transform, Load (ETL) 15 minutes
Practice Quiz: Extract, Transform, Load (ETL) 10 minutes

4 app items Total 120 minutes

Hands-on Lab: Getting Started with IDE 15 minutes
Hands-on Lab: Extract, Transform, Load (ETL) 30 minutes
Hands-on Lab: Web scraping and Extracting Data using APIs 45 minutes
Hands-on Lab: Accessing Databases using Python script 30 minutes

1 plugin Total 5 minutes

Reading: Querying SQLite3 database 5 minutes

In this lesson, you will complete two projects, one for practice and one for assessment to apply what you’ve learned. These projects have you implement your skills learned in the previous course and the last module regarding the Extract, Transform, and Load process using web scraping and accessing databases using REST APIs and Python.

What's included

2 readings1 assignment1 peer review3 app items3 plugins

2 readings Total 15 minutes

Congratulations and Next Steps 10 minutes
Thanks from the Course Team 5 minutes

1 assignment Total 15 minutes

Graded Quiz: Final Project 15 minutes

1 peer review Total 60 minutes

Option 2 - Peer Graded: Final Project - Submission and Evaluation 60 minutes

3 app items Total 180 minutes

Practice Project: Extract, Transform and Load GDP data 60 minutes
Final Project: Acquiring and processing information on world's largest banks 60 minutes
Option 1 - AI Graded: Final Project - Submission and Evaluation 60 minutes

3 plugins Total 25 minutes

Practice Project Overview 5 minutes
Final Project Overview 5 minutes
Reading: Final Project Submission Guidelines and Deliverables 15 minutes

In this bonus module, you will become familiar with the best practices for coding as documented in the Python Enhancement Proposal (PEP8) style guide. You will learn about static code analysis, ensuring that your code adheres to the coding rules. Next, you will learn how to create and run unit tests. Finally, you will learn how to create, verify, and run Python packages.

What's included

3 videos2 readings1 assignment3 app items2 plugins

3 videos Total 19 minutes

Python Style Guide and Coding Practices 6 minutes
Unit Testing 7 minutes
Packaging 5 minutes

2 readings Total 7 minutes

Module Introduction 2 minutes
Module Summary: Python Coding Practices and Packaging Concepts 5 minutes

1 assignment Total 10 minutes

Practice Quiz: Python Coding Practices and Packaging Concepts 10 minutes

3 app items Total 90 minutes

Hands-on Lab: Static Code Analysis 30 minutes
Hands-on Lab: Practice Session and Assignment on Unit Testing 30 minutes
Hands-on Lab: Practice Session and Assignment on Python Packaging 30 minutes

2 plugins Total 7 minutes

Reading: Static Code Analysis Resources 2 minutes
Cheatsheet: Python Coding Practices and Packaging Concepts 5 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructors

Instructor ratings

(215 ratings)

Ramesh Sannareddy

IBM

24 Courses 494,667 learners

Offered by

IBM

Explore more from Data Management

Status: Free Trial
Duke University
Applied Python Data Engineering
Specialization
Status: Free Trial
IBM
Python Project for Data Science
Course
Status: Free Trial
Duke University
Python and Pandas for Data Engineering
Course
Status: Free Trial
Duke University
Scripting with Python and SQL for Data Engineering
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Learner reviews

5 stars
77.65%
4 stars
14.18%
3 stars
3.66%
2 stars
1.77%
1 star
2.71%

Showing 3 of 844

Reviewed on May 18, 2023

Challenging and informative. Some difficulty interacting with the IBM Cloud unrelated to Coursera.

Reviewed on Aug 1, 2021

This course is very challenged both Python skills for Extract Transform and Load assignment.I really enjoyed it.

Reviewed on May 16, 2023

Really Nice. But it could be a little more advanced, which would feel like a Project. It was too basic.

View more reviews

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Learn more

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Explore degrees

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Learn more

Frequently asked questions

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Certificate, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.