Big Data and Hadoop Foundations and Setup

Seize the savings! Get 40% off 3 months of Coursera Plus and full access to thousands of courses.

Big Data and Hadoop Foundations and Setup

This course is part of Big Data Processing Using Hadoop Specialization

Instructor: Karthik Shyamsunder

Included with

Learn more

4 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Recommended experience

1 week to complete

at 10 hours a week

Flexible schedule

Learn at your own pace

4 modules

Gain insight into a topic and learn the fundamentals.

Intermediate level

Recommended experience

1 week to complete

at 10 hours a week

Flexible schedule

Learn at your own pace

What you'll learn

Define Big Data, explore its relevance in analytics and data science, and understand trends shaping modern data processing technologies.
Examine Hadoop architecture, its ecosystem, and subprojects, distinguishing distributions and their roles in Big Data solutions.
Acquire practical skills to install, configure, and run Hadoop on a Linux virtual machine, enabling effective Big Data processing.

Skills you'll gain

Tools you'll learn

Details to know

Shareable certificate

Add to your LinkedIn profile

Assessments

9 assignments

Taught in English

See how employees at top companies are mastering in-demand skills

Learn more about Coursera for Business

logos of Petrobras, TATA, Danone, Capgemini, P&G and L'Oreal

Build your subject-matter expertise

This course is part of the Big Data Processing Using Hadoop Specialization

When you enroll in this course, you'll also be enrolled in this Specialization.

Learn new concepts from industry experts
Gain a foundational understanding of a subject or tool
Develop job-relevant skills with hands-on projects
Earn a shareable career certificate

There are 4 modules in this course

The course "Big Data and Hadoop Foundations and Setup" offers a comprehensive introduction to the world of Big Data and Hadoop, providing foundational knowledge crucial for navigating modern data-driven environments. You’ll explore the limitations of traditional data processing technologies and understand how Hadoop addresses these challenges with its robust architecture and ecosystem.

Through detailed modules, you will gain a deep understanding of Big Data concepts, the role of Data Science and Big Data Analytics, and the trends shaping the Big Data revolution. The course demystifies Hadoop's subprojects and distributions, giving you the tools to differentiate between them and apply their features to real-world problems. What sets this course apart is its hands-on approach. You'll install, configure, and run Hadoop in a Linux environment, building the technical proficiency needed to process large-scale data effectively. Whether you’re looking to enhance your career in Data Science or understand Big Data’s transformative impact on businesses, this course equips you with the skills to succeed.

This course provides an in-depth understanding of Big Data concepts, including Data Science and Big Data Analytics. It explores the limitations of traditional data processing and introduces modern technologies that support Big Data solutions. Learners will gain a comprehensive understanding of Hadoop architecture, its subprojects, and distributions. The course includes hands-on experience with installing, configuring, and running Hadoop in a Big Data environment. By the end of the course, learners will be equipped to leverage Hadoop for processing large-scale data.

What's included

2 readings

In this introductory module, we introduce the trends and concepts behind the Big Data revolution that is taking place in the Information Technology marketplace.

What's included

8 videos6 readings3 assignments

8 videos Total 76 minutes

Introduction - Big Data Revolution 2 minutes
Data Explosion 10 minutes
Data Economy 9 minutes
Big Data Analytics 21 minutes
Data Science 16 minutes
Historical Data Processing Technologies 10 minutes
Modern Data Processing Technologies 6 minutes
Big Data Revolution Summary 1 minute

6 readings Total 75 minutes

Data Explosion 15 minutes
Data Economy 10 minutes
Big Data Analytics 10 minutes
Data Science 15 minutes
Historical Data Processing Technologies 15 minutes
Modern Data Processing Technologies 10 minutes

3 assignments Total 90 minutes

The Big Data Landscape: Revolution, Explosion, Economy, and Science 15 minutes
Evolution of Data Processing: From Historical to Modern Technologies 15 minutes
Big Data Revolution (Introduction) 60 minutes

This module provides a comprehensive overview of Apache Hadoop, exploring its architecture, history, and foundational principles. You will also delve into the Hadoop ecosystem, examining its technology stack, popular distributions, and key documentation to help you navigate and understand this powerful big data framework.

What's included

8 videos7 readings3 assignments

8 videos Total 122 minutes

Introduction - Apache Hadoop Architecture and Ecosystem 2 minutes
Hadoop History 14 minutes
Hadoop Architecture 36 minutes
Key Principles behind Hadoop Architecture 13 minutes
Hadoop Technology Stack 28 minutes
Hadoop Distributions 15 minutes
Hadoop Documentation 12 minutes
Summary - Apache Hadoop Architecture and Ecosystem 1 minute

7 readings Total 88 minutes

Hadoop History 10 minutes
Hadoop Architecture 15 minutes
Key Principles behind Hadoop Architecture 10 minutes
Hadoop Technology Stack 10 minutes
Hadoop Distributions 15 minutes
Hadoop Documentation 8 minutes
Self-Reflective Reading: Coexistence of Hadoop and Traditional Data Warehouses 20 minutes

3 assignments Total 90 minutes

Exploring Hadoop: Architecture, History, and Key Principles 15 minutes
Navigating Hadoop: Technology Stack, Distributions, and Documentation 15 minutes
Hadoop Architecture and Ecosystem 60 minutes

In this module, you will learn how to set up a Hadoop environment on a Linux Virtual Machine. We will guide you through downloading, installing, configuring, and running Hadoop using VirtualBox and CentOS Linux. Additionally, you will explore the setup and configuration of Hadoop 3 YARN, concluding with a comprehensive summary of the process.

What's included

5 videos4 readings3 assignments

5 videos Total 103 minutes

Introduction - Setting Up and Running Hadoop 2 minutes
Setting Up VirtualBox 10 minutes
Setting Up CentOS Linux VM on VirtualBox 28 minutes
Setting Up Hadoop 3 YARN 61 minutes
Summary - Setting Up Hadoop 1 minute

4 readings Total 110 minutes

Setting Up VirtualBox 10 minutes
Setting Up CentOS Linux VM on VirtualBox 10 minutes
Steps to Configure a Single Node Hadoop 3 YARN Cluster 50 minutes
Self-Reflective Reading: Challenges and Solutions for Large-Scale Deployments 40 minutes

3 assignments Total 90 minutes

Getting Started with Hadoop: Setting Up VirtualBox and CentOS Linux 15 minutes
Configuring Hadoop 3 YARN: Setup and Summary 15 minutes
Setting up Hadoop 60 minutes

Earn a career certificate

Add this credential to your LinkedIn profile, resume, or CV. Share it on social media and in your performance review.

Instructor

Karthik Shyamsunder

Johns Hopkins University

4 Courses 1,277 learners

Offered by

Johns Hopkins University

Explore more from Data Management

Status: Free Trial
University of California San Diego
Introduction to Big Data
Course
Status: Free Trial
EDUCBA
Hadoop: Analyze, Configure & Manage Big Data
Course
Status: Free Trial
EDUCBA
Hadoop & Big Data Foundations Mastery Course
Specialization
Status: Free Trial
Pearson
Hadoop and Spark Fundamentals: Unit 1
Course

Why people choose Coursera for their career

Felipe M.

Learner since 2018

"To be able to take courses at my own pace and rhythm has been an amazing experience. I can learn whenever it fits my schedule and mood."

Jennifer J.

Learner since 2020

"I directly applied the concepts and skills I learned from my courses to an exciting new project at work."

Larry W.

Learner since 2021

"When I need courses on topics that my university doesn't offer, Coursera is one of the best places to go."

Chaitanya A.

"Learning isn't just about being better at your job: it's so much more than that. Coursera allows me to learn without limits."

Open new doors with Coursera Plus

Unlimited access to 10,000+ world-class courses, hands-on projects, and job-ready certificate programs - all included in your subscription

Learn more

Advance your career with an online degree

Earn a degree from world-class universities - 100% online

Explore degrees

Join over 3,400 global companies that choose Coursera for Business

Upskill your employees to excel in the digital economy

Learn more

Frequently asked questions

To access the course materials, assignments and to earn a Certificate, you will need to purchase the Certificate experience when you enroll in a course. You can try a Free Trial instead, or apply for Financial Aid. The course may offer 'Full Course, No Certificate' instead. This option lets you see all course materials, submit required assessments, and get a final grade. This also means that you will not be able to purchase a Certificate experience.

When you enroll in the course, you get access to all of the courses in the Specialization, and you earn a certificate when you complete the work. Your electronic Certificate will be added to your Accomplishments page - from there, you can print your Certificate or add it to your LinkedIn profile.

Yes. In select learning programs, you can apply for financial aid or a scholarship if you can’t afford the enrollment fee. If fin aid or scholarship is available for your learning program selection, you’ll find a link to apply on the description page.