US flag US
888-843-8733
888-843-8733

Introduction to Data Engineering

Course 1481

  • Duration: 1 day
  • Language: English
  • Level: Foundation

In this course, you learn about data engineering on Google Cloud, the roles and responsibilities of data engineers, and how those map to offerings provided by Google Cloud. You also learn about ways to address data engineering challenges.

Introduction to Data Engineering Delivery Methods

  • In-Person

  • Online

  • Upskill your whole team by bringing Private Team Training to your facility.

Introduction to Data Engineering Course Information

This course will empower you to:

  • Understand the role of a data engineer.
  • Identify data engineering tasks and core components used on Google Cloud.
  • Understand how to create and deploy data pipelines of varying patterns on Google Cloud.
  • Identify and utilize various automation techniques on Google Cloud

Prerequisites

  • Prior Google Cloud experience at the fundamental level using Cloud Shell and accessing products from the Google Cloud console.
  • Basic proficiency with a common query language such as SQL.
  • Experience with data modeling and ETL (extract, transform, load) activities.
  • Experience developing applications using a common programming language such as Python

Introduction to Data Engineering Training Outline

Data Engineering Tasks and Components

  • Explain the role of a data engineer.
  • Understand the differences between a data source and a data sink.
  • Explain the different types of data formats.
  • Explain the storage solution options on Google Cloud.
  • Learn about the metadata management options on Google Cloud.
  •  Understand how to share datasets with ease using Analytics Hub.
  • Understand how to load data into BigQuery using the Google Cloud console or the gcloud CLI.

 

Data Replication and Migration

  • Explain the baseline Google Cloud data replication and migration architecture.
  • Understand the options and use cases for the gcloud command-line tool.
  • Explain the functionality and use cases for Storage Transfer Service.
  • Explain the functionality and use cases for Transfer Appliance.
  • Understand the features and deployment of Datastream.

 

The Extract and Load Data Pipeline Pattern

  • Explain the baseline extract and load architecture diagram.
  • Understand the options of the bq command-line tool.
  • Explain the functionality and use cases for BigQuery Data Transfer Service.
  • Explain the functionality and use cases for BigLake as a non-extract-load pattern

 

The Extract, Load, and Transform Data Pipeline Pattern

  • Explain the baseline extract, load, and transform architecture diagram.
  • Understand a common ELT pipeline on Google Cloud.
  • Learn about BigQuery’s SQL scripting and scheduling capabilities.
  • Explain the functionality and use cases for Dataform

 

The Extract, Transform, and Load Data Pipeline Pattern

  • Explain the baseline extract, transform, and load architecture diagram.
  • Learn about the GUI tools on Google Cloud used for ETL data pipelines.
  • Explain batch data processing using Dataproc.
  • Learn how to use Dataproc Serverless for Spark for ETL.
  • Explain streaming data processing options.
  • Explain the role Bigtable plays in data pipelines

 

Automation Techniques

  • Explain the automation patterns and options available for pipelines.
  • Learn about Cloud Scheduler and Workflows.
  • Learn about Cloud Composer.
  • Learn about Cloud Run functions.
  • Explain the functionality and automation use cases for Eventarc
Get This Course $895 GOV $620 For Team Prices Call: 888-843-8733

  • 1-Day Instructor-Led Training

  • Hands-On Labs

  • After-Course Instructor-Coaching

Get the Advantage $3,895
  • Take this course and gain unlimited access to more than 300 virtual instructor-led courses
  • Future-proof your career with more than 100 sought-after certifications in the market
  • Build real skills through hands-on learning in more than 180 virtual labs
  • Grow your skills and capabilities with more than one course at a time and save
Thank you for choosing subscriptions!
#1481
  • May 20 9:00 AM - 4:30 PM EDT
    Virtual
  • Aug 19 9:00 AM - 4:30 PM EDT
    Virtual
  • Nov 18 9:00 AM - 4:30 PM EST
    Virtual

  • 1-Day Instructor-Led Training

  • Hands-On Labs

  • After-Course Instructor-Coaching

Get the Advantage $3,895
  • Take this course and gain unlimited access to more than 300 virtual instructor-led courses
  • Future-proof your career with more than 100 sought-after certifications in the market
  • Build real skills through hands-on learning in more than 180 virtual labs
  • Grow your skills and capabilities with more than one course at a time and save
Thank you for choosing subscriptions!
#1481
  • May 20 9:00 AM - 4:30 PM EDT
    Virtual
  • Aug 19 9:00 AM - 4:30 PM EDT
    Virtual
  • Nov 18 9:00 AM - 4:30 PM EST
    Virtual

  • Bring this or any training to your organization

  • Full-scale program development

  • Delivered when, where, and how you want it

  • Blended learning models

  • Tailored content

  • Expert team coaching

Get the Advantage $3,895
  • Take this course and gain unlimited access to more than 300 virtual instructor-led courses
  • Future-proof your career with more than 100 sought-after certifications in the market
  • Build real skills through hands-on learning in more than 180 virtual labs
  • Grow your skills and capabilities with more than one course at a time and save
Thank you for choosing subscriptions!
#1481
Questions about this course?
* Required Fields
Customize Your Team Training Experience

Fill out the form below or call 888-843-8733

* Required Fields
Preferred method of contact:

Need Help Finding The Right Training Solution?

Our training advisors are here for you.

Contact Us

Introduction to Data Engineering

While this introductory course itself may not lead to a certification, it is a stepping stone toward preparing for the Google Cloud Certified – Professional Data Engineer certification.

You can assess your understanding through quizzes, hands-on labs, and practice exams available as part of the training program. These resources help reinforce learning and prepare for further certification.

Related Courses

  • Google
    From Data to Insights with Google Cloud

    Learn to derive insights from data using Google Cloud's BigQuery with hands-on labs, demos, and lectures. Ideal for data analysts and business professionals.

    Foundation
    3 days
    Online or In-class
    Starts from $2,785
  • Learning Tree
    Data Management Tools, Machine Learning and AI Training

    This 1-day introduction to Data Management Tools, provides the knowledge & skills to make effective Machine Learning and AI business & technical decisions.

    Foundation
    1 day
    Online or In-class
    Starts from $895
  • Learning Tree
    Introduction to Python for Data Analytics

    Learn Python for data analytics: clean, manipulate, and mine data. Evaluate model performance with numpy, pandas, scipy, and scikit-learn.

    Foundation
    1 day
    Online or In-class
    Bundle
    Starts from $895
Chat With Us