Gareth Eagar - Data Engineering with AWS: Learn how to design and build cloud-based data transformation pipelines using AWS

Learn how to design and build cloud-based data transformation pipelines using AWS

Gareth Eagar

BIRMINGHAMMUMBAI

Copyright 2021 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author(s), nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

Publishing Product Manager: Reshma Raman

Senior Editor: Mohammed Yusuf Imaratwale

Content Development Editor: Sean Lobo

Technical Editor: Rahul Limbachiya

Copy Editor: Safis Editing

Project Coordinator: Aparna Ravikumar Nair

Proofreader: Safis Editing

Indexer: Tejal Daruwale Soni

Production Designer: Alishon Mendonca

First published: December 2021

Production reference: 1251121

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham

B3 2PB, UK.

ISBN: 978-1-80056-041-3

www.packt.com

Gareth Eagar has worked in the IT industry for over 25 years, starting in South Africa, then working in the United Kingdom, and now based in the United States. In 2017, he started working at Amazon Web Services (AWS) as a solution architect, working with enterprise customers in the NYC metro area. Gareth has become a recognized subject matter expert for building data lakes on AWS, and in 2019 he launched the Data Lake Day educational event at the AWS Lofts in NYC and San Francisco. He has also delivered a number of public talks and webinars on topics relating to big data, and in 2020 Gareth transitioned to the AWS Professional Services organization as a senior data architect, helping customers architect and build complex data pipelines.

Disha Umarwani is a Data and ML Engineer at Amazon Web Services (AWS). She works with AWS heath care and life science customers to design, architect and build analytics and ML solutions on the AWS cloud. Disha specializes in services like AWS Glue, Amazon EMR, and AWS Step functions.

Praful Kava is a Senior Specialist Solutions Architect at Amazon Web Services (AWS). He guides customers in designing and engineering cloud-scale analytics pipelines on AWS. Outside work, Praful enjoys travelling with his family and exploring new hiking trails.

Natalie Rabinovich is a Senior Solutions Architect at Amazon Web Services (AWS). She has extensive experience in data center infrastructure, data storage, and big data and analytics. Natalie helps organizations design reliable and cost-effective cloud solutions.

Praveen Gupta is currently a data engineering manager and has over 17 years of experience in the IT industry. Praveen started his career as an ETL/reporting developer working on traditional RDBMSes and reporting tools. Since 2014, he has been working on the AWS cloud on projects related to data science/machine learning and building complex data engineering pipelines on AWS. He specializes in data ingestion, big data processing, reporting, and building massive data warehouses at the petabyte scale for his customers, helping his customers make data-driven decisions. Praveen has an undergraduate degree in computer science and a masters degree in computer science from UIUC, USA. Praveen lives in Portland, USA with his wife and 8-year-old daughter.

Mradul Saraf is a data engineer at an American multinational conglomerate that focuses on e-commerce, cloud computing, digital streaming, and artificial intelligence. It is one of the Big Five companies in the US. He has over four years of experience in data engineering, big data, and cloud computing. He holds a Bachelor of Technology degree in computer science from Maulana Azad National Institute of Technology, Bhopal. He has experience of architecture, analysis, design, development, implementation, maintenance, and support, along with experience of developing strategic methods for deploying big data technologies to efficiently meet big data processing requirements across multiple domains.