Christian Cote - ETL with Azure Cookbook: Practical recipes for building modern ETL solutions to load and transform data from any source

Practical recipes for building modern ETL solutions to load and transform data from any source

Christian Cote

Matija Lah

Madina Saitakhmetova

BIRMINGHAMMUMBAI

Copyright 2020 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the authors, nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

Commissioning Editor: Sunith Shetty

Acquisition Editor: Ali Abidi

Senior Editor: David Sugarman

Content Development Editor: Nathanya Dias

Technical Editor: Manikandan Kurup

Copy Editor: Safis Editing

Project Coordinator: Aishwarya Mohan

Proofreader: Safis Editing

Indexer: Pratik Shirodkar

Production Designer: Vijay Kamble

First published: September 2020

Production reference: 1290920

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham

B3 2PB, UK.

ISBN 978-1-80020-331-0

www.packt.com

Packt.com

Subscribe to our online digital library for full access to over 7,000 books and videos, as well as industry leading tools to help you plan your personal development and advance your career. For more information, please visit our website.

• Spend less time learning and more time coding with practical eBooks and Videos from over 4,000 industry professionals
• Improve your learning with Skill Plans built especially for you
• Get a free eBook or video every month
• Fully searchable for easy access to vital information
• Copy and paste, print, and bookmark content

Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at for more details.

At www.packt.com, you can also read a collection of free technical articles, sign up for a range of free newsletters, and receive exclusive discounts and offers on Packt books and eBooks.

Christian Cote is an IT professional with more than 15 years of experience working on data warehouse, big data, and business intelligence projects. Christian has developed expertise in data warehousing and data lakes over the years and has designed many ETL/BI processes using a range of tools on multiple platforms. He's presented at several conferences and code camps. He currently co-leads the SQL Server PASS chapter. He is also a Microsoft Data Platform Most Valuable Professional (MVP).

Matija Lah has more than 18 years of experience working with Microsoft SQL Server, mostly from architecting data-centric solutions in the legal domain. His contributions to the SQL Server community have led to him being awarded the MVP Professional award (Data Platform) between 2007 and 2017/2018. He spends most of his time on projects involving advanced information management and natural language processing, but often finds time to speak at events related to Microsoft SQL Server where he loves to share his experience with the SQL Server platform.

Madina Saitakhmetova is a developer specializing in BI. She has been in IT for 15 years, working with Microsoft SQL, .NET, Microsoft BI, Azure, and building BI solutions for medical, educational, and engineering companies. Her adventure with Microsoft BI began with Analysis Services and SSIS, and in later years she has been building her expertise in ETL/ELT, both on-premises and in the cloud. Finding patterns, automating processes, and making BI teams work more efficiently are challenges that drive her. During the past few years, BIML has become an important part of her work, increasing its efficiency and quality.

Steph Martin is a senior customer engineer in the FastTrack for Azure team at Microsoft. She has a background in SQL Server database design and development and extensive knowledge of SSIS and ETL patterns and practices. Steph helps customers to achieve success with their projects, providing architecture design reviews, best practice guidance, and in-depth knowledge sharing across the platform, covering migration to Azure as well as cloud-first deployments. She has wide-ranging experience of Azure data services, specializing in Azure SQL Database and Managed Instance, and Azure Data Factory. Steph is an active member of the data platform community, running a PASS affiliated meetup in the UK and helping to co-ordinate the volunteer team at SQLBits.

Aaditya Pokkunuri is an experienced Senior Database Engineer with a demonstrated history of working in information technology and services industry. He is skilled in performance tuning, SQL Database, requirements analysis, databases, and servers, SSIS, and SSRS. He possesses strong knowledge on Clustering, SQL server high-availability options, and ITIL of processes. Aaditya's expertise lies in Windows administration tasks, active directory, and Microsoft Azure technologies. He is a strong information technology professional with a Bachelor of Technology degree, specializing in computer science and engineering from SASTRA University, Tamil Nadu.

If you're interested in becoming an author for Packt, please visit authors.packtpub.com and apply today. We have worked with thousands of developers and tech professionals, just like you, to help them share their insight with the global tech community. You can make a general application, apply for a specific hot topic that we are recruiting an author for, or submit your own idea.