Tomasz Palczewski - Production-Ready Applied Deep Learning: Learn how to construct and deploy complex models in PyTorch and TensorFlow deep-learning frameworks

Learn how to construct and deploy complex models in PyTorch and TensorFlow deep learning frameworks

Tomasz Palczewski

Jaejun (Brandon) Lee

Lenin Mookiah

BIRMINGHAMMUMBAI

Copyright 2022 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the authors, nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

Publishing Product Manager: Ali Abidi

Senior Editor: Nazia Shaikh

Content Development Editor: Shreya Moharir

Technical Editor: Rahul Limbachiya

Copy Editor: Safis Editing

Project Coordinator: Farheen Fathima

Proofreader: Safis Editing

Indexer: Rekha Nair

Production Designer: Aparna Bhagat

Marketing Coordinators: Shifa Ansari and Abeer Dawe

First published: September 2022

Production reference: 1260822

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham

B3 2PB, UK.

ISBN 978-1-80324-366-5

www.packt.com

To Sylwia, Anna, and Matt my loves, my life. To my Mom, my brother Piotr, and my family.

- Tomasz

To my parents, Changhee and Kyung Ja, for always loving and supporting me.

- Jaejun

To my mom, Chendurkani, for her unconditional support and encouragement.

- Lenin

Finally, we would like to dedicate this book to self-motivated and value-driven individuals who put their time into learning new technologies to make the world more exciting.

Tomasz Palczewski is currently working as a staff software engineer at Samsung Research America (SRA). He has a Ph.D. in physics and an eMBA degree from Quantic. His zeal for getting insights out of large datasets using cutting-edge techniques led him to work across the globe at CERN (Switzerland), LBNL (Italy), J-PARC (Japan), University of Alabama (US), and the University of California, Berkeley (US). In 2016, he was deployed to the South Pole to calibrate the worlds largest neutrino telescope. At some point, he decided to pivot his career and focus on applying his skills in industry. Currently, Dr. Palczewski works on modeling user behavior and creating value for advertising and marketing verticals by deploying machine learning (ML), deep learning, and statistical models at scale.

I had the idea of writing a book that my younger self would appreciate. The book would show different aspects of production-ready deep learning. I am grateful that Jaejun and Lenin were excited about the idea and joined the project. Without their help, this would not have turned out as it did. Finally, I would like to thank my wife for all her support.

Jaejun (Brandon) Lee is currently working as an AI research lead at RoboEye.ai, integrating cutting-edge algorithms in computer vision and AI into industrial automation solutions. He obtained his masters degree from the University of Waterloo with research focused on natural language processing (NLP), specifically speech recognition. He has spent many years developing a fully productionized yet open source wake word detection toolkit with a web browser deployment target, Howl. Luckily, his effort has been picked up by Mozillas Firefox Voice and it is actively providing a completely hands-free experience to many users all over the world.

I would like to thank Tomasz for offering this remarkable opportunity to become an author. Next, I am really grateful to Lenin for sharing his knowledge of data engineering throughout our journey. Lastly, I would like to thank Erica for her encouragement.

Lenin Mookiah is a machine learning engineer who has worked with reputed tech companies Samsung Research America, eBay Inc., and Adobe R&D. He has worked in the technology industry for over 11 years in various domains: banking, retail, eDiscovery, and media. He has played various roles in the end-to-end productization of large-scale machine learning systems. He mainly employs the big data ecosystem to build reliable feature pipelines that data scientists consume. Apart from his industrial experience, he researched anomaly detection in his Ph.D. at Tennessee Tech University (US) using a novel graph-based approach. He studied entity resolution on social networks during his masters at Tsinghua University, China.

Working with Tomasz and Jaejun was very exciting. I sincerely thank both for the collaboration on this book. I have learned many aspects of data science from both.

Utkarsh Srivastava is an AI/ML professional, trainer, YouTuber, and blogger. He loves to tackle and develop ML, NLP, and computer vision algorithms to solve complex problems. He started his data science career as a blogger of his own blog (datamahadev.com) and YouTube channel (datamahadev), followed by working as a senior data science trainer in an institute in Gujarat. Additionally, he has trained and counseled 1,000+ working professionals and students in AI/ML. Utkarsh has successfully completed 40+ freelance training and development work/projects in data science and analytics, AI/ML, Python development, and SQL. He hails from Lucknow and is currently settled in Bangalore, India, as an analyst at Deloitte USI Consulting.

I would like to thank my mother, Mrs. Rupam Srivastava, for her continuous guidance and support throughout my hardships and struggles. Thanks also to the Supreme Para-Brahman.

Neeraj Jhaveri is a cloud solution architect at Microsoft with expertise in providing data and AI solutions. He has around 20 years of IT experience. Over the last decade, working on data and analytics, he has provided AI architect solutions on Azure. Using Azure ML and Cognitive Services, he has helped customers move to Azure using the latest technologies. He received a masters degree in computer science from NYIT. He provides frequent tech talks for the fast-tracking implementation of AI solutions in Azure.

Pooya Rezaei is an ML software engineer at Google using machine learning to estimate offline conversions from Google Ads. Previously, he was an ML engineer at Iterable for two years optimizing their email marketing automation platform to maximize reach. He received a B.Sc. from the University of Tehran, an M.Sc. from the Sharif University of Technology, and a Ph.D. from the University of Vermont, all in electrical and computer engineering.