Hands-On Deep Learning Algorithms with Python
Master deep learning algorithms with extensive math by implementing them using TensorFlow
Sudharsan Ravichandiran
BIRMINGHAM - MUMBAI
Hands-On Deep Learning Algorithms with Python
Copyright 2019 Packt Publishing
All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.
Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing or its dealers and distributors, will be held liable for any damages caused or alleged to have been caused directly or indirectly by this book.
Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.
Commissioning Editor: Pravin Dhandre
Acquisition Editor: Devika Battike
Content Development Editor: Unnati Guha
Senior Editor: Martin Whittemore
Technical Editor: Naveen Sharma
Copy Editor: Safis Editing
Project Coordinator: Manthan Patel
Proofreader: Safis Editing
Indexer: Manju Arasan
Graphics: Jisha Chirayil
Production Designer: Shraddha Falebhai
First published: July 2019
Production reference: 1240719
Published by Packt Publishing Ltd.
Livery Place
35 Livery Street
Birmingham
B3 2PB, UK.
ISBN 978-1-78934-415-8
www.packtpub.com
To my adorable mom, Kasthuri, and to my beloved dad, Ravichandiran.
- Sudharsan Ravichandiran
Packt.com
Subscribe to our online digital library for full access to over 7,000 books and videos, as well as industry leading tools to help you plan your personal development and advance your career. For more information, please visit our website.
Why subscribe?
Spend less time learning and more time coding with practical eBooks and Videos from over 4,000 industry professionals
Improve your learning with Skill Plans built especially for you
Get a free eBook or video every month
Fully searchable for easy access to vital information
Copy and paste, print, and bookmark content
Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at www.packt.com and as a print book customer, you are entitled to a discount on the eBook copy. Get in touch with us at customercare@packtpub.com for more details.
At www.packt.com , you can also read a collection of free technical articles, sign up for a range of free newsletters, and receive exclusive discounts and offers on Packt books and eBooks.
Contributors
About the author
Sudharsan Ravichandiran is a data scientist, researcher, artificial intelligence enthusiast, and YouTuber (search for Sudharsan reinforcement learning). He completed his bachelor's in information technology at Anna University. His area of research focuses on practical implementations of deep learning and reinforcement learning, which includes natural language processing and computer vision. He is an open source contributor and loves answering questions on Stack Overflow. He also authored a best-seller, Hands-On Reinforcement Learning with Python, published by Packt Publishing.
I would like to thank my most amazing parents and my brother, Karthikeyan, for inspiring and motivating me. I am forever grateful to my Sur who always has my back. I can't thank enough my editors, Unnati and Naveen for their hard work and dedication. Without their support, it would have been impossible to complete this book.
About the reviewers
Sujit S Ahirrao is a computer vision and machine learning researcher and software developer who's mostly experienced in image processing and deep learning. He graduated in electronics and telecommunication from University of Pune. He made his way into the field of artificial intelligence through start-ups and has been a part of in-house R&D teams at well-established firms. He pursues his interest in contributing to education, healthcare, and scientific research communities with his growing skills and experience.
Bharath Kumar Varma currently works as a lead data scientist at an Indian tech start-up called MTW Labs, with clients in India and North America. His primary areas of interest are deep learning, NLP, and computer vision. He is a seasoned architect focusing on machine learning projects, vision and text analytics solutions, and is an active member of the start-up ecosystem. He holds a M.Tech degree from IIT Hyderabad, with a specialization in data science, and is certified in various other technological and banking-related certifications. Aside from his work, he actively participates in teaching and mentoring data science enthusiasts and contributes to the community by networking and working with fellow enthusiasts in groups.
Doug Ortiz is an experienced enterprise cloud, big data, data analytics, and solutions architect who has architectured, designed, developed, re-engineered, and integrated enterprise solutions. His other areas of expertise include Amazon Web Services, Azure, Google Cloud, business intelligence, Hadoop, Spark, NoSQL databases, and SharePoint. He is also the founder of Illustris, LLC.
Packt is searching for authors like you
If you're interested in becoming an author for Packt, please visit authors.packtpub.com and apply today. We have worked with thousands of developers and tech professionals, just like you, to help them share their insight with the global tech community. You can make a general application, apply for a specific hot topic that we are recruiting an author for, or submit your own idea.
Preface
Deep learning is one of the most popular domains in the artificial intelligence (AI) space, which allows you to develop multi-layered models of varying complexities. This book introduces you to popular deep learning algorithmsfrom basic to advancedand shows you how to implement them from scratch using TensorFlow. Throughout the book, youll gain insights into each algorithm, the mathematical principles behind it, and how to implement them in the best possible manner.
The book starts by explaining how you can build your own neural network, followed by introducing you to TensorFlow; the powerful Python-based library for machine learning and deep learning. Next, you will get up to speed with gradient descent variants, such as NAG, AMSGrad, AdaDelta, Adam, Nadam, and more. The book will then provide you with insights into the working of
Next page