Farrukh Akhtar - Practical Reinforcement Learning

BIRMINGHAM - MUMBAI

Copyright 2017 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

First published: October 2017

Production reference: 1131017

ISBN 978-1-78712-872-9

www.packtpub.com

Dr. Engr. S.M. Farrukh Akhtar is an active researcher and speaker with more than 13 years of industrial experience analyzing, designing, developing, integrating, and managing large applications in different countries and diverse industries. He has worked in Dubai, Pakistan, Germany, Singapore, and Malaysia. He is currently working in Hewlett Packard as an enterprise solution architect.

He received a PhD in artificial intelligence from European Global School, France. He also received two master's degrees: a m aster's of intelligent systems from the University Technology Malaysia, and MBA in business strategy from the International University of Georgia. Farrukh completed his BSc in computer engineering from Sir Syed University of Engineering and Technology, Pakistan. He is also an active contributor and member of the machine learning for data science research group in the University Technology Malaysia. His research and focus areas are mainly big data, deep learning, and reinforcement learning.

He has cross-platform expertise and has achieved recognition for his expertise from IBM, Sun Microsystems, Oracle, and Microsoft. Farrukh received the following accolades:

• Sun Certified Java Programmer in 2001
• Microsoft Certified Professional and Sun Certified Web Component Developer in 2002
• Microsoft Certified Application Developer in 2003
• Microsoft Certified Solution Developer in 2004
• Oracle Certified Professional in 2005
• IBM Certified Solution Developer - XML in 2006
• IBM Certified Big Data Architect and Scrum Master Certified - For Agile Software Practitioners in 2017

He also contributes his experience and services as a member of the board of directors in K.K. Abdal Institute of Engineering and Management Sciences, Pakistan, and is a board member of Alam Educational Society.

Skype id: farrukh.akhtar

Ruben Oliva Ramos is a computer systems engineer with a master's degree in computer and electronic systems engineering, teleinformatics, and networking, with a specialization from the University of Salle Bajio in Leon, Guanajuato, Mexico. He has more than 5 years of experience in developing web applications to control and monitor devices connected with Arduino and Raspberry Pi, and using web frameworks and cloud services to build Internet of Things applications.

He is a mechatronics teacher at the University of Salle Bajio and teaches students of master's in design and engineering of mechatronics systems. Ruben also works at Centro de Bachillerato Tecnologico Industrial 225 in Leon, teaching subjects such as electronics, robotics and control, automation, and microcontrollers.

He is a technician, consultant, and developer of monitoring systems and datalogger data using technologies such as Android, iOS, Windows Phone, HTML5, PHP, CSS, Ajax, JavaScript, Angular, ASP.NET databases (SQlite, MongoDB, web servers, Node.js, IIS), hardware programming (Arduino, Raspberry Pi, Ethernet Shield, GPS, and GSM/GPRS), ESP8266, and control and monitor systems for data acquisition and programming.

He has written a book called Internet of ThingsProgramming with JavaScript, published by Packt.

Juan Toms Oliva Ramos is an environmental engineer from the University of Guanajuato, Mexico, with a master's degree in administrative engineering and quality. He has more than 5 years of experience in management and development of patents, technological innovation projects, and development of technological solutions through the statistical control of processes. He has been a teacher of statistics, entrepreneurship, and technological development of projects since 2011. He became an entrepreneur mentor and started a new department of technology management and entrepreneurship at Instituto Tecnologico Superior de Purisima del Rincon.

Juan is an Alfaomega reviewer and has worked on the book Wearable designs for Smart watches, Smart TVs and Android mobile devices.

He has developed prototypes through programming and automation technologies for the improvement of operations, which have been registered for patents.