Shumin Guo - Hadoop Operations and Cluster Management Cookbook

Shumin Guo is a PhD student of Computer Science at Wright State University in Dayton, OH. His research fields include Cloud Computing and Social Computing. He is enthusiastic about open source technologies and has been working as a System Administrator, Programmer, and Researcher at State Street Corp. and LexisNexis.

I would like to sincerely thank my wife, Min Han, for her support both technically and mentally. This book would not have been possible without encouragement from her.

Hector Cuesta-Arvizu provides consulting services for software engineering and data analysis with over eight years of experience in a variety of industries, including financial services, social networking, e-learning, and Human Resources.

Hector holds a BA in Informatics and an MSc in Computer Science. His main research interests lie in Machine Learning, High Performance Computing, Big Data, Computational Epidemiology, and Data Visualization. He has also helped in the technical review of the book Raspberry Pi Networking Cookbook by Rick Golden , Packt Publishing . He has published 12 scientific papers in International Conferences and Journals. He is an enthusiast of Lego Robotics and Raspberry Pi in his spare time.

You can follow him on Twitter at https://twitter.com/hmCuesta.

Mark Kerzner holds degrees in Law, Math, and Computer Science. He has been designing software for many years and Hadoop-based systems since 2008. He is the President of SHMsoft, a provider of Hadoop applications for various verticals, and a co-author of the book/project Hadoop Illuminated . He has authored and co-authored books and patents.

I would like to acknowledge the help of my colleagues, in particular Sujee Maniyam, and last but not least, my multitalented family.

Harvinder Singh Saluja has over 20 years of software architecture and development experience, and is the co-founder of MindTelligent, Inc. He works as Oracle SOA, Fusion MiddleWare, and Oracle Identity and Access Manager, and Oracle Big Data Specialist and Chief Integration Specialist at MindTelligent, Inc. Harvinder's strengths include his experience with strategy, concepts, and logical and physical architecture and development using Java/JEE/ADF/SEAM, SOA/AIA/OSB/OSR/OER, and OIM/OAM technologies.

He leads and manages MindTelligent's onshore and offshore and Oracle SOA/OSB/AIA/OSB/OER/OIM/OAM engagements. His specialty includes the AIA Foundation Pack development of custom PIPS for Utilities, Healthcare, and Energy verticals. His integration engagements include CC&B (Oracle Utilities Customer Care and Billing), Oracle Enterprise Taxation and Policy, Oracle Utilities Mobile Workforce Management, Oracle Utilities Meter Data Management, Oracle eBusiness Suite, Siebel CRM, and Oracle B2B for EDI X12 and EDIFACT.

His strengths include enterprise-wide security using Oracle Identity and Access Management, OID/OVD/ODSM/OWSM, including provisioning, workflows, reconciliation, single sign-on, SPML API, Connector API, and Web Services message and transport security using OWSM and Java cryptography.

He was awarded JDeveloper Java Extensions Developer of the Year award in 2003 by Oracle magazine.

www.PacktPub.com

Support files, eBooks, discount offers and more

You might want to visit www.PacktPub.com for support files and downloads related to your book.

Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at > for more details.

At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks.

http://PacktLib.PacktPub.com

Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can access, read and search across Packt's entire library of books.

Why Subscribe?

• Fully searchable across every book published by Packt
• Copy and paste, print and bookmark content
• On demand and accessible via web browser

Free Access for Packt account holders

If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view nine entirely free books. Simply use your login credentials for immediate access.

Preface

Today, many organizations are facing the Big Data problem. Managing and processing Big Data can incur a lot of challenges for traditional data processing platforms such as relational database systems. Hadoop was designed to be a distributed and scalable system for dealing with Big Data problems. A Hadoop-based Big Data platform uses Hadoop as the data storage and processing engine. It deals with the problem by transforming the Big Data input into expected output.

Hadoop Operations and Cluster Management Cookbook provides examples and step-by-step recipes for you to administrate a Hadoop cluster. It covers a wide range of topics for designing, configuring, managing, and monitoring a Hadoop cluster. The goal of this book is to help you manage a Hadoop cluster more efficiently and in a more systematic way.