Soumendra Mohanty - Big Data Imperatives: Enterprise ‘Big Data’ Warehouse, ‘BI’ Implementations and Analytics

Big Data Imperatives

Enterprise Big Data Warehouse, BI Implementations and Analytics

Soumendra Mohanty

Madhu Jagadeesh

Harsha Srivatsa

Big Data Analytics

Copyright 2013 by Soumendra Mohanty, Madhu Jagadeesh, and Harsha Srivatsa

This work is subject to copyright. All rights are reserved by the publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed. Exempted from this legal reservation are brief excerpts in connection with reviews or scholarly analysis or material supplied specifically for the purpose of being entered and executed on a computer system, for exclusive use by the purchaser of the work. Duplication of this publication or parts thereof is permitted only under the provisions of the Copyright Law of the Publishers location, in its current version, and permission for use must always be obtained from Springer. Permissions for use may be obtained through RightsLink at the Copyright Clearance Center. Violations are liable to prosecution under the respective Copyright Law.

ISBN-13 (pbk): 978-1-4302-4872-9

ISBN-13 (electronic): 978-1-4302-4873-6

Trademarked names, logos, and images may appear in this book. Rather than use a trademark symbol with every occurrence of a trademarked name, logo, or image we use the names, logos, and images only in an editorial fashion and to the benefit of the trademark owner, with no intention of infringement of the trademark.

The use in this publication of trade names, trademarks, service marks, and similar terms, even if they are not identified as such, is not to be taken as an expression of opinion as to whether or not they are subject to proprietary rights.

While the advice and information in this book are believed to be true and accurate at the date of publication, neither the authors nor the editors nor the publisher can accept any legal responsibility for any errors or omissions that may be made. The publisher makes no warranty, express or implied, with respect to the material contained herein.

President and Publisher: Paul Manning

Lead Editor: Saswata Mishra

Technical Reviewer: Nitin Sawant

Editorial Board: Steve Anglin, Ewan Buckingham, Gary Cornell, Louise Corrigan, Morgan Ertel, Jonathan Gennick, Jonathan Hassell, Robert Hutchinson, Michelle Lowman, James Markham, Matthew Moodie, Jeff Olson, Jeffrey Pepper, Douglas Pundick, Ben Renow-Clarke, Dominic Shakeshaft, Gwenan Spearing, Steve Weiss, Tom Welsh

Coordinating Editor: Anamika Panchoo

Copy Editor: Michael Sandlin

Compositor: SPi Global

Indexer: SPi Global

Artist: SPi Global

Cover Designer: Anna Ishchenko

Distributed to the book trade worldwide by Springer Science+Business Media New York, 233 Spring Street, 6th Floor, New York, NY 10013. Phone 1-800-SPRINGER, fax (201) 348-4505, e-mail . Apress Media, LLC is a California LLC and the sole member (owner) is Springer Science + Business Media Finance Inc (SSBM Finance Inc). SSBM Finance Inc is a Delaware corporation.

For information on translations, please .

Apress and friends of ED books may be purchased in bulk for academic, corporate, or promotional use. eBook versions and licenses are also available for most titles. For more information, reference our Special Bulk SaleseBook Licensing web page at www.apress.com/bulk-sales .

Any source code or other supplementary material referenced by the author in this text is available to readers at www.apress.com/9781430248729 . For detailed information about how to locate your books source code, go to www.apress.com/source-code .

Contents at a Glance

Contents

Preface

The path to here, for us, began in 2011. Data warehouses and BI solutions had become run of the mill; big data was gaining momentum. Sajid Usman (our boss) asked us a very simple but thought-provoking question: What do you think about big data? That got us thinking about big data. The definitions are plentiful and situational interpretations are plentiful as well. But a broader set of questions was lurking in our mind. What is the future of traditional data warehousing and BI applications? Are big data solutions a natural evolution of traditional BI applications? Should they co-exist? In our spare time, we started researching this topic, reading published papers, blogs, and other articles. By the end of 2011, a small but unmistakable set of thoughts and ideas began to materialize. It was further enriched by conversations with other practitioners and clients.

This book project began in late 2011. We find ourselves surprised and pleased to still be rolling along with this growing snowball of different thoughts. I (Soumendra) met with Harsha in San Jose during breakfast in a hotel (Marriott San Jose Downtown), we discussed the project and he jumped in to become a co-author. Madhu has been working in the data and analytics area for quite a long time and had always had an inclination to publish; she also agreed to join the group. So, we are only here by accident.

While we are all IT professionals, nobody would mistake us for expert researchers in this area. We are more like museum curators than painterscollecting, organizing, and packaging for wider use the great ideas of an emerging technology area. It turns out thats useful work as well.

After reading a draft, someone recently described the book as certainly a nice collection of thoughts. It was meant as a compliment, and we couldnt agree more. Big data is all about