Vivek Kale - Parallel Computing Architectures and APIs: IoT Big Data Stream Processing

Parallel Computing Architectures and APIs

IoT Big Data Stream Processing

Parallel Computing Architectures and APIs

IoT Big Data Stream Processing

Vivek Kale

CRC Press

Taylor & Francis Group

52 Vanderbilt Avenue,

New York, NY 10017

2020 by Vivek Kale

CRC Press is an imprint of Taylor & Francis Group, an Informa business

No claim to original U.S. Government works

Printed on acid-free paper

International Standard Book Number-13: 978-1-138-55391-0 (Hardback)

This book contains information obtained from authentic and highly regarded sources. Reasonable efforts have been made to publish reliable data and information, but the author and publisher cannot assume responsibility for the validity of all materials or the consequences of their use. The authors and publishers have attempted to trace the copyright holders of all material reproduced in this publication and apologize to copyright holders if permission to publish in this form has not been obtained. If any copyright material has not been acknowledged please write and let us know so we may rectify in any future reprint.

Except as permitted under U.S. Copyright Law, no part of this book may be reprinted, reproduced, transmitted, or utilized in any form by any electronic, mechanical, or other means, now known or hereafter invented, including photocopying, microfilming, and recording, or in any information storage or retrieval system, without written permission from the publishers.

For permission to photocopy or use material electronically from this work, please access www.copyright.com ( http://www.copyright.com/ ) or contact the Copyright Clearance Center, Inc. (CCC), 222 Rosewood Drive, Danvers, MA 01923, 978-750-8400. CCC is a not-for-profit organization that provides licenses and registration for a variety of users. For organizations that have been granted a photocopy license by the CCC, a separate system of payment has been arranged.

Trademark Notice: Product or corporate names may be trademarks or registered trademarks, and are used only for identification and explanation without intent to infringe.

Visit the Taylor & Francis Web site at

http://www.taylorandfrancis.com

and the CRC Press Web site at

http://www.crcpress.com

To my family friends Charudutta (Charu) and Shobha Palkar

with whom we reconnected after a gap of almost 30 years

Contents

A basic trade-off exists between the use of one or a small number of complex processors, at one extreme, and a moderate to very large number of simpler processors, at the other. When combined with a high bandwidth, the interprocessor communication facility leads to significant simplification in the design process. However, two major roadblocks prevent the widespread adoption of such moderately to massively parallel architectures: the interprocessor communication bottleneck and the difficulty and high cost of algorithm/software development.

One of the most important reasons for studying parallel computing architectures is to learn how to extract the best performance from parallel systems. Specifically, you must understand its architectures so that you will be able to exploit those architectures during programming via the standardized application programming interfaces.

Until the last few decades, the business of the global economy was, essentially, manufacturing. The focus on goods rather than services led to a product-focused, mass-market marketing strategy resulting in a high cost of acquiring new customers, and a low cost for customers switching to other brands. There has always been a focus on customer needs, but with the advent of computers, there has been a shift away from producing goods or providing services, toward discovering and meeting the needs of the individual customer. Don Peppers and Martha Rogers pioneered the concept of one-to-one marketing made possible by the advent of computer-assisted database marketing. Businesses with highly diversified customer needs and highly differentiated customer valuations were expected to benefit from one-to-one customized marketing. This paradigm of one-to-one marketing has been further extended inward onto the production systems via Industry 4.0.

In the eighteenth century, the first industrial revolution, Industry 1.0, was characterized by mechanical production powered by water and steam. The industrial revolution in the twentieth century, Industry 2.0, introduced mass production, based on the division of labor and powered by electrical energy. In the 1970s, Industry 3.0 was set in motion by embedded electronics and information technology (IT) for further automation of production. Industry 4.0 (especially in Europe; Industrial Internet in the United States), reflects the rise of a basket of new digitally-enabled industrial technologies i.e.