Kakadia - Apache Mesos Essentials

Dharmesh Kakadia is a research fellow at Microsoft Research, who develops the next-generation cluster management systems. Before coming to MSR, he completed his MS in research from the International Institute of Information Technology, Hyderabad, where he worked on improving scheduling in cloud and big data systems. He likes to work at the intersection of systems and data and has published research in resource management at various venues. He is passionate about open source technologies and plays an active role in various open source communities. You can learn more about him at @DharmeshKakadia on Twitter.

I would like to thank my family members, friends, and colleagues for always being there for me. I would also like to thank the reviewers and the entire Packt Publishing staff for putting in the hard work to make sure that the quality of the book was up to the mark. Without help from all these people, this book would never have made it here.

Tomas Barton is a PhD candidate at Czech Technical University in Prague, who focuses on distributed computing, data mining, and machine learning. He has been experimenting with Mesos since its early releases. He has contributed to Debian packaging and maintains a Puppet module for automated Mesos installation management.

Andrea Mostosi is a technology enthusiast. He is an innovation lover from childhood. He started his professional career in 2003 and has worked on several projects, playing almost every role in the computer science environment. He is currently the CTO at The Fool, a company that tries to make sense of the Web and social data. During his free time, he likes to travel, run, cook, ride a bike, and write code.

I would like to thank my geek friends, Simone M, Daniele V, Luca T, Luigi P, Michele N, Luca O, Luca B, Diego C, and Fabio B. They are the smartest people I know and comparing myself with them has always pushed me to do better.

Sai Warang is a software developer working at a Canadian start-up called Shopify. He is currently working on making real-time tools to protect the hundreds of thousands of online merchants from fraud. In the past, he has studied computer science at the University of Waterloo and worked at Tagged and Zynga in San Francisco on various data analytics projects. He occasionally dabbles in creative writing.

www.PacktPub.com

Support files, eBooks, discount offers, and more

For support files and downloads related to your book, please visit www.PacktPub.com.

Did you know that Packt offers eBook versions of every book published, with PDF and ePub files available? You can upgrade to the eBook version at > for more details.

At www.PacktPub.com, you can also read a collection of free technical articles, sign up for a range of free newsletters and receive exclusive discounts and offers on Packt books and eBooks.

https://www2.packtpub.com/books/subscription/packtlib

Do you need instant solutions to your IT questions? PacktLib is Packt's online digital book library. Here, you can search, access, and read Packt's entire library of books.

Why subscribe?

• Fully searchable across every book published by Packt
• Copy and paste, print, and bookmark content
• On demand and accessible via a web browser

Free access for Packt account holders

If you have an account with Packt at www.PacktPub.com, you can use this to access PacktLib today and view 9 entirely free books. Simply use your login credentials for immediate access.

Preface

Mesos makes it easier to develop and manage fault-tolerant and scalable distributed applications. Mesos provides primitives that allow you to program for the aggregated resource pool, without worrying about managing resources on individual machines. With Mesos, all your favorite frameworks, ranging from data processing to long-running services to data storage to Web serving, can share resources from the same cluster. The unification of infrastructure combined with the resilience built into Mesos also simplifies the operational aspects of large deployments. When running on Mesos, failures will not affect the continuous operations of applications.

With Mesos, everyone can develop distributed applications and scale it to millions of nodes.

What this book covers

, Running Mesos , explains the need for a data center operating system in the modern infrastructure and why Mesos is a great choice for it. It also covers how to set up singlenode and multimode Mesos installations in various environments.

, Running Hadoop on Mesos , discusses batch data processing using Hadoop on Mesos.

, Running Spark on Mesos , covers how to run Spark on Mesos. It also covers tuning considerations for Spark while running on Mesos.

, Complex Data Analysis on Mesos , demonstrates the various options for deploying lambda architecture on Mesos. It covers Storm, Spark Streaming, and Cassandra setups on Mesos in detail.

, Running Services on Mesos , introduces services and walks you through the different aspects of service architecture on Mesos. It covers the Marathon, Chronos, and Aurora frameworks in detail and helps you understand how services are deployed on Mesos.