Marwala Tshilidzi - Handbook Of Machine Learning - Volume 2: Optimization And Decision Making

HANDBOOK OF
MACHINE LEARNING

Volume 2: Optimization and
Decision Making

HANDBOOK OF
MACHINE LEARNING

Volume 2: Optimization and
Decision Making

Tshilidzi Marwala

Collins Achepsah Leke

University of Johannesburg, South Africa

Published by

World Scientific Publishing Co. Pte. Ltd.

5 Toh Tuck Link, Singapore 596224

USA office: 27 Warren Street, Suite 401-402, Hackensack, NJ 07601

UK office: 57 Shelton Street, Covent Garden, London WC2H 9HE

Library of Congress Cataloging-in-Publication Data

Names: Marwala, Tshilidzi, 1971 author.

Title: Handbook of machine learning / by Tshilidzi Marwala (University of Johannesburg, South Africa).

Description: New Jersey : World Scientific, 2018- | Includes bibliographical references and index. Contents: volume 1. Foundation of artificial intelligence

Identifiers: LCCN 2018023989 | ISBN 9789813271227 (hc : alk. paper : v. 1)

Subjects: LCSH: Machine learning. | Artificial intelligence.

Classification: LCC Q325.5 .M3688 2018 | DDC 006.3/1--dc23

LC record available at https://lccn.loc.gov/2018023989

British Library Cataloguing-in-Publication Data

A catalogue record for this book is available from the British Library.

Volume 2. Optimization and Decision Making

by Tshilidzi Marwala and Collins A. Leke

ISBN 978-981-120-566-8

Copyright 2020 by World Scientific Publishing Co. Pte. Ltd.

All rights reserved. This book, or parts thereof, may not be reproduced in any form or by any means, electronic or mechanical, including photocopying, recording or any information storage and retrieval system now known or to be invented, without written permission from the publisher.

For photocopying of material in this volume, please pay a copying fee through the Copyright Clearance Center, Inc., 222 Rosewood Drive, Danvers, MA 01923, USA. In this case permission to photocopy is not required from the publisher.

For any available supplementary material, please visit

https://www.worldscientific.com/worldscibooks/10.1142/11425#t=suppl

Desk Editors: Herbert Moses/Yu Shan Tay

Typeset by Stallion Press

Email:

Printed in Singapore

Preface

Handbook of Machine Learning: Optimization and Decision-Making Volume 2, discusses the concepts and applications of optimization algorithms as well as other concepts like economic modeling and decision-making. The optimization algorithms that are studied include NelderMead simplex method, conjugate gradient descent, BroydenFletcherGoldfarbShanno, genetic algorithm, simulated annealing, particle swarm optimization, response surface method, ant colony optimization, bat algorithm, firefly algorithm, artificial immune system, invasive weed optimization algorithm, Cuckoo search, decision trees and random forests. In addition, this book explores hybrid methods, economic modeling, condition monitoring and rational decision-making.

These algorithms are used to solve the missing data, finite element model updating, Sudoku, remanufacturing and condition monitoring problems.

This book is an interesting reference for graduate students, researchers and artificial intelligence practitioners.

Tshilidzi Marwala and Collins Achepsah Leke

University of Johannesburg

March 2019

About the Authors

Tshilidzi Marwala, born in Venda (Limpopo, South Africa), is the Vice Chancellor and Principal of the University of Johannesburg. Previously, he was the Deputy Vice Chancellor for Research and Internationalization and the Executive Dean of the Faculty of Engineering and the Built Environment both at the University of Johannesburg. From 2003 to 2008, he progressively held the positions of Associate Professor, Full Professor, the Carl and Emily Fuchs Chair of Systems and Control Engineering as well as the SARChI Chair of Systems Engineering at the Department of Electrical and Information Engineering at the University of the Witwatersrand. From 2001 to 2003, he was the Executive Assistant to the Technical Director at South African Breweries. From 2000 to 2001, he was a post-doctoral research associate at the Imperial College (then University of London). He holds a Bachelor of Science in Mechanical Engineering (magna cum laude) from Case Western Reserve University (USA) in 1995, a Master of Mechanical Engineering from the University of Pretoria in 1997 and a Ph.D. specializing in Artificial Intelligence and Engineering from the University of Cambridge in 2000. Marwala completed the Advanced Management Program (AMP) at Columbia University Businesses School in 2017 and completed a Program for Leadership Development (PLD) at Harvard Business School in 2007. Tshilidzi is a registered professional engineer, a Fellow of TWAS (The World Academy of Sciences), the Academy of Science of South Africa, the African Academy of Sciences and the South African Academy of Engineering. He is a Senior Member of the Institute of Electrical and Electronics Engineering (IEEE) and a distinguished member of the Association for Computing Machinery (ACM). His research interests are multi-disciplinary, and they include the theory and application of artificial intelligence to engineering, computer science, finance, social science and medicine. He has extensive track record in human capacity development having supervised 47 Masters and 28 Doctoral students to completion. Some of these students have proceeded with their doctoral and post-doctoral studies at leading universities such as Harvard, Oxford, Cambridge, British Columbia, Rutgers, Purdue, Chiba and Waseda. He has published 13 books in artificial intelligence, one of these has been translated into Chinese, over 300 papers in journals, proceedings, book chapters and magazines and holds four patents. He is an Associate Editor of the International Journal of Systems Science (Taylor and Francis Publishers). He has been a visiting scholar at Harvard University, University of California at Berkeley, Wolfson College of the University of Cambridge and Nanjing Tech University as well as member of the programming council of the Faculty of Electrical Engineering at the Silesian University of Technology in Poland. He has received more than 45 awards including the Order of Mapungubwe and was a delegate to the 1989 London International Youth Science Fortnight (LIYSF) when he was in high school. His writings and opinions have appeared in the magazines New Scientist, The Economist and Time Magazine.

Collins Achepsah Leke, born in Yaounde (Cameroon), is a lecturer at the University of Johannesburg. He holds a Bachelor of Science with Honours in Computer Science from University of the Witwatersrand, a Master of Engineering from the University of Johannesburg and a Ph.D. in Engineering from the University of Johannesburg. His research interests include the applications of computational intelligence to engineering, computer science, finance, social science and medicine. He has published one book on Deep Learning and missing data in engineering systems.