Emily S. Patterson - Macrocognition Metrics and Scenarios

MACROCOGNITION METRICS AND SCENARIOS

Design and Evaluation for Real-World Teams

Edited by

EMILY S. PATTERSON
Ohio State University, USA

&

JANET E. MILLER
Air Force Research Laboratory, USA

ASHGATE

Emily S. Patterson and Janet E. Miller 2010

All rights reserved. No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording or otherwise without the prior permission of the publisher.

Emily S. Patterson and Janet E. Miller have asserted their right under the Copyright, Designs and Patents Act, 1988, to be identified as the editors of this work.

Published by
Ashgate Publishing Limited
Wey Court East
Union Road
Farnham
Surrey, GU9 7PT
England

Ashgate Publishing Company
Suite 420
101 Cherry Street
Burlington
VT 05401-4405
USA

www.ashgate.com

British Library Cataloguing in Publication Data
Macrocognition metrics and scenarios : design and

evaluation for real-world teams.
1. Group problem solving. 2. Teams in the workplace-
Evaluation.
I. Patterson, Emily S. II. Miller, Janet E.
658.4'036--dc22

ISBN: 978-0-7546-7578-5 (hbk)
ISBN: 978-1-4094-0687-7 (ebk)
ISBN: 978-1-4094-8636-7 (ebk-ePUB)

Library of Congress Cataloging-in-Publication Data
Macrocognition metrics and scenarios : design and evaluation for real-world teams /
edited by by Emily S. Patterson and Janet E. Miller.

p. cm.

Includes bibliographical references and index.

ISBN 978-0-7546-7578-5 (hardback) -- ISBN 978-1-4094-0687-7 (ebook) 1. Group
decision making--Evaluation. 2. Cognition--Measurement. 3. Teams in the workplace-
Evaluation. I. Patterson, Emily S., 1972- II. Miller, Janet E., 1952

HM746.M33 2010

658.4'036072--dc22

2010000799

Printed and bound in Great Britain by MPG Books Group, UK

Robert R. Hoffman

Robert R. Hoffman

C. Shawn Burke, Eduardo Salas, Kimberly Smith-Jentsch, and Michael A. Rosen

Gary Klein

Daniel J. Zelik, Emily S. Patterson, and David D. Woods

James Shanteau, Brian Friel, Rick P. Thomas, John Raacke, and David J. Weiss

John D. Lee

Lawrence G. Shattuck

Barbara Knzle, Yan Xiao, Anne M. Miller, and Colin Mackenzie

Emily S. Patterson and Robert L. Wears

Nancy J. Cooke and Jamie C. Gorman

Stephen M. Fiore, John Elias, Eduardo Salas, Norman W. Warner, and Michael P. Letsky

Emilie M. Roth and Robert G. Eggleston

Emily S. Patterson, Emilie M. Roth, and David D. Woods

Scott S. Potter and Robert Rousseau

John M. Flach, Daniel Schwartz, April M. Courtice, Kyle Behymer, and Wayne Shebilske

Sterling L. Wiggins and Donald A. Cox

Support for book editing and a two-day conference on Macrocognitive Metrics in Columbus, Ohio, at The Ohio State University on June 14, 2007, was provided by the Air Force Research Laboratory (S110000012). The views expressed in this book are those of the authors and do not necessarily represent those of the Air Force. We thank Christopher P. Nemeth for sharing a book index from Healthcare Team Communication, Michael W. Smith for creating the book index, and Fernando Bernal for designing the book cover. We thank all of the chapter reviewers, and in particular Robert Hoffman, for his thoughtful and detailed reviews of many of the book chapters.

Kyle Behymer is currently a Senior Researcher at 361 Interactive, LLC. Mr. Behymer received his M.S. in Human Factors Psychology in 2005 from Wright State University. From 20032006, he was a Research Psychologist at JST Applications in the defense and space industry. Mr. Behymers research interests are human factors psychology and computer information systems.

C. Shawn Burke is a Research Scientist at the Institute for Simulation and Training at the University of Central Florida. Dr. Burke earned her doctorate in Industrial and Organizational Psychology from George Mason University. Her expertise includes teams and their leadership, team adaptability, team training, measurement, evaluation, and team effectiveness. Dr. Burke has published more than 60 journal articles and book chapters related to these topics and has had work accepted at more than 100 peer-reviewed conferences.

Nancy J. Cooke is a Professor of Applied Psychology at Arizona State University and is Science Director of the Cognitive Engineering Research Institute in Mesa, AZ. She is also Section Editor of Human Factors, a member-at-large of the Human Factors and Ergonomics Societys Executive Council, a member of the National Research Councils Committee on Human Systems Integration, and a member of the US Air Force Scientific Advisory Board. Dr. Cooke specializes in the development, application, and evaluation of methodologies to elicit and assess individual and team cognition.

April B. Courtice is a Research Psychologist at the Air Force Research Laboratory. Ms. Courtice received her M.S. in Psychology from Wright State University in 2009. She is a member of the Human Factors and Ergonomics Society and her main research interest is cognitive engineering and decision making.

Donald A. Cox is a Senior Scientist at Klein Associates Division of Applied Research Associates. Mr. Cox completed his M.Sc. in Computer Science at the University of Calgary. Mr. Cox has been working with computers for over 25 years in design, implementation, evaluation, and researching of systems and development methods with a special interest in qualitative methods. At Klein Associates, Mr. Cox is currently involved in projects evaluating advanced decision support for planning, making ethnographic insights more available to system developers, and characterizing the impact of new technology of submarine command team functioning.

Robert G. Eggleston is a Principal Research Scientist affiliated with the Air Force Research Laboratory with over 30 years of fundamental and applied research experience on human performance in complex work. He is currently leading the theoretical and applied development of work-centered support technology from a joint cognitive systems perspective, addressing the contextualized work needs over the range of orderly (simple, complicated), to unruly (complex and chaotic) military work problem situations.

John Elias is a Graduate Student in the Modeling and Simulation program at the University of Central Floridas Institute for Simulation and Training. His education includes studies in molecular biology, literature, and philosophy. His chief research interests lie in the interdisciplinary cognitive sciences, with focus specifically on intersubjectivity and its relation to interaction.

Stephen M. Fiore is an Assistant Professor of Cognitive Sciences at the University of Central Florida with the Department of Philosophy and Director of the Cognitive Sciences Laboratory at UCFs Institute for Simulation and Training. Dr. Fiore earned his doctorate in Cognitive Psychology from the University of Pittsburgh. His multidisciplinary research interests incorporate aspects of the cognitive, social, and computational sciences in the investigation of learning and performance in individuals and teams. Dr. Fiore has published more than 100 scholarly publications in the area of learning, memory, and problem solving at the individual and the group level.