Firesmith - Common system and software testing pitfalls: how to prevent and mitigate them: descriptions, symptoms, consequences, causes, and recommendations

ePUB is an open, industry-standard format for eBooks. However, support of ePUB and its many features varies across reading devices and applications. Use your device or app settings to customize the presentation to your liking. Settings that you can customize often include font, font size, single or double column, landscape or portrait mode, and figures that you can click or tap to enlarge. For additional information about the settings and features on your reading device or app, visit the device manufacturers Web site.

Many titles include programming code or configuration examples. To optimize the presentation of these elements, view the eBook in single-column, landscape mode and adjust the font size to the smallest setting. In addition to presenting code and configurations in the reflowable text format, we have included images of the code that mimic the presentation found in the print book; therefore, where the reflowable format may compromise the presentation of the code listing, you will see a Click here to view code image link. Click the link to view the print-fidelity code image. To return to the previous page viewed, click the Back button on your device or app.

How to Prevent and Mitigate Them

Descriptions, Symptoms, Consequences, Causes, and Recommendations

Donald G. Firesmith

Upper Saddle River, NJ Boston Indianapolis San Francisco
New York Toronto Montreal London Munich Paris Madrid
Capetown Sydney Tokyo Singapore Mexico City

Software Engineering Institute | CarnegieMellon

The SEI Series in Software Engineering

Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals.

The author and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein.

For information about buying this title in bulk quantities, or for special sales opportunities (which may include electronic versions; custom cover designs; and content particular to your business, training goals, marketing focus, or branding interests), please contact our corporate sales department at or (800) 382-3419.

For government sales inquiries, please contact .

For questions about sales outside the U.S., please contact .

Visit us on the Web: informit.com/aw

Library of Congress Cataloging-in-Publication Data

Firesmith, Donald G., 1952
Common system and software testing pitfalls : how to prevent and
mitigate them : descriptions, symptoms, consequences, causes, and
recommendations / Donald G. Firesmith.
pages cm.
Includes bibliographical references and index.
ISBN 978-0-13-374855-0 (pbk. : alk. paper)
1. Computer softwareTestingAutomation. 2. Software
failuresPrevention. I. Title.
QA76.76.T48F58 2013
005.3028'7dc23 2013039235

Copyright 2014 Pearson Education, Inc.

All rights reserved. Printed in the United States of America. This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, electronic, mechanical, photocopying, recording, or likewise. To obtain permission to use material from this work, please submit a written request to Pearson Education, Inc., Permissions Department, One Lake Street, Upper Saddle River, New Jersey 07458, or you may fax your request to (201) 236-3290.

ISBN-13: 978-0-13-374855-0
ISBN-10: 0-13-374855-3

Text printed in the United States on recycled paper at R.R. Donnelley in Crawfordsville, Indiana.
First printing, December 2013

Firesmiths collection of actionable practices for real-world, non-trivial testing and the processes in which theyre applied is comprehensive and uniquely valuable. Nothing published about software testing in recent years provides anything like it.

Robert V. Binder, robertvbinder.com

Dons compilation of real-world testing problems, symptoms, and solutions is the most comprehensive available. You can use it early in your project to prevent these problems. Or you can use it at the end, as a ready list of costly lessons you could have avoided, had you used it early on. Im afraid this books publication will undermine a lot of excuses for repeating these mistakes.

Vince Alcalde, National Australia Bank

Excellent, Excellent, Excellent! This book should be mandatory reading for anyone involved in product development. Donalds book addresses the pitfalls that need to be understood and allowed for in all product development verification and validation planning. While the focus of the book is on software projects, most of the pitfalls are equally applicable to any size project that involves both hardware and software.

Louis S. Wheatcraft, Requirements Experts Inc.

The potential impact of this book cannot be overstressed. Software systems that are not adequately tested do not adequately evolve. I highly recommend this book as a must-read for people directly involved in the development and management of software-intensive systems.

Dr. Kenneth E. Nidiffer, Director of Strategic Plans for Government Programs, Software Engineering Institute, Carnegie Mellon University

Common System and Software Testing Pitfalls identifies realistic testing pitfalls. More importantly, it also identifies solutions for avoiding them on your next project. Every manager should read this book and follow the recommendations.

Barry Stanly, Enterprise Technology Alliance

Whether you are a novice tester or a seasoned professional, you will find this book to be a valuable resource. The information on how to identify and prevent problem areas is clear, concise and, most importantly, actionable.

Allison Yeager, Blackbaud

First of all, this is great material! It contains probably all of the testing problems I have faced in my career and some that I wasnt aware of.... Thank you for the opportunity to read this superb material!

Alexandru Cosma, Frequentis

As a tester, I consider Common System and Software Testing Pitfalls by Donald Firesmith to be a must-read book for all testers and QA engineers.

Thanh Huynh, LogiGear

Your book provides very good insight and knowledge. After working in IT for over thirty years, and focusing on software testing the past thirteen years, I still learned more tips and best practices in software testing.

Tom Zalewski, Texas State Government

This book is essential for the people in the cyber security business... I can see it becoming a classic. Don has done a great job.

Michael Hom, Compass360 Consulting