Agile Testing
A Practical Guide for Testers and Agile Teams
Lisa Crispin
Janet Gregory
Upper Saddle River, NJ Boston Indianapolis San Francisco
New York Toronto Montreal London Munich Paris Madrid
Capetown Sydney Tokyo Singapore Mexico City
Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks. Where those designations appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals.
The authors and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions. No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein.
The publisher offers excellent discounts on this book when ordered in quantity for bulk purchases or special sales, which may include electronic versions and/or custom covers and content particular to your business, training goals, marketing focus, and branding interests. For more information, please contact:
U.S. Corporate and Government Sales
(800) 382-3419
For sales outside the United States, please contact:
International Sales
Visit us on the Web: informit.com/aw
Library of Congress Cataloging-in-Publication Data:
Crispin, Lisa.
Agile testing : a practical guide for testers and agile teams /
Lisa Crispin, Janet Gregory. 1st ed.
p. cm.
Includes bibliographical references and index.
ISBN-13: 978-0-321-53446-0 (pbk. : alk. paper)
ISBN-10: 0-321-53446-8 (pbk. : alk. paper) 1. Computer software
Testing. 2. Agile software development. I. Gregory, Janet. II. Title.
QA76.76.T48C75 2009
005.1dc22
2008042444
Copyright 2009 Pearson Education, Inc.
All rights reserved. Printed in the United States of America. This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, electronic, mechanical, photocopying, recording, or likewise. To obtain permission to use material from this work, please submit a written request to Pearson Education, Inc., Permissions Department, 200 Old Tappan Road, Old Tappan, New Jersey 07675, or you may fax your request to (201) 236-3290.
ISBN-13: 978-0-321-53446-0
ISBN-10: 0-321-53446-8
Text printed in the United States on recycled paper at RR Donnelley in Crawfordsville, Indiana.
Eleventh printing, October 2015
Dedication
To my husband, Bob Downingyoure the bees knees!
Lisa
To Jack, Dana, and Susan, and to all the writers in my family.
Janet
And to all our favorite donkeys and dragons.
Lisa and Janet
Index
A
Abbot GUI test tool,
Acceptance tests. See also
definition,
Remote Data Monitoring system example,
UAT (user acceptance testing) compared with,
Ad hoc testing,
Adaptability, skills and,
ADEPT (AS400 Displays for External Prototyping and Testing),
Advance clarity
customers speaking with one voice,
determining story size,
gathering all viewpoints regarding requirements,
overview of,
Advance preparation
downside of,
how much needed,
Agile development
Agile manifesto and,
barriers to. See
team orientation of,
Agile Estimating and Planning (Cohn),
Agile manifesto
people focus,
statement of,
value statements in,
Agile principles. See
Agile testers. See also
agile testing mind-set,
definition,
giving all team members equal weight,
hiring,
what they are,
Agile testing
definition,
as mind-set,
what we mean,
Agile values,
Alceas FIT IssueTrack,
Alpha tests,
ant,
as build tool,
continual builds and,
AnthillPro,
ANTS Profiler Pro,
Apache JMeter. See
API-layer functional test tools,
Fit and FitNesse,
overview of,
testing web Services,
API testing
automating,
overview of,
APIs (application programming interfaces),
Appleton, Brad,
Application under test (AUT),
Applications
integration testing with external applications,
Remote Data Monitoring system example,
Architecture
incremental approach to testing,
layered,
Quadrant 1 tests and,
scalability and,
testable,
AS400 Displays for External Prototyping and Testing (ADEPT),
Assumptions, hidden
agile testers response to,
failure to detect,
questions that uncover,
worst-case scenarios and,
Attitude
agile testing mind-set,
barriers to adopting agile development,
vs. skills,
Audits, compliance with audit requirements,
AUT (application under test),
Authorization, security testing and,
Automated regression testing
key success factors,
release candidates and,
as a safety net,
Automated test lists, test plan alternatives,
Automation
code flux and,
of deployment,
driving development with,
of exploratory testing,
fear of,
feedback from,
freeing people for other work,
of functional test structure,
home-brewed test,
investment required,
learning curve,
legacy code and,
maintainability and,
manual testing vs.,
obstacles to,
old habits and,
overview of,
programmers attitude regarding,
reasons for,
responding to change and,
ROI and,
task cards and,
testability and,
tests as documentation,
Automation strategy
agile coding practices and,
applying one tool at a time,
data generation tools,
database access and,
design and maintenance and,
developing,
identifying tool requirements,
implementing,
iterative approach,
keep it simple,
learning by doing,
managing automated tests,
multi-layered approach to,
organizing test results,
organizing tests,
overview of,
principles,
record/playback tools and,
starting with area of greatest pain,
taking time to do it right,
test automation pyramid,
test categories,
tool selection,
understanding purpose of tests and,
what can be automated,
what might be difficult to automate,
whole team approach,
Automation tools,
API-layer functional test tools,
builds and,
GUI test tools,
overview of,
unit-level test tools,
web services test tool,
B
Bach, James,
Bach, Jonathan,
Back-end testing
behind the GUI,
non-UI testing,
Bamboo,
conflicting or multiple roles,
cultural differences among roles,
lack of training,
lack of understanding of agile concepts,
loss of identity,
overview of,
past experience and attitudes,
Baselines
break-test baseline technique,
performance,
Batch
files,
processing,
scheduling process,
BDD (Behavior-driven development)
easyb tool,
tools for Quadrant 1 tests,
Beck, Kent,
Benander, Mark,
Benchmarking,
Berczuk, Stephen,
Beta testing,