G AME T ESTING
LICENSE, DISCLAIMER OF LIABILITY, AND LIMITED WARRANTY
By purchasing or using this book (the Work), you agree that this license grants permission to use the contents contained herein, but does not give you the right of ownership to any of the textual content in the book or ownership to any of the information or products contained in it. This license does not permit uploading of the Work onto the Internet or on a network (of any kind) without the written consent of the Publisher. Duplication or dissemination of any text, code, simulations, images, etc. contained herein is limited to and subject to licensing terms for the respective products, and permission must be obtained from the Publisher or the owner of the content, etc., in order to reproduce or network any portion of the textual material (in any media) that is contained in the Work.
M ERCURY L EARNING AND I NFORMATION (MLI or the Publisher) and anyone involved in the creation, writing, or production of the companion disc, accompanying algorithms, code, or computer programs (the software), and any accompanying Web site or software of the Work, cannot and do not warrant the performance or results that might be obtained by using the contents of the Work. The author, developers, and the Publisher have used their best efforts to insure the accuracy and functionality of the textual material and/or programs contained in this package; we, however, make no warranty of any kind, express or implied, regarding the performance of these contents or programs. The Work is sold as is without warranty (except for defective materials used in manufacturing the book or due to faulty workmanship).
The author, developers, and the publisher of any accompanying content, and anyone involved in the composition, production, and manufacturing of this work will not be liable for damages of any kind arising out of the use of (or the inability to use) the algorithms, source code, computer programs, or textual material contained in this publication. This includes, but is not limited to, loss of revenue or profit, or other incidental, physical, or consequential damages arising out of the use of this Work.
The sole remedy in the event of a claim of any kind is expressly limited to replacement of the book, and only at the discretion of the Publisher. The use of implied warranty and certain exclusions vary from state to state, and might not apply to the purchaser of this product.
G AME T ESTING
All In One
Second Edition
Charles P. Schultz
Robert D. Bryant
M ERCURY L EARNING AND I NFORMATION
Dulles, Virginia
Boston, Massachusetts
Copyright 2012 by M ERCURY L EARNING AND I NFORMATION . All rights reserved.
This publication, portions of it, or any accompanying software may not be reproduced in any way, stored in a retrieval system of any type, or transmitted by any means, media, electronic display or mechanical display, including, but not limited to, photocopy, recording, Internet postings, orscanning, without prior permission in writing from the publisher.
Publisher: David Pallai
M ERCURY L EARNING AND I NFORMATION
22841 Quicksilver Drive
Dulles, VA 20166
info@merclearning.com
www.merclearning.com
1-800-758-3756
This book is printed on acid-free paper.
Charles P. Schultz and Robert D. Bryant. Game Testing : All In One , Second Edition .
ISBN: 978-1-9364201-6-2
The publisher recognizes and respects all marks used by companies, manufacturers, and developers as a means to distinguish their products. All brand names and product names mentioned in this book are trademarks or service marks of their respective companies. Any omission or misuse (of any kind) of service marks or trademarks, etc. is not an attempt to infringe on the property of others.
Library of Congress Control Number: 2011932024
111213321
Printed in Canada
Our titles are available for adoption, license, or bulk purchase by institutions, corporations, etc. For additional information, please contact the Customer Service Dept. at 1-800-758-3756 (toll free).
The sole obligation of M ERCURY L EARNING AND I NFORMATION to the purchaser is to replace the disc, based on defective materials or faulty workmanship, but not based on the operation or functionality of the product.
Dont Panic
Unfamiliar
Unprepared
Under Pressure
Unrested
Pre-Test
Post-Test
Nearsighted
Trust No One
Balancing Act
Word Games
Last Chance
Trust Fund
Give And Take
The Rest Of The Story
Summary
Exercises
Playing Games
Identifying Bugs
Here Comes the Judge
Judger Defined
Perceiver Defined
Amplifying Problems
Early Bird
Places Everyone
Notifying the Team
Describe
Pick a Type
Prioritize
Be Helpful
Pass or Fail?
Testify to Others
Verify the Fix
Summary
Exercises
Who Cares?
Defect Typing
Functions
Assignments
Checking
Timing
Build/Package/Merge
Algorithms
Documentation
Interfaces
Summary
Exercises
Game Quality Factors
Game Quality Appraisal
Walkthroughs
Reviews
Checklist-Based Reviews
Inspections
Game Standards
User Interface Standards
Coding Standards
Game Quality Measurements
Six Sigma Software
Phase Containment
Quality Plans
QA Personnel
Standards
Reviews and Audits
Feedback and Reports
Problem Reporting and Corrective Action
Tools, Techniques, and Methods
Supplier Control
Training
Risk Management
Summary
Exercises
Pre-Production
Planning Tasks
Determine the Scope of Testing the Project Will Require
Assign a Lead Tester
Determine Phase Acceptance Criteria
Participate in Game Design Reviews
Set Up the Defect Tracking Database
Draft Test Plans and Design Tests
Testing Before Testing Begins
Test Kickoffs
Alpha Testing
Alpha Phase Entry Criteria
Beta Testing
Beta Phase Entry Criteria
Design Lock
Letting Bugs Go
Gold Testing
Last-Minute Defects
Release Certification
Post-Release Testing
Summary
Exercises
Black Box Testing
White Box Testing
The Life Cycle of a Build
Test Cases and Test Suites
Entry Criteria
Configuration Preparation
Smoke Testing
Regression Testing
Testing Around a Bug
On Writing Bugs Well
Just the Facts, Maam
Brief Description
Full Description
Great Expectations
Habits to Avoid
Summary
Exercises
Testing Progress
Testing Effectiveness
Tester Performance
Summary
Exercises
Parameters
Values
Defaults
Enumerations
Ranges
Boundaries
Constructing Tables
Combinatorial Templates
Combinatorial Test Generation
Combinatorial Economics
Summary
Exercises
TFD Elements
Flows
Events
Actions
States
Primitives
Terminators
TFD Design Activities
Preparation
Allocation
Construction
A TFD Example
Data Dictionary
Data Dictionary Application
Data Dictionary Reuse
Data Dictionary Example
TFD Paths
Minimum Path Generation
Baseline Path Method
Expert Constructed Paths
Combining Path Strategies
Producing Test Cases From Paths
TFD Templates
To TFD or Not to TFD?
Summary
Exercises
Usage Probabilities