CAST Vancouver, BC: Coming Soon

I’m looking forward to attending CAST next month in Vancouver, BC, which will be my first time at this particular conference. I’ve heard lots of good things from past attendees, and I look forward to what seems like a very practical lineup of folks talking bout real-world testing issues in an interactive environment.

I’ll be arriving on Sunday and attending James Bach and Fiona Charles’ tutorials on Monday.

I may try to organize some sort of Sunday evening gathering for craft beer lovers – keep an eye on Twitter.

Why I’ll Be Back at STARWEST

I’ll be returning to Anaheim next month to attend STARWEST1. I’ve been a couple times previously and have generally found it to be a useful, fun experience.

In looking at this year’s program, several topics/speakers stand out. I’ve found great value in the half- and full-day tutorials. One thing I like about STARWEST is that during the “regular” conference talks there are five or six tracks being offered, which generally means there will be something of value in each time slot.

Beyond the program (and this really applies to all conferences, not just this one) is the other key value in these events: the informal networking and conversations. Whether it’s over lunch at the event, in the hallway between sessions, or in the evening at a bar, I’ve made some great connections with folks from around the country who share similar (or dissimilar) testing experiences.

Nighttime at DCA

Looking towards Paradise Pier at Disneys California Adventure

Also: it doesn’t hurt that I’m a Disneyland fan.

Will you be at STARWEST? Let’s connect.

  1. I have no idea why STARWEST is in all capital letters. But it is. 

Coming Soon to a #Starwest Near You

Last year was my first time at Starwest, a conference for testers held in Anaheim.

Monorail Orange

As a famous Californaustrian once said, I’ll be back.

I’ll be in Anaheim from the 11th through the 16th, taking workshops from Michael Bolton, Rob Sabourin, and Bob Galin, followed by the main conference.

If you’ll be there, let’s connect!

Unrelated to Starwest, I’m leading a photowalk the evening of the 11th. Hit that link to find out more or register.

Testing Like an Airline Pilot with James Bach at STARWest

Yesterday James Bach presented one of the day-long tutorials preceding the STARWest conference. I tweeted a bunch during his talk, but I also wanted to revisit my notes and identify some key points and thoughts. And because I’m all generous and shit, I’m sharing that here 🙂

Critical Thinking for Software Testers

The talk was about critical thinking as a tester. The natural opening to the talk was identifying what is meant by testing and being a tester.

What is Testing (vs. Checking)?

Checking is the process of noting whether something worked exactly as expected off of a checklist of repeatable procedures. This is where most so-called “automated testing” falls… it’s not really testing… it’s checking that the software behaved as expected based on a pre-written list of specific expectations.

Testing is the broader process and cannot be simply reduced to a set of instructions. Testing requires a human brain to analyze things and make decisions on the fly, reacting and adapting. In this respect, testing is much like being a doctor, lawyer, or airline pilot… while there are parts of these professions that require following a checklist for the expected scenario, it’s also required that a professional have the ability to think on their feet, adapting to the unexpected.

Testers are agents for the user

Basic testing is straightforward and uses reflex thinking – faster and looser. Excellent testing requires slower, surer thinking. Excellent testing involves a difficult social and psychological process in addition to the technical aspect. It requires mixing technical observation with context in order to understand what’s important.


A signfiicant portion of the afternoon discussed modeling and observation; models are fundamental to critical thinking. The ones and zeros of a software program do not exist on their own. The application and elements within the application usually model other things.

What you see is not all there is.

Models link observation and inference… and a good tester must be able to distinguish the two.

Test Cases and Observations

If someone asks how many test cases are needed to test a program or function, well, that’s a really crappy question that will lead to a meaningless answer. A better question would be how will you test this? The number of test cases doesn’t mean much… much like we don’t measure program complexity or productivity by lines of code, we shouldn’t much care about the number of test cases.

Documents and statements are stories, not reality

Huh? Really? So?

Three easy questions when testing.

Huh? – gets at the meaning… implies that you may not understand what’s really going on

Really? – gets at the facts… perhaps what you understand may not be true

So? – gets at the risks… the truth may not matter, or it may matter more than you think

The overall theme of the day fit in line with Bach’s philosophies on context-driven and exploratory testing and analysis. Check out Lessons Learned in Software Testing: A Context-Driven Approach for more.