I was once lucky enough to have been chosen to keynote at the 2008 STAR West conference. As often happens when I do testing talks, I got an epiphany the night before – an anchoring idea to frame my talk and make it more memorable.
The conference was at the Disneyland Hotel. They have their own series of TV channels there, one of which is the Fireworks Music Channel (channel 47 if you stay at the hotel). I noticed this when flipping around the channels trying to find one of the many Disney stations so that my 2-year-old daughter Charlotte could get in some Mickey Mouse time before she met him in person.
I happened upon channel 47, which was a static image of the Magic Kingdom with a black background, with Disney soundtrack music playing softly. That was it. All day, all night, music playing softly with an image of the Magic Kingdom – perhaps for weary parents or children who need to wind down from being over-stimulated by rides and sugar.
Handy to know, but we had just arrived, so little Charlotte was ready to wind up, not wind down.
We found a channel with the Mickey Mouse Club and she was happy.
The next morning, Sunday morning, was quiet, and with Charlotte still asleep in the bed next to mine with my wife, I wanted to start my day quietly – no news, no Mickey Mouse Club, just quiet music. I remembered Channel 47.
I flipped to it and saw this:
Nice! Finding bugs is my business, but sometimes they find *me*.
I took a picture of the error to use in a testing class one day.
The next day, I was flipping through the channels, and saw this:
The story had unfolded a bit – two error dialogs which appear to say the same thing: “unintelligble path” is not a valid win32 application” and I noticed the menu bar at the bottom with the system tray. It was PowerPoint that was failing.
The next day:
That’s right… 3 error dialogs. One per day? Clearly, no one at the hotel is looking at this.
The next day was my keynote, titled “Telling Your Exploratory Story” and I knew I had my hook – a way to anchor my talk about how to describe the flow of thinking when there’s no test script to follow. I would use this as an example that sometimes details slowly reveal themselves, and it’s the thinking about the new, emerging context (and how you react to it) that really underscores the art and craft of exploratory testing – telling your story of the dynamic things that happened in your testing and what you did about it.
Thinking that it was a date-driven bug – perhaps midnight being the trigger – I checked channel 47 one more time before going to bed just after midnight on Day 4.
I saw this:
Cool. Four dialogs, four days.
The day of my keynote, I told the front desk. After some trouble explaining that it was not my TV or my laptop, (and no, a technician does not need to be sent to my room) I felt that I had done my civic duty as a tester – reporting a problem in such a way that it had a likelihood of getting fixed.
I added the pictures to my keynote slides and kicked off my talk with them, saying that sometimes a bug story unfolds without us having to do anything but collect context. It enhanced my talk, I think – got some good laughs and made my point.
A good keynote sets the tone for the conference – grounds the attendees to a meaningful social meme. And sure enough, for the rest of the week, I had evidence that my talk did exactly that. People came up to me the next day and asked me what was happening with Channel 47. I told them it was fixed because I did not see any dialogs that next day.
But someone came up to me the day after that and said they saw the error return. I checked and confirmed it. One error dialog. But later that evening, well before midnight, there were two dialogs, blowing my theory that midnight was the driving event.
I mentioned this at a separate talk I was doing the next day. Someone in the audience pointed out there is also a Disney site in Florida, not just California, and if the channel was hosted at Disney World in Orlando, it would be three hours ahead, meaning that it still could be driven by midnight!
But it was the final day of the conference that was the critical incident for me. I was in the front row ofRob Sabourin‘s talk titled “Toward an Exploratory Testing Culture.” He talked about ways testers could find things in common like how to add value to a project, how to be a bug advocate, how to represent their work in credible ways. He invited discussion from the audience of about 250 people. And then it hit me. I had a two-word comment that to me, was an iconic example of an exploratory testing culture – something that grounded us that week, bonded the attendees into a common story, that got people out of their boxes and shells and compartments for just a little while to think about one common, curious, critical problem.
“What’s going on with Channel 47 today, Jon?”
“I didn’t see the error today, Jon. Did you?”
“I can’t get Channel 47 at all here at the hotel, I called the front desk to see what the deal was.”
“What do you think the invalid win32 application is, Jon?”
“I saw something similar in the hotel elevator – it appeared to be a digital test pattern underneath the floor indicator.”
“I like that theory that the server is based in Florida.”
“Why do you think the title bar doesn’t show until day two of the problem?”
It was these comments that made me feel connected to everyone else at the conference. I was the just vehicle for the culture, which, like the bugs that exist in the software that’s delivered to us, was already there, waiting to be discovered.