Resources

Our notable partnerships give us access to the best resources and tools for the job.

Get software testing training resources:

Quality, per J.M. Juran, is fitness for use. The presence of attributes and features that  will satisfy customers, users, and other stakeholders, as well as the absence of attributes (e.g., bugs) that will dissatisfy them.


Resources for “Quality”

Articles

Testing is an excellent means to build confidence in the quality of software before it’s deployed in a data center or released to customers. It’s good to have confidence before you turn an application loose on the users, but why wait until the end of the project? The most efficient form of quality assurance is building software the right way, right from the start. What can software testing, software quality, and software engineering professionals do, starting with the first day of the project, to deliver quality applications?

Continue reading →

Quality Software

By Rex Black

I suspect that, in the near future, many types of software will become commoditized, just as many types of computer hardware have. The open-source phenomenon is leading the way, with Linux and Apache ascendant on the Internet. Regardless of the motives of the partisans of open-source software, the motives of the important business users of these open-source applications are clear: They want cheap software with the same quality levels as the commercial alternatives. 

Continue reading →

Testing can be considered an investment. A software organization—whether an in-house IT shop, market-driven shrink-wrap software vendor, or Internet ASP— chooses to forego spending money on new projects or additional features to fund the test team. What’s the return on that investment (ROI)? Cost of quality analysis provides one way to quantify ROI.

Continue reading →

Information appliances, which provide simplified, easy access to specific information such as e-mail and Web sites, promise to bring the benefits of computing to a wide customer base, including some computer-averse people who have hitherto avoided buying a computer. Internet appliances are evolving from personal computers, game stations, digital mobile phones, and server technologies. While this allows us to apply well-known quality assurance techniques, including testing techniques, the software quality professional must remember that the risks to product quality are different; the quality bar is higher, especially in terms of usability, robustness, and harmonizing the appliance with the dynamic Internet. Customers will assess the quality of information appliances by the degree to which the appliance reliably, quickly, transparently, and intuitively provides them with access to the desired information, and we expect them to be much less understanding of glitches than the current PC user. Information appliances are gaining wide acceptance—millions will hit the market in the next few years—so many of us who practice software quality professions will spend time working on projects to develop them. Indeed, we expect that information appliances will present tremendous opportunities to those who seek to bring quality to software in the new millennium. This paper presents the test team’s findings on one such project.

Continue reading →

"Back in 2010, at the launch of Core Magazine, http://www.coremag.eu/, I wrote a series of columns to welcome people to the magazine. As a sort of Throw-Back-December, here they are, as they appeared in the original magazine issues. I hope you enjoy them."
-Rex Black
 
Greetings, and welcome to my quarterly column on software testing best practices.  When I was asked to write this column, I had to choose the approach, the theme.  The writers' aphorism says, "Write what you know." So, what do I know?
 
Well, if you know me and my consulting company, RBCS, you know that we spend time with clients around the world, in every possible industry, helping people improve their testing with training or consulting services, or doing testing for them with our outsourcing services.  Our work gives me insights into what goes on, the actual day-to-day practice of software testing.
 

Continue reading →

Engineering Quality for Bananas

By Rex Black, Daniel Derr, Michael Tyszkiewicz

[How can dumb monkeys built from free tools help you? Give this article a read to see a case study.  Originally published in Software Testing Professional magazine in 2008, these ideas and techniques are still relevant to SDETs, Technical Test Engineers, and Technical Test Analysts looking to build their own automation solutions using open-source components.]

Arrowhead Electronic Healthcare has been creating eDiarys on handheld devices since 1999. Arrowhead helps pharmaceutical research and marketing organizations document important information about how their products are being used in patients’ homes.

ePRO-LOG is Arrowhead’s third generation eDiary product. The primary design goal of ePRO-LOG is to be able to rapidly deploy diaries used for data collection in clinical trails and disease management programs.

A typical diary may include 100 forms translated in 15 or more languages, and used in several locales. This results in a large number of software builds and configurations.  As a result, we needed an automated test tool to address potential risks and to automate common tasks.

The most important quality risks we wanted to address were:

  • Reliability
  • Translation completeness
  • Functionality of UI
  • Input error checking
  • Verification of requirements

We needed an automated test tool with the following capabilities and features:

  • Address defined risks
  • Produce accurate form-flow diagrams
  • Reduce tedium and opportunity for error in manual testing
  • Save effort associated with manual testing for these risks
  • Improve time-to-market by reducing test cycle duration through 24x7 testing
  • Provide auditable documentation
  • Handle any screen flow or translation without custom test scripts (i.e., be trial-independent)
  • Be easy to implement and cost effective

This is a case study in how we reduced our risks and achieved our test automation objectives in just a few months on a total tools outlay of $0.

Continue reading →

What’s New in the ISTQB CTFL 2018 Syllabus?

By Rex Black, interview with iSQI Agustina Gay

The following is a transcript of an interview with Rex Black. Rex is President of RBCS, a worldwide test consulting, training, and expert services company. He is also former President of ISTQB, and most recently served the ISTQB as Project Manager and Technical Editor for the ISTQB® Foundation 2018 syllabus release. The interview was conducted by Agustina Gay. She is a Key Account Manager at iSQI.
Agustina: Rex, thank you for being here. Would you please introduce yourself?
Rex: Yes, I am Rex Black. I am the president of a company called RBCS and we are a training, consulting, and expert services company based in Texas with clients around the world. I’ve been in software engineering since 1983 and RBCS has been around about almost 25 years, since 1994. I’m also the past president of the ISTQB, from 2005 to 2009, and most recently I was involved on the Foundation project. So I have many years involvement with the ISTQB program.
 

Continue reading →

Webinars

Podcast Episodes

Why Does Software Quality (Still) Suck


Length: 1h 49m 0s

Software quality, for the most part, sucks. It still sucks, seventy-five years since the advent of the programmable computer. Software bugs are a constant fact of life, thanks to the ubiquity of software and the ubiquity of software bugs. Sometimes the bugs costs millions of dollars or kill people. Why is the reaction so muted? Rather than just accept software bugs as unavoidable, let’s ask the obvious question: Given that manufacturing is able to achieve six sigma levels of quality—i.e., only three defective items per million manufactured—why does software quality still suck? In this webinar, Rex will address some of the real barriers to achieving six sigma quality in software, while at the same time holding software engineering as a profession accountable for not doing nearly as much as we can.

Listen now →

Let’s suppose you bought a car. Six days later, someone from the dealership let himself into your garage, removed the tires on the car, installed some “updated” tires that actually had holes in them, and then left. In the morning, your car was there in the garage, all sad and undriveable on its flat, flabby tires. That’s clearly unacceptable, in fact even criminal, but we allow the same thing to happen all the time with software. Why? In this webinar, Rex will catalog infamous automated software updates, released without sufficient testing to wreak havoc, or at least inconvenience. He’ll then give a detailed roadmap for reducing your chances of being part of the problem.

Listen now →

Some people use the terms “verification” and “validation” interchangeably, but there are significant differences between them. Some people disparage verification, or deny that it’s even involved in testing. However, you can’t adequately build confidence and reduce risk in the software you test without using the proper mix of both. In this webinar, Rex will clarify the meaning of these two terms, give examples, and explain why both are essential to proper software testing.

Listen now →

Webinar: Two Bug Metrics, Millions in Process Improvement


Length: 1h 20m 50s

When we do assessments, we always try to look at process metrics. In most cases, we can find millions of dollars in process improvement opportunities. In this webinar, Rex will show you how two very simple bug metrics, calculated using only two simple facts for each bug report using simple, free spreadsheets you can get from our website, can reveal millions and millions of dollars in potential process improvements. All the more reason to track those bugs! To paraphrase Timothy Leary: Tune in, download, and drop software co

Listen now →

Shift Left and Friends


Length: 1h 0m 28s

Shift left. Continuous integration and continuous delivery (CI/CD). Continuous deployment. DevOps. What is all this stuff and what does it mean for you as the tester? In this keynote, Rex Black will explain these concepts and their test implications.  He’ll then describe the emerging role of the SDET (Software Development Engineering in Test, also called SET) and what SDETs do.  Yes, being an SDET is about test automation, but it’s about a lot more than that, and Rex will give you some examples of things you can expect to do as an SDET in a shift left world over the coming decade.  Don’t worry. Life as a tester in the SDET reality is gonna be fun and exciting, and Rex will give you some ideas how.

Listen now →

One Key Idea: Test Automation ROI


Length: 0h 18m 11s

Test automation is all the rage.  Spinning away in Agile lifecycles or playing key roles in DevOps pipelines, automation is supposed to be everywhere, right? However, such widespread automation is a big investment. If you want to obtain management approval for the kind of automation investments all the webinar and conference talking heads are saying you simply must do right now, you better be able to talk automation ROI. In this One Key Idea session, Rex will explain the measurable business benefits of test automation and how to calculate automation ROI.  In twenty minutes or less, you’ll learn how to bridge the gap between automation techno-speak and the managerial bottom-line focus.

Listen now →

For nearly ten years, RBCS has run a highly successful free webinar series.  In 2018, we’re adding the Two Points of View at Two series to our monthly webinar rotation. In each of these sessions, Rex Black will talk with another software luminary about topics of mutual interest, where the two have some different views, and then Rex opens the floor to questions. 

In this inaugural session, Rex is happy to welcome Maaret Pyhäjärvi .  Maaret’s bio describes her as feedback fairy with a day job at F-Secure, where they call her a Lead Quality Engineer. She identifies as empirical technologist, tester and programmer, catalyst for improvement, author and speaker, and community facilitator and conference organizer. You can catch her latest thoughts on her blog at http://visible-quality.blogspot.fi

In this session, Rex and Maaret will discuss tester-developer collaboration and the relationships between testers and developers.  How to approach developers for collaboration? How do testers-developers ratios affect relationships? What about people who move between tester and developer roles? Join Rex and Maaret to hear their thoughts and ask your questions.

Listen now →

One Key Idea: Two Simple, Useful Defect Metrics


Length: 0h 30m 44s

Technical debt is bad.  It’s smart to carefully manage technical debt. Defects are a form of technical debt.  Do you know how to measure how well you are managing defect-related technical debt? In this One Key Idea session, Rex will demonstrate two simple defect metrics, easily extractable from any defect management tool, which can give you useful insights into what’s happening with defect-related technical debt.  In twenty minutes or less, you’ll learn what these metrics can tell you and how you can use them to manage your technical debt better.

Listen now →

Hiring and managing distributed, international test teams

Phil Lew, President of XBOSoft, an international software testing firm, joins Rex Black to discuss the critical topics of hiring and managing teams of testers who work around the world.  How do distance, culture, and language create challenges, and how have Phil and Rex dealt with those challenges in the past?  You won’t want to miss Phil and Rex’s points of view on these important topics.

Listen now →

The Agile Testing Pyramid is a great metaphor, and it can be very useful when applied properly. However, it can also lead to some serious dysfunctions in organizations that misunderstand, misapply, or misinterpret it.  Are you using the Agile Testing Pyramid properly? Rex will help you answer that question, and help you resolve problems if they exist.  In twenty minutes or less, you’ll learn the rights and wrongs of the Agile Testing Pyramid.

Listen now →

One Key Idea: The ISTQB Foundation 2018 Syllabus


Length: 0h 21m 58s

As a bonus to our June complimentary webinar, this month we shared with you an interview with Rex about the newly released ISTQB Certified Tester Foundation Level  2018 Syllabus. Listen to the session and you will learn why the changes were made, what was the process for making the changes and, finally, what are the changes!

Listen now →

In this month’s “Two Points of View at Two” session, Rex is happy to welcome Nivia S. Henry. Nivia fundamentally believes that happy people, working in a healthy environment, will do great things. This philosophy has driven her to build a 15+ year career creating and supporting high-performing teams. Her career path has included agile coaching, enterprise agile transformations, product management, and people leadership. Today, Nivia applies her hard-earned experience as an Quality and Web Engineering Manager at Spotify. In this session, she'll discuss Spotify's perspective on Quality and focus on how the organization has organically grown its test automation practice.

Listen now →

One Key Idea: Understanding the ISTQB Career Path


Length: 0h 31m 57s

The ISTQB provides extensive support for the test professional’s career path. There are so many options, in fact, that some people get confused and have questions.  Well, in this One Key Idea session, Rex is here to make the career path clear and answer your questions.  In twenty minutes or less, you’ll understand how the ISTQB career path can support your progress throughout your professional testing life.

Listen now →

Two Case Studies in Non-GUI Test Automation


Length: 0h 56m 31s

All too often, people believe that they have to run all their system tests through the GUI, and that includes automated tests.  However, it is possible to run automated system tests through a variety of interfaces, such as command lines, APIs, data layers, network services, and more. In this webinar, Rex will give two such examples of sophisticated automated system test platforms capable of quickly running thousands of tests with very low false positive rates, flaky test rates, and test maintenance rates. One tested a data layer interface, the other a network services interface.  Each used a flexible and maintainable keyword driven architecture.  Come ready to open your mind to new ways of automating system testing, and leave with ideas you can apply to automating your tests away from the GUI.

Listen now →

Training

ISTQB Virtual Advanced Security Tester Boot Camp

The Advanced Security Tester Boot Camp course, created by Rex Black, past President of the International Software Testing Qualifications Board (ISTQB), past President of the American Software Testing Qualifications Board (ASTQB) and co-author of a number of International Software Testing Qualifications Board syllabi, is ideal for testers and test teams preparing for certification in a short timeframe with time and money constraints.

View details →

ISTQB Virtual Advanced Test Automation Engineer Boot Camp

The Advanced Test Automation Engineer Boot Camp, created by Rex Black, past President of the International Software Testing Qualifications Board (ISTQB), past President of the American Software Testing Qualifications Board (ASTQB) and co-author of a number of International Software Testing Qualifications Board syllabi, is ideal for testers and test teams preparing for certification in a short timeframe with time and money constraints.

View details →

Black-box Bug-a-thon

If you are looking to spend one day learning powerful test techniques in a hands-on way using real apps, and having fun while doing so in a friendly yet competitive setting, this black-box bug-a-thon is for you.

View details →


Copyright ® 2018 Rex Black Consulting Services.
All Rights Reserved.
ISTQB Logo ASTQB Logo IREB Logo PMI Logo ISTQB Logo
PMI is a registered mark of the Project Management Institute, Inc.