Evaluating exit criteria and reporting

04 Jun

Evaluating exit criteria is the activity where test execution is assessed against the defined objectives. This should be done for each test level, as for each we need to know whether we have done enough testing. Based on our risk assessment, we’ll have set criteria against which we’ll measure ‘enough’. These criteria vary for each project and are known as exit criteria. They tell us whether we can declare a given testing activity or level complete. We may have a mix of coverage or completion criteria (which tell us about test cases that must be included, e.g. ‘the driving test must include an emergency stop’ or ‘the software test must include a response measurement’), acceptance criteria (which tell us how we know whether the software has passed or failed overall, e.g. ‘only pass the driver if they have completed the emergency stop correctly’ or ‘only pass the software for release if it meets the priority 1 requirements list’) and process exit criteria (which tell us whether we have completed all the tasks we need to do, e.g. ‘the examiner/tester has not finished until they have written and filed the end of test report’). Exit criteria should be set and evaluated for each test level. Evaluating exit criteria has the following major tasks:

• Check test logs against the exit criteria specified in test planning: We look to see what evidence we have for which tests have been executed and checked, and what defects have been raised, fixed, confirmation tested, or are outstanding.

• Assess if more tests are needed or if the exit criteria specified should be changed: We may need to run more tests if we have not run all the tests we designed, or if we realize we have not reached the coverage we expected, or if the risks have increased for the project. We may need to change the exit criteria to lower them, if the business and project risks rise in importance and the product or technical risks drop in importance. Note that this is not easy to do and must be agreed with stakeholders. The test management tools and test coverage tools that we’ll discuss in Chapter 6 help us with this assessment.

• Write a test summary report for stakeholders: It is not enough that the testers know the outcome of the test. All the stakeholders need to know what testing has been done and the outcome of the testing, in order to make informed decisions about the software.

Tags: , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , ,

11 responses to “Evaluating exit criteria and reporting

  1. Le Galik

    June 23, 2012 at 12:15 PM

    Nice. How many animals do they have at the market right now?

  2. Octavio Amelung

    June 23, 2012 at 10:07 PM

    This is a great initiative and will surely help the SHM and a great company flourish further you’ve got our vote!

  3. Ashlyn Otwell

    June 25, 2012 at 4:21 AM

    Great post. I will be facing some of these issues as well..

  4. Kiyoko Dysart

    June 26, 2012 at 2:51 PM

    I blog quite often and I genuinely thank you for your content. Your article has truly peaked my interest. I will bookmark your website and keep checking for new details about once per week. I subscribed to your Feed as well.

  5. cialis

    June 26, 2012 at 5:54 PM

    Aw, this was a very nice post. In thought I would like to put in writing like this moreover – taking time and actual effort to make a very good article… however what can I say… I procrastinate alot and by no means seem to get one thing done.

  6. site map

    June 27, 2012 at 3:20 AM

    StayAt Hotel Apartments is just what it sounds like – spacious apartments with fully equipped kitchenettes for people travelling in business or pleasure or both.

  7. cialis

    June 27, 2012 at 3:10 PM

    Thanks for some other wonderful article. Where else may anybody get that kind of info in such a perfect way of writing? I have a presentation next week, and I’m at the search for such info.

  8. cialis

    June 27, 2012 at 6:11 PM

    Magnificent beat ! I would like to apprentice even as you amend your website, how can i subscribe for a blog website? The account aided me a applicable deal. I have been a little bit familiar of this your broadcast provided bright transparent idea

  9. cialis

    June 27, 2012 at 7:14 PM

    very nice post, i certainly love this website, keep on it

  10. Simon Ripp

    June 29, 2012 at 4:31 AM

    very nice post, i certainly love this website, keep on it

  11. Translator Job Online

    June 29, 2012 at 5:01 AM

    Appreciating the persistence you put into your site and in depth information you provide. It’s awesome to come across a blog every once in a while that isn’t the same outdated rehashed information. Excellent read! I’ve bookmarked your site and I’m including your RSS feeds to my Google account.


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: