3582296416

3582296416



3 Method

3.1    Metrics used in evaluation

lt łs ahvays a daunting task to discuss measunng of quality. In order to do so. we need to establish some definitions as well as some metrics. We have found inspiration for doing this in [Pfaller 2008].

3.1.1    What are we comparing

The object of measurement is in this case the test suites that have been generated from the two different approaches.

3.1.2    Relative quality

As this is a comparison of two approaches to test case generation against a very smali specification and therefore also a very smali unit of production codę it should be noted that the quality we measure here is by naturę onfy relat)ve. Against other kind of production codę or other specifications results may be different.

3.1.3    Defects detected

The ability to detect defects in the production codę is of course the most important property of a test suitę.

3.1.4    Time spent on test case generation

This metric is concerned with the time that is spent with the test case creation. In the case of the traditional approach this includes the equivalence class partitiomng. boundary value analysts and the writing of the concrete test cases.

In case of the automatic test case generation tool we decided not to measure time to learn usmg the tool as mastering the EQ+BV analysis also has a leaming curve.

The time metric is not directly related to the quality of the test cases but it is needed to evaluate the two methods against each other.


Wyszukiwarka

Podobne podstrony:
Dysorvequation method (which 1$ used in quantum field theory) have been analyzed (107). The existenc
3 7 16 Othertactics used in negotiations : lt is used when one of the party is less dependant on tim
[DPG] Page0 Here is some information on the eyes that are often used in animation and manga It is m
GSM BASICS GSM HISTORY: In 1982 the Nordic PTTs sent a proposal to CEPT (Conference of European Post
MSc IN MECHANICAL ENGINEERING specialization: International Design Engir to beobtained Master of
74085 IMGx56 284 The Origin of Civilisation In theory, there musi be sonę limit to the number of ris
page12 (9) A different alr cleaner is now installed in the 2 seater models. It is mounted to the rig
IMGx56 284 The Origin of Civilisation In theory, there musi be sonę limit to the number of rises tha
i * i * signs. or complexes of symptoms and signs. The “diagnoses** of the screening method use
Skan es and PattensRecording methods, archive and conventions used in the report As soon as the eno
Dydaktyka 3 It was called Classical Method sińce it was first used in the teaching of the classical
- Editorial----Epilogue at Stony Brook: The Year in Controversy łt a coming. And it a błg. Finala we
shoes&pattens7 Recording methods, archive and conyentions used in the report J As soon as the enorm

więcej podobnych podstron