Concept: Test Automation and Tools








var backPath = './../../../';
var imgPath = './../../../images/';
var nodeInfo=[{view: "view:_LVCagP5WEdmAzesbYywanQ", path: ["_LVCagP5WEdmAzesbYywanQ", "_mp7z0DIDEdqwaNnSEheSAg", "_1yMJAN7YEdmjRZts2c4ZjQ", "{8728060F-9DAD-42AD-B0B6-668C9AEA531D}", "1.2428425240885136E-304"]}, {view: "view:_LVCagP5WEdmAzesbYywanQ", path: ["_LVCagP5WEdmAzesbYywanQ", "_mp7z0DIDEdqwaNnSEheSAg", "_1yMJAN7YEdmjRZts2c4ZjQ", "{84F723B5-288F-4AC4-B6C1-C75A07BFEEED}", "1.2428425240885136E-304"]}, {view: "view:_LVCagP5WEdmAzesbYywanQ", path: ["_LVCagP5WEdmAzesbYywanQ", "_mp7z0DIDEdqwaNnSEheSAg", "_u2yEADIEEdqwaNnSEheSAg", "_yd3EzdnmEdmO6L4XMImrsA", "1.2428425240885136E-304"]}, {view: "view:_FCx1oN7CEdmsEI4YDGX2ag", path: ["_FCx1oN7CEdmsEI4YDGX2ag", "_f6_YwN7DEdmsEI4YDGX2ag", "_1yMJAN7YEdmjRZts2c4ZjQ", "{8728060F-9DAD-42AD-B0B6-668C9AEA531D}", "1.2428425240885136E-304"]}, {view: "view:_FCx1oN7CEdmsEI4YDGX2ag", path: ["_FCx1oN7CEdmsEI4YDGX2ag", "_f6_YwN7DEdmsEI4YDGX2ag", "_1yMJAN7YEdmjRZts2c4ZjQ", "{84F723B5-288F-4AC4-B6C1-C75A07BFEEED}", "1.2428425240885136E-304"]}, {view: "view:_FCx1oN7CEdmsEI4YDGX2ag", path: ["_FCx1oN7CEdmsEI4YDGX2ag", "_kC0pcN7GEdm8G6yT7-Wdqw", "_yd3EzdnmEdmO6L4XMImrsA", "1.2428425240885136E-304"]}, {view: "view:_FCx1oN7CEdmsEI4YDGX2ag", path: ["_FCx1oN7CEdmsEI4YDGX2ag", "_jD8dUAIbEdqEutyfYo0quQ", "_vzRNgDIcEdqDs_9ORT1Rig", "1.2428425240885136E-304"]}];
contentPage.preload(imgPath, backPath, nodeInfo, '', false, false, false);










Concept: Test Automation and Tools















This guideline discusses the types of tools that can be used to improve the efficiency of testing.






Relationships



Related Elements


Improve Test Assets


Improve Test Assets


Test


Test Analyst


Test and Evaluate


Test and Evaluate


Test Designer


Validate Build Stability


Validate Build Stability


Verify Test Approach


Verify Test Approach






Main Description



Test automation tools are increasingly being brought to the market to automate Test tasks. A number of automation tools exist, but it's unlikely that a single tool is capable of automating all test tasks. Most tools focus on a specific task or group of tasks, whereas some only address one aspect of a task. When evaluating different tools for test automation, it's important to be aware of the type of tool you are evaluating, the limitations of the tool, and what tasks the tool addresses and automates. Test tools are often evaluated and acquired based on these categories: Function White-box vs. Black-box Specialization Function Test tools may be categorized by the functions they perform. Typical function designations for tools include: Data acquisition tools that acquire data to be used in the test tasks. The data may be acquired through conversion, extraction, transformation, or capture of existing data, or through generating use cases or supplemental specifications. Static measurement tools that analyze information contained in the design models, source code, or other fixed sources. The analysis yields information on the logic flow, data flow, or quality metrics such as complexity, maintainability, or lines of code. Dynamic measurement tools that perform an analysis during the execution of the code. The measurements include the run-time operation of the code such as memory, error detection, and performance. Simulators or drivers that perform tasks, which for reasons of timing, expense, or safety are not available for testing purposes. Test management tools that assist in planning, designing, implementing, executing, evaluating, and managing the test tasks or work products. White-box vs. Black-box Test tools are often characterized as either white-box or black-box based upon the manner in which tools are used, or the technology and knowledge needed to use the tools. White-box tools rely upon knowledge of the code, design models, or other source material to implement and execute the tests. Black-box tools rely only upon the use cases or functional description of the target-of-test. Whereas white-box tools have knowledge of how the target-of-test processes the request, black-box tools rely upon the input and output conditions to evaluate the test. Specialization In addition to the broad classifications of tools previously presented, tools may also be classified by specialization. Record and Playback tools combine data acquisition with dynamic measurement. Test data is acquired during the recording of events (known as test implementation). Later, during test execution, the data is used to playback the test script, which is used to evaluate the execution of the target-of-test. Quality metrics tools are static measurement tools that perform a static analysis of the design models or source code to establish a set of parameters that describe the target-of-test's quality. The parameters may indicate reliability, complexity, maintainability, or other measures of quality. Coverage monitoring tools indicate the completeness of testing by identifying how much of the target-of-test was covered, in some dimension, during testing. Typical classes of coverage include use cases (requirements-based), logic branch or node (code-based), data state, and function points. Test case generators automate the generation of test data. Test case generators use either a formal specification of the target-of-test's data inputs, or the design models and source code to produce test data that tests the nominal inputs, error inputs, and limit and boundary cases. Comparator tools compare test results with reference results and identify differences. Comparators differ in their specificity to particular data formats. For example, comparators may be pixel-based to compare bitmap images or object-based to compare object properties or data. Data extractors provide inputs for test cases from existing sources, including databases, data streams in a communication system, reports, or design models and source code.





©  Copyright IBM Corp. 1987, 2006.  All Rights Reserved.







contentPage.onload();