Testing

FAQ What's New

Table of Contents [show]     1 Whitebox vs blackbox testing     2 What is a triage meeting?     3 Testing Tools       3.1 STAF       3.2 TestNG       3.3 Purify     4 Code Coverage     5 GUI Testing     6 API Testing     7 Links Keywords SilkTest, Squish Copyright Information This article is licensed under GNU Public License. Contact webmasters for more information on copyright issues. 1 Whitebox vs blackbox testing Whitebox testing tests a program against what the soure code intends to do, while blackbox testing tests a program against its spec. Blackbox testing doesn't care about how a program is implemented, it only cares about if the program does what it's intended to do. [BS]. 2 What is a triage meeting? Triage is originally a medical term. During a triage process, patients are separated into three groups: those who will die anyway, those who will recover anyway, and those who will recover if aided. Apparently doctors should focus on the third group. Similarly, in software testing, there is a similar triage meeting that separate all bugs into three groups. Triage is pronounced as tri(ple)(gar)'age, with tri- pronouced as in triple, and -age pronounced as in garage. 3 Testing Tools 3.1 STAF Error registering with STAF, RC: 21? This usually means you were not able to submit the staf command. Check to make sure you have a local (yes, local) staf service running. How do I view STAF logs? STAF logs are located in $%STAF_HOME%\data\STAF\service\log\machine\youmachinename\Global\servicename.log You could either use FmtLog.exe command to format it, or use staf local log to view it 27:Error constructing service, JSTAF, Result: Unable to connect to JVM Error reading config file If you check your logs files at data\STAF\lang\java\jvm\STAFJVM.1, and if you see something like "java.lang.NoClassDefFoundError: com/ibm/staf/service/STAFServiceHelper", then make sure you have bin\JSTAF.jar in your classpath. Try set CLASSPATH \STAF\bin\JSTAF....[more] 3.2 TestNG TestNG is a java testing framework, where NG stands for Next-Generation. ...[more] 3.3 Purify Purify complains "No reloc section found" By default, compiler builds DLLs loadable to arbitrary base address, while everything else with fixed base address through load parameter. In other words, if you don't set -fixed:no, then your exe file can only be loaded to their preferred base addresses. By setting this option, compiler builds everything with arbitrary base address. This is required by Purify to instrument your EXE files. Purify complains "Some dlls are incremental, purify doesn't work with applications with incremental option enabled" Add -incremental:no to your linker options. My option changes doesn't see to work Run a make clean before make. Some times cc may think you binaries are already uptodate and refuse to recompile with your ne...[more] 4 Code Coverage Code coverage testing, aka test coverage testing, is a white (glass) box testing technique where testers try to evaluate test result by the percentage of code covered [BS]. There are various code coverate metrics. Including but not limited to line (basic block) coverage, condition coverage, decision coverage, path coverage, function coverage, entry/exit coverage etc. [WP] There are quite a few code coverage analysis tools out there. For example, gcov is a GNU coverage analysis tool that works with gcc. However, gcov may not work well with shared libraries[KB]. PurifyPlus from rational/IBM CTC++ from Testwell 5 GUI Testing There are various GUI testing tools available, including Squish, SilkTest, Rational Test, XRunner, etc. 6 API Testing 7 Links Kim Burchett's testing blog IEEE 829 Software testing resources Comments References [BS] http://www.bullseye.com/coverage.html [KB] http://www.kimbly.com/blog/000331.html [WP] http://en.wikipedia.org/wiki/Code_coverage Webster Unabridged Test"ing (?), n. 1. The act of testing or proving; trial; proof. 2. (Metal.) The operation of refining gold or silver in a test, or cupel; cupellation. Testing machine (Engin.), a machine used in the determination of the strength of materials, as iron, stone, etc., and their behavior under strains of various kinds, as elongation, bending, crushing, etc. (search time: 90.488 msec) English-Chinese testing ['testi8] ²âÊÔ³ÔÁ¦µÄ,ÊÔÑéµÄ (search time: 151.002 msec)