A test script can be replayed as a blackbox test or a whitebox test. When it is replayed as a blackbox test only the user input and the solutions are compared, not all the steps of Trinc-Prolog and values of variables. This makes it possible to check if a new version of an algorithm still produces correct results with a test script of an older version of the same algorithm. While replaying a whitebox test all the user input, all the steps of the Trinc-Prolog inference engine and the output are compared.
To start replaying a test press the button 'Replay' in the main window, the following dialog then appears:
|
It is possible to use a file filter instead of a single file for specifying a set of test script files to replay, if for instance: 'c:\temp\*.txt' is specified then all files with the extension .txt in the folder 'c:\temp\' are replayed.
If the option Repeat test infinite is checked the test(s) specified is (are) executed infinitely, this is useful for doing reliability tests. If the option Show output during test is checked the solutions are displayed, else nothing is displayed during the replaying of the test. No output during the replaying of a test increases the speed of replaying a test. If Delete report file before test is checked the output report file is deleted before the replaying of the test is started, else the information from the test is appended to the report file. It is possible per different test run that the identifiers of empty variables are different, by checking Ignore empty variable identifiers on the identifiers of empty variables are ignored but the relations between empty variables are still compared.
After replaying the test the contents of the report file specifies which clauses had different output as compared to when the test file was recorded.
 |
If the keyboard focus switches to the text editor of Trinc-Prolog it checks if there are newer versions of the files opened in the text editor on disk. If the report file is opened in the text editor and the replaying of a test has finished the text editor will ask the user if the newer version of the report file must be loaded. |