Page History
...
will not complain that test 4d does not exist.
Run a Range of Tests with auster
Range of tests using --only
If you want to run a range of tests, you can use the test suite flag "--only”.
Code Block |
---|
./auster abc --only "11-14"
./auster abc --only 11-14 |
will run abc.sh tests 11, 12, 13, and 14.
The test number at the beginning and/or end of the range does not have to exist in the test suite; all tests in a range that exist are run. For example,
Code Block |
---|
./auster abc --only 10-15 |
will run abc.sh tests 11, 12, 13, and 14.
Spaces between the hyphen are not allowed and will give an error and will not run any tests.
Code Block |
---|
./auster abc --only “10 – 15” |
will run no tests.
More than one range can be specified. The ranges will be combined and tests will be run in numerical order.
Code Block |
---|
./auster abc --only "11-14 3-4"
./auster abc --only "11-14,3-4"
./auster abc --only 11-14,3-4 |
will run abc.sh tests in the order of 3, 4, 11, 12, 13, and 14.
Ranges can overlap and each test will only be run once even if it is specified in more than one range.
Code Block |
---|
./auster abc --only "11-13,12-14"
|
will run abc.sh tests 11, 12, 13, and 14.
If the –only flag is used more than once for the same test suite, only the tests specified in the range of the last –only flag will be run.
Code Block |
---|
./auster abc --only 3-4 --only 12-14
|
will run abc.sh tests 12, 13, and 14. Tests 3 and 4 will not be run.
If a test suite has tests with the same number with letters appended, then all tests with the same number all letters will be run if the test number falls into a range.
Code Block |
---|
./auster abc --only 6-10
|
will run abc.sh tests 6, 7a 7b, and 7c.
Using a range with the --only flag overrides the ALWAYS_EXCEPT list in the test suite script and will execute a test in the –only list even if the same test is on the ALWAYS_EXCEPT list. For example, assume abc.sh test suite has ALWAYS_EXCEPT=”2c 3 4” defined, running
Code Block |
---|
./auster abc --only 3-5
|
will run abc.sh tests 3, 4, 5a, and 5b even though tests 3 and 4 are on the ALWAYS_EXCEPT list.
The –only flag does not allow a range to start with a subtest, a number followed by a letter, and does not allow a range to end with a subtest. All of the following will get an error “seq: invalid floating point argument: 2d” or “seq: invalid floating point argument: 5d” and no tests will be run. The following are NOT supported
Code Block |
---|
./auster abc --only “2d-5a”
./auster abc --only “2d-4”
./auster abc --only “3-5d” |