cf72fe8fe9
test_testsuite_class.py: Added testcases for load_From_file and apply_filters functions of Class Testsuite. conftest.py: Modified class_testsuite fixture to create the outdir as temporary directory which gets deleted after execution of testcases. test_data/sanitycheck.csv: load_from_file function uses this customized file to load the failed or last run testcases. test_data/sanitycheck_keyerror.csv: file used by test_load_from_file function to raise the appropriate error if there is a keyerror. scripts/requirements-build-test.txt: added mock & csv python libraries Signed-off-by: Aastha Grover <aastha.grover@intel.com> |
||
|---|---|---|
| .. | ||
| test_data | ||
| conftest.py | ||
| README.md | ||
| test_sanitycheck.py | ||
| test_testinstance.py | ||
| test_testsuite_class.py | ||
Sanitycheck Testing
Running the tests require the environment variable ZEPHYR_BASE to be set.
Sanitycheck Testsuite are located in $ZEPHYR_BASE/scripts/tests directory with all the data files in $ZEPHYR_BASE/scripts/test_data directory.
Dependencies
Install all the dependencies using
pip install -r $ZEPHYR_BASE/scripts/tests/sanitycheck/requirements.txt
Executing testsuite
The testcases can be executed from the root directory using
pytest $ZEPHYR_BASE/scripts/tests/sanitycheck
Sanitycheck Coverage
The coverage for all the tests can be run using the command below. This will collect all the tests available.
coverage run -m pytest $ZEPHYR_BASE/scripts/tests/sanitycheck/
Then we can generate the coverage report for just sanitycheck script using
coverage report -m $ZEPHYR_BASE/scripts/sanitycheck
The html coverage report for sanitycheck can be generated using
coverage html sanitycheck
If needed,the full coverage html report can be generated in every run of "pytest" in the tests directory using configuration file (setup.cfg).
Organization of tests
- test_sanitycheck.py : Contains basic testcases for environment variables, verifying testcase & platform schema's.