History

Lukasz Mrugala f71a4184f3 scripts: twister: Fix Unit Tests on Windows systems Unit tests currently are not runnable on Windows systems, failing on two testfiles: test_jobserver.py and test_testsuite.py. This commit removes code dependency on Windows-unavailable elements on Windows systems via skipping the offending tests. Signed-off-by: Lukasz Mrugala <lukaszx.mrugala@intel.com>		2024-05-15 17:08:06 +02:00
..
pytest_integration	scripts/pylib/twister/twisterlib: Support multiple `--pytest-args`	2023-11-30 10:03:01 +01:00
test_data	twister: do not use non-existing architectures	2024-03-19 18:28:06 -04:00
conftest.py	scripts: tests: Expand environment.py tests	2023-07-18 16:20:54 +02:00
README.md	twister: fixups to various files	2022-07-05 12:06:27 -04:00
test_cmakecache.py	scripts: tests: twister: CMakeCache test expansion	2023-07-25 09:11:26 +02:00
test_config_parser.py	twister: ut for config_parser.py	2024-03-29 15:06:44 +00:00
test_environment.py	scripts: twister: Fix overbroad Mock in environment unit tests	2024-04-15 16:25:51 +02:00
test_errors.py	scripts: tests: twister: Add error testing	2023-10-30 08:27:43 -04:00
test_handlers.py	twister: Allow to run sysbuild with native_sim	2024-05-15 13:16:39 +02:00
test_hardwaremap.py	scripts: tests: twister: Hardware map unit testing	2023-11-06 10:08:44 +01:00
test_harness.py	twister: Refactor 'recording' feature	2024-05-14 18:20:12 -04:00
test_jobserver.py	scripts: twister: Fix Unit Tests on Windows systems	2024-05-15 17:08:06 +02:00
test_log_helper.py	scripts: tests: twister: Add log_helper tests	2023-10-03 15:22:08 +01:00
test_mixins.py	scripts: tests: twister: Mixin test	2023-09-06 09:40:38 -04:00
test_platform.py	twister: do not use non-existing architectures	2024-03-19 18:28:06 -04:00
test_quarantine.py	twister: Fix quarantine performance issue	2023-10-04 14:49:38 +01:00
test_runner.py	twister: allow using west-flash with 'erase'	2024-05-10 20:26:02 -04:00
test_scl.py	twister: fix utf-8 encoding for device handler	2023-09-19 15:23:52 +01:00
test_testinstance.py	twister: Refactor 'recording' feature	2024-05-14 18:20:12 -04:00
test_testplan.py	scripts: tests: Blackbox test expansion - report summary	2024-05-15 09:29:05 +02:00
test_testsuite.py	scripts: twister: Fix Unit Tests on Windows systems	2024-05-15 17:08:06 +02:00
test_twister.py	scripts: Twister ConfigurationError Fix	2023-05-26 05:50:20 -04:00

README.md

Twister Testing

Running the tests require the environment variable ZEPHYR_BASE to be set.

Twister Testsuite are located in $ZEPHYR_BASE/scripts/tests directory with all the data files in $ZEPHYR_BASE/scripts/test_data directory.

Dependencies

Install all the dependencies using

pip install -r $ZEPHYR_BASE/scripts/requirements-build-test.txt

Executing testsuite

The testcases can be executed from the root directory using

pytest $ZEPHYR_BASE/scripts/tests/twister

Twister Coverage

The coverage for all the tests can be run using the command below. This will collect all the tests available.

coverage run -m pytest $ZEPHYR_BASE/scripts/tests/twister/

Then we can generate the coverage report for just twister script using

coverage report -m $ZEPHYR_BASE/scripts/pylib/twister/

To generate the coverage report for twister script use below command

coverage report -m $ZEPHYR_BASE/scripts/twister

The html coverage report for twister can be generated using

coverage html twister

If needed,the full coverage html report can be generated in every run of "pytest" in the tests directory using configuration file (setup.cfg).

Organization of tests

conftest.py: Contains common fixtures for use in testing the twister tool.
test_twister.py : Contains basic testcases for environment variables, verifying testcase & platform schema's.
test_testsuite_class.py : Contains testcases for Testsuite class (except reporting functionality) in twisterlib.py.
test_testinstance.py : Contains testcases for Testinstance and Testcase class.
test_reporting_testsuite.py : Contains testcases for reporting functionality of Testsuite class of twister.