Skip to content

tests: subsys: fs: bm_zms: fix testcase.yml#781

Merged
eivindj-nordic merged 1 commit intonrfconnect:mainfrom
lemrey:zms-test-yml
Apr 29, 2026
Merged

tests: subsys: fs: bm_zms: fix testcase.yml#781
eivindj-nordic merged 1 commit intonrfconnect:mainfrom
lemrey:zms-test-yml

Conversation

@lemrey
Copy link
Copy Markdown
Contributor

@lemrey lemrey commented Apr 28, 2026

Add more test cases, correct existing ones.

$ west twister --device-testing --device-serial /dev/ttyACM1 -vc -T . -p bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice --west-flash="--erase"
Deleting output directory /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out
INFO    - Using Ninja..
INFO    - Zephyr version: ncs-v3.3.0-rc1
INFO    - Using 'zephyr' toolchain.
INFO    - Building initial testsuite list...
INFO    - Built testsuite list in 0.00 seconds
INFO    - Writing JSON report /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out/testplan.json

Device testing on:

| Platform                                      | ID   | Serial device   |
|-----------------------------------------------|------|-----------------|
| bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice |      | /dev/ttyACM1    |

INFO    - JOBS: 20
INFO    - Adding tasks to the queue...
INFO    - Added initial list of jobs to queue
INFO    - 1/7 bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice subsys.bm_zms                  FILTERED (runtime filter)
INFO    - 2/7 bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice subsys.bm_zms.data_crc         FILTERED (runtime filter)
INFO    - 3/7 bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice subsys.bm_zms.async            FILTERED (runtime filter)
INFO    - 4/7 bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice subsys.bm_zms.cache            FILTERED (runtime filter)
INFO    - 5/7 bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice subsys.bm_zms.softdevice       PASSED (device 4.514s <zephyr>)
INFO    - 6/7 bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice subsys.bm_zms.softdevice.cache PASSED (device 4.632s <zephyr>)
INFO    - 7/7 bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice subsys.bm_zms.softdevice.data_crc PASSED (device 4.532s <zephyr>)

INFO    - 7 test scenarios (7 configurations) selected, 4 configurations filtered (0 by static filter, 4 at runtime).
INFO    - 3 of 3 executed test configurations passed (100.00%), 0 built (not run), 0 failed, 0 errored, with no warnings in 31.99 seconds.
INFO    - 33 of 33 executed test cases passed (100.00%) on 1 out of total 1412 platforms (0.07%).
INFO    - 3 test configurations executed on platforms, 0 test configurations were only built.

Hardware distribution summary:

| Board                                         | ID   |   Counter |   Failures |
|-----------------------------------------------|------|-----------|------------|
| bm_nrf54l15dk/nrf54l15/cpuapp/s115_softdevice |      |         3 |          0 |
INFO    - Saving reports...
INFO    - Writing JSON report /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out/twister.json
INFO    - Writing xunit report /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out/twister.xml...
INFO    - Writing xunit report /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out/twister_report.xml...
INFO    - Run completed
$ west twister -vc -T . -p native_sim
Deleting output directory /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out
INFO    - Using Ninja..
INFO    - Zephyr version: ncs-v3.3.0-rc1
INFO    - Using 'zephyr' toolchain.
INFO    - Building initial testsuite list...
INFO    - Built testsuite list in 0.00 seconds
INFO    - Writing JSON report /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out/testplan.json
INFO    - JOBS: 20
INFO    - Adding tasks to the queue...
INFO    - Added initial list of jobs to queue
INFO    - 1/7 native_sim/native         subsys.bm_zms.softdevice                           FILTERED (runtime filter)
INFO    - 2/7 native_sim/native         subsys.bm_zms.softdevice.cache                     FILTERED (runtime filter)
INFO    - 3/7 native_sim/native         subsys.bm_zms.softdevice.data_crc                  FILTERED (runtime filter)
INFO    - 4/7 native_sim/native         subsys.bm_zms                                      PASSED (native 0.013s <host>)
INFO    - 5/7 native_sim/native         subsys.bm_zms.async                                PASSED (native 0.019s <host>)
INFO    - 6/7 native_sim/native         subsys.bm_zms.data_crc                             PASSED (native 0.008s <host>)
INFO    - 7/7 native_sim/native         subsys.bm_zms.cache                                PASSED (native 0.012s <host>)

INFO    - 7 test scenarios (7 configurations) selected, 3 configurations filtered (0 by static filter, 3 at runtime).
INFO    - 4 of 4 executed test configurations passed (100.00%), 0 built (not run), 0 failed, 0 errored, with no warnings in 9.33 seconds.
INFO    - 44 of 44 executed test cases passed (100.00%) on 1 out of total 1412 platforms (0.07%).
INFO    - 4 test configurations executed on platforms, 0 test configurations were only built.
INFO    - Saving reports...
INFO    - Writing JSON report /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out/twister.json
INFO    - Writing xunit report /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out/twister.xml...
INFO    - Writing xunit report /home/emdi/ncs/nrf-bm/tests/subsys/fs/bm_zms/twister-out/twister_report.xml...
INFO    - Run completed

Add more test cases, correct existing ones.

Signed-off-by: Emanuele Di Santo <emdi@nordicsemi.no>
@lemrey lemrey requested review from a team and rghaddab as code owners April 28, 2026 10:50
@github-actions github-actions Bot added the changelog-entry-required Update changelog before merge. Remove label if entry is not needed or already added. label Apr 28, 2026
@lemrey lemrey removed the changelog-entry-required Update changelog before merge. Remove label if entry is not needed or already added. label Apr 28, 2026
@github-actions
Copy link
Copy Markdown

You can find the documentation preview for this PR here.

Copy link
Copy Markdown
Contributor

@anhmolt anhmolt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good cleanup. I'm fine with this.

Although, I think we could use individual platform_allow: list for the different tests instead of filtering. I tried it here: lemrey/sdk-nrf-bm@zms-test-yml...anhmolt:sdk-nrf-bm:anhmolt-zms-test-yml

Then the tests that do not match the board target will be simply discarded (static filtering), and not show up as runtime filtered. No dtc or Kconfig (early steps of the build) will be run on them. Not sure why it was done with filtering in the first place, but there might be a good reason why.

@eivindj-nordic
Copy link
Copy Markdown
Contributor

Although, I think we could use individual platform_allow: list for the different tests instead of filtering.

I agree that might be cleaner. Though as filters are already used here, I'll merge this as is for the release and we can revisit after.

@eivindj-nordic eivindj-nordic merged commit 9f7209a into nrfconnect:main Apr 29, 2026
20 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants