Tests

Tested from main at 9ba7f64.

On this page: Failures · Unit · Integration · Build · BDD · By pack · Versions

20209Tests
20109Passed
0Failed
100Skipped
19Lanes
47 min 57 sTest time

Test time is the sum of every test's own duration, across lanes that ran in parallel; it is not the run's wall clock.

Failures

No failures in this run.

Unit 16893 tests, 16893 passed, 15 min 7 s

CppUTest against the fakes, under each compiler and sanitiser the lanes run. The Unit page has the view across these lanes.

LaneExecutablesSuitesTestsPassedFailedSkippedTime
unit-linux-clang1919427362736003.5 s
unit-linux-gcc6428943304330003 min 58 s
unit-linux-gcc-sanitize63271412641260010 min 56 s
unit-linux-gcc-tunables3021331863186004.0 s
unit-windows-msvc1917325152515004.9 s

Integration 279 tests, 279 passed, 6 min 55 s

CppUTest against a real upstream, where a fake would prove too little. The Integration page has the view across these lanes.

LaneExecutablesSuitesTestsPassedFailedSkippedTime
integration-linux-littlefs121414002 ms
integration-linux-mbedtls147777006 min 48 s
integration-linux-openssl134545002.1 s
integration-linux-wolfssl26989800299 ms
integration-windows-openssl134545004.2 s

Build 2349 tests, 2349 passed, 997 ms

A build lane that also runs the unit tests it builds. The Build page has the view across these lanes.

LaneExecutablesSuitesTestsPassedFailedSkippedTime
build-linux-wolfssl141742349234900997 ms

BDD 688 tests, 588 passed, 100 skipped, 25 min 54 s

Gherkin scenarios driving a real target against the syslog oracle. The BDD page has the view across these lanes.

LaneExecutablesSuitesTestsPassedFailedSkippedTime
bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng12286720144 min 56 s
bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng12286720145 min 1 s
bdd-freertos-lwipraw-mbedtls-fatfs-syslogng12286720144 min 48 s
bdd-freertos-plustcp-mbedtls-plusfat-syslogng12286720144 min 11 s
bdd-linux-openssl-syslogng1228681052 min 3 s
bdd-linux-openssl-syslogng-passthrough122865802846.1 s
bdd-linux-wolfssl-syslogng1228681052 min 3 s
bdd-windows-openssl-otel1228680062 min 6 s

By pack

Tests attributed by the test file that holds them. A pack's figure counts every lane that ran it.

PackLanesTestsPassedFailedSkippedTime
BDD scenarios8688588010025 min 54 s
BDD target1202202001 ms
CmsisRtos5170170001 ms
Core681048104001 min 56 s
FatFs2124124001 ms
FreeRtos27272001 ms
LittleFs31281280010 ms
LwipRaw2276276005 ms
LwipSocket2236236005 ms
MbedTls37637630019 min 43 s
OpenSsl7204520450021.1 s
PlusFat2100100000 ms
PlusTcp2276276003 ms
Posix5152015200018 ms
StdAtomic55555000 ms
Test support6175117510014 ms
VxWorks645172017200078 ms
Windows181810011 ms
WolfSsl518981898002.1 s

Versions

What each lane compiled against, from the record its configure wrote: the compiler, and the version each selected pack's upstream states in its own header. A lane page has the tag and commit of each tree.

LaneCompilerUpstreams
bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogngGNU 14.2.1 (arm-none-eabi-gcc)CmsisRtos v6.4.0 / v11.3.0, LittleFs 2.11 (v2.11.3), LwipSocket 2.2.1, MbedTls 3.6.7
bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogngGNU 14.2.1 (arm-none-eabi-gcc)CmsisRtos v6.4.0 / v11.3.0, LittleFs 2.11 (v2.11.3), LwipSocket 2.2.1, WolfSsl 5.9.4
bdd-freertos-lwipraw-mbedtls-fatfs-syslogngGNU 14.2.1 (arm-none-eabi-gcc)FatFs R0.16, FreeRtos V11.3.3, LwipRaw 2.2.1, MbedTls 3.6.7
bdd-freertos-plustcp-mbedtls-plusfat-syslogngGNU 14.2.1 (arm-none-eabi-gcc)CmsisRtos v6.4.0 / v11.3.0, FatFs R0.16, FreeRtos V11.3.3, LittleFs 2.11 (v2.11.3), LwipRaw 2.2.1, LwipSocket 2.2.1, MbedTls 3.6.7, PlusFat 9ca465c, PlusTcp V4.4.1 (V4.4.2), WolfSsl 5.9.4
bdd-linux-openssl-syslogngGNU 14.2.0OpenSsl 3.5.7, WolfSsl 5.9.4
bdd-linux-openssl-syslogng-passthroughGNU 14.2.0OpenSsl 3.5.7, WolfSsl 5.9.4
bdd-linux-wolfssl-syslogngGNU 14.2.0WolfSsl 5.9.4
bdd-windows-openssl-otelMSVC 19.51.36260.0OpenSsl 3.6.3
build-linux-wolfsslGNU 14.2.0WolfSsl 5.9.4
integration-linux-littlefsGNU 14.2.0CmsisRtos v6.4.0 / v11.3.0, FatFs R0.16, FreeRtos V11.3.3, LittleFs 2.11 (v2.11.3), LwipRaw 2.2.1, LwipSocket 2.2.1, MbedTls 3.6.7, OpenSsl 3.5.7, PlusFat 9ca465c, PlusTcp V4.4.1 (V4.4.2), WolfSsl 5.9.4
integration-linux-mbedtlsGNU 14.2.0CmsisRtos v6.4.0 / v11.3.0, FatFs R0.16, FreeRtos V11.3.3, LittleFs 2.11 (v2.11.3), LwipRaw 2.2.1, LwipSocket 2.2.1, MbedTls 3.6.7, OpenSsl 3.5.7, PlusFat 9ca465c, PlusTcp V4.4.1 (V4.4.2), WolfSsl 5.9.4
integration-linux-opensslGNU 14.2.0OpenSsl 3.5.7, WolfSsl 5.9.4
integration-linux-wolfsslGNU 14.2.0OpenSsl 3.5.7, WolfSsl 5.9.4
integration-windows-opensslMSVC 19.51.36260.0OpenSsl 3.6.3
unit-linux-clangClang 19.1.7OpenSsl 3.5.7
unit-linux-gccGNU 14.2.0CmsisRtos v6.4.0 / v11.3.0, FatFs R0.16, FreeRtos V11.3.3, LittleFs 2.11 (v2.11.3), LwipRaw 2.2.1, LwipSocket 2.2.1, MbedTls 3.6.7, OpenSsl 3.5.7, PlusFat 9ca465c, PlusTcp V4.4.1 (V4.4.2), WolfSsl 5.9.4
unit-linux-gcc-sanitizeGNU 14.2.0CmsisRtos v6.4.0 / v11.3.0, FatFs R0.16, FreeRtos V11.3.3, LittleFs 2.11 (v2.11.3), LwipRaw 2.2.1, LwipSocket 2.2.1, MbedTls 3.6.7, OpenSsl 3.5.7, PlusFat 9ca465c, PlusTcp V4.4.1 (V4.4.2), WolfSsl 5.9.4
unit-linux-gcc-tunablesGNU 14.2.0OpenSsl 3.5.7, WolfSsl 5.9.4
unit-windows-msvcMSVC 19.51.36260.0OpenSsl 3.6.3