Slowest

Tested from main at 9ba7f64.

Durations as each test runner reported them; CppUTest reports to the millisecond.

On this page: Test time by lane · Slowest suites · Slowest tests

Test time by lane

Lane	Tests	Time
unit-linux-gcc-sanitize	4126	10 min 56 s
integration-linux-mbedtls	77	6 min 48 s
bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	86	5 min 1 s
bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	86	4 min 56 s
bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	86	4 min 48 s
bdd-freertos-plustcp-mbedtls-plusfat-syslogng	86	4 min 11 s
unit-linux-gcc	4330	3 min 58 s
bdd-windows-openssl-otel	86	2 min 6 s
bdd-linux-openssl-syslogng	86	2 min 3 s
bdd-linux-wolfssl-syslogng	86	2 min 3 s
bdd-linux-openssl-syslogng-passthrough	86	46.1 s
unit-windows-msvc	2515	4.9 s
integration-windows-openssl	45	4.2 s
unit-linux-gcc-tunables	3186	4.0 s
unit-linux-clang	2736	3.5 s
integration-linux-openssl	45	2.1 s
build-linux-wolfssl	2349	997 ms
integration-linux-wolfssl	98	299 ms
integration-linux-littlefs	14	2 ms

Slowest suites

Time	Lane	Suite	Tests
5 min 22 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	30
4 min 2 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	38
3 min 24 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	38
3 min 24 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	30
2 min 5 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	TLS equivalence matrix	28
2 min 0 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	TLS equivalence matrix	28
1 min 57 s	unit-linux-gcc	SolidSyslogMbedTlsStreamIntegration	30
1 min 56 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	TLS equivalence matrix	28
1 min 35 s	unit-linux-gcc	SolidSyslogMbedTlsPemBufferCredentials	38
1 min 19 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	TLS equivalence matrix	28
1 min 3 s	unit-linux-gcc-sanitize	StoreSweep	9
45.8 s	bdd-windows-openssl-otel	TLS equivalence matrix	28
44.7 s	bdd-linux-openssl-syslogng	TLS equivalence matrix	28
44.7 s	bdd-linux-wolfssl-syslogng	TLS equivalence matrix	28
43.0 s	bdd-linux-openssl-syslogng-passthrough	TLS equivalence matrix	28
30.7 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Store capacity limit and discard policy	4
30.4 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Store capacity limit and discard policy	4
28.8 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	Store capacity limit and discard policy	4
28.7 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	Store capacity limit and discard policy	4
25.9 s	unit-linux-gcc-sanitize	ScenarioSuite	31
25.8 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Store and forward during sender outage	5
25.1 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Store and forward during sender outage	5
24.8 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	Store and forward during sender outage	5
24.6 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	Store and forward during sender outage	5
23.3 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Power cycle replay from block store	3
22.7 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Power cycle replay from block store	3
22.7 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	Power cycle replay from block store	3
22.2 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	Power cycle replay from block store	3
20.6 s	bdd-windows-openssl-otel	Store and forward during sender outage	5
20.3 s	unit-linux-gcc	StoreSweep	9

Slowest tests

Time	Lane	Suite	Test	Status
35.9 s	unit-linux-gcc-sanitize	StoreSweep	ASingleFlippedBit	pass
25.8 s	unit-linux-gcc-sanitize	ScenarioSuite	ARandomWalkHoldsEveryInvariant	pass
23.8 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	TLS equivalence matrix	Rotating in the client credential lets a refused device deliver	pass
23.3 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	TLS equivalence matrix	Rotating in the client credential lets a refused device deliver	pass
23.2 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	TLS equivalence matrix	A device the collector rejects after the handshake is told, rather than believing it delivered	pass
23.2 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	TLS equivalence matrix	Rotating in the client credential lets a refused device deliver	pass
23.0 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	TLS equivalence matrix	A device the collector rejects after the handshake is told, rather than believing it delivered	pass
22.8 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	TLS equivalence matrix	A device the collector rejects after the handshake is told, rather than believing it delivered	pass
21.1 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	MutualTlsHandshakeRejectedWhenClientSendsNoCert	pass
20.5 s	bdd-windows-openssl-otel	TLS equivalence matrix	Rotating in the client credential lets a refused device deliver	pass
20.5 s	bdd-windows-openssl-otel	TLS equivalence matrix	A device the collector rejects after the handshake is told, rather than believing it delivered	pass
20.5 s	bdd-linux-openssl-syslogng-passthrough	TLS equivalence matrix	Rotating in the client credential lets a refused device deliver	pass
20.5 s	bdd-linux-openssl-syslogng-passthrough	TLS equivalence matrix	A device the collector rejects after the handshake is told, rather than believing it delivered	pass
20.5 s	bdd-linux-wolfssl-syslogng	TLS equivalence matrix	Rotating in the client credential lets a refused device deliver	pass
20.5 s	bdd-linux-wolfssl-syslogng	TLS equivalence matrix	A device the collector rejects after the handshake is told, rather than believing it delivered	pass
20.4 s	bdd-linux-openssl-syslogng	TLS equivalence matrix	Rotating in the client credential lets a refused device deliver	pass
20.4 s	bdd-linux-openssl-syslogng	TLS equivalence matrix	A device the collector rejects after the handshake is told, rather than believing it delivered	pass
20.4 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	MutualTlsHandshakeRejectedWhenClientCertSignedByUntrustedCa	pass
19.9 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	AFingerprintThatMatchesNothingIsNamedBeforeAnUntrustedChain	pass
17.1 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	AnUntrustedChainIsNamedBeforeANameThatDoesNotMatch	pass
16.3 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	MutualTlsHandshakeSucceedsWithClientCertSignedByTrustedCa	pass
16.0 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeRejectedWhenTheServerCertIsExpiredEvenThoughItsPinMatches	pass
15.7 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	AnExpiredIssuerIsNamedWhenTheLeafItSignedIsOtherwiseSound	pass
15.7 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	MutualTlsHandshakeRejectedWhenClientSendsNoCert	pass
15.3 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	ReleaseWithoutAnInstallIsSafe	pass
15.2 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeFailsWhenServerCertIsNotYetValid	pass
14.2 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	AFingerprintThatMatchesNothingIsNamedBeforeAnUntrustedChain	pass
14.0 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	OpenFailsWhenNothingAuthorisesThePeer	pass
13.9 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	AClientCredentialIsNotPresentedToAPeerThatMatchesNoPin	pass
13.7 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeFailsWhenServerCertHasExpired	pass
13.6 s	unit-linux-gcc	SolidSyslogMbedTlsStreamIntegration	MutualTlsHandshakeRejectedWhenClientCertSignedByUntrustedCa	pass
13.1 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	ARepeatedInstallRefusedWhileTheFirstIsOutstandingIsReportedOnce	pass
12.9 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	AnUntrustedChainIsNamedBeforeANameThatDoesNotMatch	pass
12.8 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	AnExpiredIssuerIsNamedBeforeALeafNameThatDoesNotMatch	pass
12.3 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeSucceedsWhenAPinIsTheOnlyThingAuthorisingTheServer	pass
12.2 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeRejectedWhenTheChainIsTrustedButNoPinMatches	pass
12.0 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	TheReleaseAnsweringARefusedInstallKeepsTheOutstandingMaterial	pass
12.0 s	unit-linux-gcc	SolidSyslogMbedTlsStreamIntegration	MutualTlsHandshakeRejectedWhenClientSendsNoCert	pass
11.9 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	CreateReturnsAPooledHandle	pass
11.8 s	unit-linux-gcc	StoreSweep	ASingleFlippedBit	pass
11.3 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	AnExpiredIssuerIsNamedBeforeALeafNameThatDoesNotMatch	pass
10.9 s	unit-linux-gcc-sanitize	StoreSweep	ABlockRemovedWhileRunning	pass
10.9 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	AMalformedPinIsNamedBeforeAnyFaultInThePeersCertificate	pass
10.7 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Store and forward during sender outage	Stored messages wait for an AES-256-GCM key that is briefly unavailable	pass
10.7 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeSucceedsWhenServerCertSignedByTrustedCaAndHostnameMatches	pass
10.7 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	OpenFailsWhenNothingAuthorisesThePeer	pass
10.6 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	InstallParsesTheTrustAnchorsAndReportsThem	pass
10.6 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Store capacity limit and discard policy	Halt prevents further service after store overflows	pass
10.2 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Store and forward during sender outage	Stored messages wait for an HMAC key that is briefly unavailable	pass
10.1 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Store and forward during sender outage	Stored messages wait for an AES-256-GCM key that is briefly unavailable	pass
10.1 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Store and forward during sender outage	Stored messages wait for an HMAC key that is briefly unavailable	pass
10.1 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	AnExpiredIssuerIsNamedWhenTheLeafItSignedIsOtherwiseSound	pass
10.0 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	Store and forward during sender outage	Stored messages wait for an HMAC key that is briefly unavailable	pass
10.0 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeSucceedsChainOnlyWithNoServerNameAndWarns	pass
10.0 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	APinThatMatchesDoesNotWaiveANameThatDoesNot	pass
10.0 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	Store and forward during sender outage	Stored messages wait for an AES-256-GCM key that is briefly unavailable	pass
10.0 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeFailsWhenTheExpectedAddressDoesNotMatchCert	pass
9.9 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	Store and forward during sender outage	Stored messages wait for an AES-256-GCM key that is briefly unavailable	pass
9.9 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	DestroyingAHandleThePoolDoesNotOwnIsReported	pass
9.9 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	Store capacity limit and discard policy	Halt prevents further service after store overflows	pass
9.9 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	Store and forward during sender outage	Stored messages wait for an HMAC key that is briefly unavailable	pass
9.7 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Store capacity limit and discard policy	Halt prevents further service after store overflows	pass
9.7 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	Store capacity limit and discard policy	Halt prevents further service after store overflows	pass
9.5 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	CreateWithoutAnRngReturnsTheNullCredentials	pass
9.5 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	DestroyingAHandleTwiceReportsTheSecond	pass
9.4 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	AnInstallAfterAnInPlaceRotationParsesTheNewMaterial	pass
9.2 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	ReleaseLetsGoOfEverythingItParsed	pass
9.0 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	InstallReportsAClientKeyThatIsNotTerminated	pass
8.9 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	CreateWithAMissingPinInTheListReportsBadConfig	pass
8.9 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	CreateWithAPinCountButNoPinListReturnsTheNullCredentials	pass
8.9 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeSucceedsWithNoServerNameWhenAPinIsTheOnlyThingAuthorisingTheServer	pass
8.9 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	ASourceCreatedInAReusedSlotReportsItsFirstRefusal	pass
8.7 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	CreateWithoutAnRngReturnsTheNullCredentials	pass
8.7 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	MutualTlsHandshakeSucceedsWithClientCertSignedByTrustedCa	pass
8.7 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	InstallPresentsAParsedClientCredential	pass
8.5 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	CreateWithAPinCountButNoPinListReturnsTheNullCredentials	pass
8.5 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Store capacity limit and discard policy	Halt stops the application when store overflows	pass
8.4 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	CreateBeyondThePoolReportsExhaustion	pass
8.4 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	InstallReportsRepeatedTrustAnchorsItCannotParseOnce	pass
8.4 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	InstallPassesTheConfiguredPeerFingerprintsThrough	pass
8.3 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	InstallReportsRepeatedTrustAnchorsItCannotParseOnce	pass
8.1 s	integration-linux-mbedtls	SolidSyslogMbedTlsStreamIntegration	MutualTlsHandshakeRejectedWhenClientCertSignedByUntrustedCa	pass
7.9 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	InstallStillSucceedsWhenTheClientCredentialIsFaulty	pass
7.9 s	integration-linux-mbedtls	SolidSyslogMbedTlsPemBufferCredentials	InstallParsesTheTrustAnchorsAndReportsThem	pass
7.8 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsStreamIntegration	HandshakeFailsWhenServerCertSignedByUntrustedCa	pass
7.8 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Power cycle replay from block store	Stored messages replayed after power cycle with AES-256-GCM at rest	pass
7.8 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Power cycle replay from block store	Stored messages replayed after power cycle with HMAC-SHA256 at rest	pass
7.7 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Power cycle replay from block store	Stored messages replayed after power cycle	pass
7.7 s	unit-linux-gcc-sanitize	SolidSyslogMbedTlsPemBufferCredentials	InstallWithoutPeerFingerprintsReportsNone	pass
7.7 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Power cycle replay from block store	Stored messages replayed after power cycle with AES-256-GCM at rest	pass
7.7 s	bdd-cmsisrtos-lwipsocket-mbedtls-littlefs-syslogng	Store capacity limit and discard policy	Halt stops the application when store overflows	pass
7.6 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	Power cycle replay from block store	Stored messages replayed after power cycle with HMAC-SHA256 at rest	pass
7.6 s	bdd-windows-openssl-otel	Buffer discard policy	Halt prevents further service after the buffer overflows	pass
7.6 s	bdd-freertos-plustcp-mbedtls-plusfat-syslogng	Power cycle replay from block store	Stored messages replayed after power cycle with AES-256-GCM at rest	pass
7.6 s	bdd-cmsisrtos-lwipsocket-wolfssl-littlefs-syslogng	Power cycle replay from block store	Stored messages replayed after power cycle with HMAC-SHA256 at rest	pass
7.6 s	bdd-freertos-lwipraw-mbedtls-fatfs-syslogng	Power cycle replay from block store	Stored messages replayed after power cycle with HMAC-SHA256 at rest	pass
7.6 s	bdd-linux-openssl-syslogng	Buffer discard policy	Halt prevents further service after the buffer overflows	pass
7.6 s	bdd-linux-wolfssl-syslogng	Buffer discard policy	Halt prevents further service after the buffer overflows	pass
7.6 s	bdd-windows-openssl-otel	Store and forward during sender outage	Stored messages wait for an AES-256-GCM key that is briefly unavailable	pass
7.6 s	bdd-windows-openssl-otel	Store and forward during sender outage	Stored messages wait for an HMAC key that is briefly unavailable	pass