Test results¶

This page is regenerated from the committed CSVs under tests/results/ on every mkdocs build. The CSVs themselves are the most recent local snapshot produced by the RTEMS integration harnesses; see the testing index for the harness layout and how to reproduce the run.

The per-suite aggregate below is computed by scripts/aggregate_rtems5.sh and committed as tests/results/rtems5-aggregate.csv.
Per-ELF outcomes (one row per RTEMS test) live in the per-suite CSVs and are rendered below behind collapsible blocks because of their size (sptests alone has ~190 rows).
ctest --output-junit build/evidence/ctest-junit.xml produces a standard JUnit XML with one <testcase> per Catch2 TEST_CASE (~497 entries). The RTEMS suites appear as four rows in that XML — per-ELF granularity stays in the CSVs rendered here.
To regenerate locally: cmake --build build --target evidence, or scripts/generate_evidence.sh build -- -E smptests to skip the slow RTEMS SMP suites.

Aggregate¶

Suite	Total	PASS	FAIL	TIMEOUT	Pass rate
`sptests`	190	178	11	1	93.7%
`sptests-gr740`	190	178	11	1	93.7%
`fptests`	1	1	0	0	100.0%
`fptests-gr740`	1	1	0	0	100.0%
`smptests-N2`	54	42	9	3	77.8%
`smptests-N4`	54	40	8	6	74.1%
`TOTAL`	490	440	39	11	89.8%

By suite¶

RTEMS 5 sptests — GR712RC N=1 (no MMU)¶

178/190 passed — 178 PASS · 11 FAIL · 1 TIMEOUT — pass rate 93.7 %

Per-test rows (190)

Test	Outcome	sim (ms)	host (ms)
`sp01`	PASS	34998	261
`sp02`	PASS	6001	53
`sp03`	PASS	17000	151
`sp04`	FAIL	7000	20983
`sp05`	PASS	29999	296
`sp06`	PASS	10001	107
`sp07`	PASS	4	17
`sp08`	PASS	4	20
`sp11`	PASS	9102	143
`sp12`	PASS	33998	364
`sp13`	PASS	15781	2899
`sp14`	PASS	3002	1615
`sp15`	PASS	3	11
`sp16`	PASS	3003	45
`sp17`	PASS	2	7
`sp18`	FAIL	2	7
`sp19`	PASS	15990	13759
`sp20`	TIMEOUT	60000	445
`sp2038`	PASS	850	2855
`sp21`	PASS	5	22
`sp22`	PASS	11001	87
`sp23`	PASS	2	9
`sp24`	PASS	34998	239
`sp25`	PASS	5	19
`sp26`	PASS	11001	78
`sp27`	PASS	91	11
`sp27a`	PASS	91	10
`sp29`	PASS	10051	67
`sp30`	PASS	34998	229
`sp31`	PASS	14510	114
`sp32`	PASS	27902	116
`sp33`	PASS	5251	51
`sp34`	PASS	6001	52
`sp35`	PASS	10501	1466
`sp37`	PASS	212	18
`sp38`	PASS	101	277
`sp40`	PASS	2	10
`sp41`	PASS	2	7
`sp42`	PASS	4002	82
`sp43`	PASS	9	28
`sp44`	PASS	181	531
`sp45`	PASS	2002	21
`sp46`	PASS	1002	14
`sp47`	PASS	2	9
`sp48`	PASS	503	1408
`sp49`	PASS	2	6
`sp50`	PASS	9001	73
`sp51`	PASS	2	6
`sp52`	PASS	2	6
`sp53`	PASS	2	7
`sp54`	PASS	292	861
`sp55`	PASS	2	6
`sp56`	PASS	2	6
`sp57`	PASS	1002	12
`sp58`	PASS	1	5
`sp59`	PASS	2002	20
`sp60`	PASS	1002	13
`sp62`	PASS	2042	22
`sp63`	PASS	1213	3374
`sp64`	PASS	2	6
`sp65`	PASS	1022	13
`sp66`	PASS	1022	15
`sp67`	PASS	252	10
`sp68`	PASS	492	17
`sp70`	PASS	3	10
`sp71`	PASS	492	1403
`sp72`	PASS	1002	13
`sp73`	PASS	15000	99
`sp74`	PASS	2	6
`sp75`	PASS	1	6
`sp76`	PASS	2	7
`sp77`	PASS	1	5
`spassoc01`	PASS	4	12
`spatomic01`	PASS	2	7
`spcache01`	PASS	7	20
`spcbssched01`	PASS	34998	228
`spcbssched02`	PASS	2602	3872
`spcbssched03`	PASS	16840	46309
`spchain`	PASS	12	9
`spclock_err01`	PASS	4	12
`spclock_err02`	PASS	5001	43
`spclock_todhook01`	PASS	2	7
`spconfig01`	PASS	1	5
`spconfig02`	PASS	3	10
`spconsole01`	PASS	3091	126
`spcontext01`	FAIL	7999	20340
`spcoverage`	PASS	1	6
`spcpucounter01`	PASS	54	154
`spcpuset01`	PASS	33	87
`spedfsched01`	PASS	34998	228
`spedfsched02`	PASS	20041	371
`spedfsched03`	PASS	16840	49295
`sperror01`	PASS	2	7
`sperror02`	PASS	2	7
`sperror03`	PASS	1	9
`spevent_err03`	PASS	4002	33
`speventsystem01`	PASS	11	6
`speventtransient01`	PASS	12	7
`spextensions01`	PASS	2	9
`spfatal01`	PASS	1	6
`spfatal02`	PASS	1	5
`spfatal03`	PASS	2	6
`spfatal04`	PASS	1	6
`spfatal05`	PASS	1	6
`spfatal06`	PASS	0	2
`spfatal09`	FAIL	0	0
`spfatal10`	PASS	2	6
`spfatal11`	PASS	2	9
`spfatal12`	FAIL	0	1
`spfatal14`	PASS	1	6
`spfatal15`	PASS	1	5
`spfatal24`	PASS	1	6
`spfatal25`	PASS	1	6
`spfatal26`	PASS	1	5
`spfatal28`	PASS	1	7
`spfatal29`	PASS	11	8
`spfatal30`	FAIL	1	5
`spfatal31`	FAIL	21	5
`spfatal32`	PASS	1	5
`spfifo01`	PASS	2	6
`spfifo02`	PASS	8	29
`spfifo03`	PASS	2042	30
`spfifo04`	PASS	2	8
`spfifo05`	PASS	4	16
`spfreechain01`	PASS	2	10
`spglobalcon02`	PASS	1	6
`spheapprot`	PASS	1	6
`spinternalerror01`	FAIL	0	0
`spinternalerror02`	PASS	6	21
`spintr_err01`	PASS	2	8
`splinkersets01`	PASS	1	5
`spmisc01`	PASS	1	5
`spmkdir`	PASS	6	20
`spmountmgr01`	PASS	3	13
`spmrsp01`	FAIL	11	8
`spmsgq_err01`	PASS	3003	31
`spmsgq_err02`	PASS	4	18
`spmutex01`	PASS	85	23
`spnsext01`	FAIL	301	1005
`spobjgetnext`	PASS	2	7
`sppagesize`	PASS	1	5
`sppartition_err01`	PASS	3	11
`sppercpudata01`	PASS	1	6
`spport_err01`	PASS	2	11
`spprintk`	PASS	4	14
`spprivenv01`	PASS	1022	15
`spprofiling01`	PASS	32	6
`spqreslib`	PASS	12102	12740
`spratemon_err01`	PASS	2002	53
`sprbtree01`	PASS	6755	20357
`spregion_err01`	PASS	3003	37
`spscheduler01`	PASS	2	13
`spsem01`	PASS	2	9
`spsem02`	PASS	3	10
`spsem03`	PASS	2	6
`spsem_err01`	PASS	3	11
`spsem_err02`	PASS	3002	34
`spsignal_err01`	PASS	2	6
`spsimplesched01`	PASS	34998	253
`spsimplesched02`	PASS	2	8
`spsimplesched03`	PASS	1	7
`spsize`	PASS	3	16
`spstdthreads01`	PASS	102	10
`spstkalloc`	PASS	2	7
`spstkalloc02`	PASS	2	9
`spstkalloc03`	PASS	2	7
`spstkalloc04`	PASS	2	9
`spsysinit01`	PASS	4	13
`spsyslock01`	PASS	162	13
`sptask_err01`	PASS	2	7
`sptask_err02`	PASS	6001	54
`sptask_err03`	PASS	3	13
`sptask_err04`	PASS	3	11
`sptasknopreempt01`	PASS	2	6
`spthread01`	PASS	12	6
`spthreadlife01`	PASS	2	9
`spthreadq01`	PASS	2	7
`sptimecounter01`	FAIL	0	0
`sptimecounter03`	PASS	9991	34958
`sptimecounter04`	PASS	2002	18
`sptimer_err01`	PASS	3	15
`sptimer_err02`	PASS	3	11
`sptimerserver01`	PASS	1102	14
`sptimespec01`	PASS	2	7
`sptls01`	PASS	2	7
`sptls03`	PASS	1	6
`sptls04`	PASS	1	8
`spversion01`	PASS	2	7
`spwatchdog`	PASS	4001	35
`spwkspace`	PASS	2	10

RTEMS 5 sptests — GR740 N=1 (no MMU)¶

178/190 passed — 178 PASS · 11 FAIL · 1 TIMEOUT — pass rate 93.7 %

Per-test rows (190)

Test	Outcome	sim (ms)	host (ms)
`sp01`	PASS	34998	274
`sp02`	PASS	6001	61
`sp03`	PASS	17000	153
`sp04`	FAIL	7000	18225
`sp05`	PASS	29999	196
`sp06`	PASS	10001	75
`sp07`	PASS	4	12
`sp08`	PASS	4	12
`sp11`	PASS	9102	87
`sp12`	PASS	33998	235
`sp13`	PASS	15781	2031
`sp14`	PASS	3002	1541
`sp15`	PASS	3	11
`sp16`	PASS	3003	61
`sp17`	PASS	2	7
`sp18`	FAIL	2	8
`sp19`	PASS	15990	14402
`sp20`	TIMEOUT	60000	474
`sp2038`	PASS	850	3203
`sp21`	PASS	5	18
`sp22`	PASS	11001	117
`sp23`	PASS	2	11
`sp24`	PASS	34998	316
`sp25`	PASS	5	21
`sp26`	PASS	11001	83
`sp27`	PASS	91	13
`sp27a`	PASS	91	13
`sp29`	PASS	10051	75
`sp30`	PASS	34998	255
`sp31`	PASS	14510	117
`sp32`	PASS	27902	118
`sp33`	PASS	5251	57
`sp34`	PASS	6001	57
`sp35`	PASS	10501	1605
`sp37`	PASS	212	23
`sp38`	PASS	101	290
`sp40`	PASS	2	13
`sp41`	PASS	2	6
`sp42`	PASS	4002	80
`sp43`	PASS	9	34
`sp44`	PASS	181	635
`sp45`	PASS	2002	22
`sp46`	PASS	1002	20
`sp47`	PASS	2	10
`sp48`	PASS	503	1555
`sp49`	PASS	2	6
`sp50`	PASS	9001	83
`sp51`	PASS	2	7
`sp52`	PASS	2	6
`sp53`	PASS	2	6
`sp54`	PASS	4696	15994
`sp55`	PASS	2	6
`sp56`	PASS	2	7
`sp57`	PASS	1002	15
`sp58`	PASS	1	5
`sp59`	PASS	2002	21
`sp60`	PASS	1002	13
`sp62`	PASS	2042	27
`sp63`	PASS	1213	3845
`sp64`	PASS	2	7
`sp65`	PASS	1022	14
`sp66`	PASS	1022	15
`sp67`	PASS	252	11
`sp68`	PASS	492	24
`sp70`	PASS	3	12
`sp71`	PASS	492	1557
`sp72`	PASS	1002	12
`sp73`	PASS	15000	100
`sp74`	PASS	2	6
`sp75`	PASS	1	5
`sp76`	PASS	2	6
`sp77`	PASS	1	5
`spassoc01`	PASS	4	12
`spatomic01`	PASS	2	6
`spcache01`	PASS	7	20
`spcbssched01`	PASS	34998	227
`spcbssched02`	PASS	2602	3923
`spcbssched03`	PASS	16840	46277
`spchain`	PASS	12	9
`spclock_err01`	PASS	4	12
`spclock_err02`	PASS	5001	42
`spclock_todhook01`	PASS	2	6
`spconfig01`	PASS	1	5
`spconfig02`	PASS	3	10
`spconsole01`	PASS	3091	121
`spcontext01`	FAIL	7999	20367
`spcoverage`	PASS	1	5
`spcpucounter01`	PASS	54	153
`spcpuset01`	PASS	33	82
`spedfsched01`	PASS	34998	226
`spedfsched02`	PASS	20041	354
`spedfsched03`	PASS	16840	43691
`sperror01`	PASS	2	7
`sperror02`	PASS	2	6
`sperror03`	PASS	1	6
`spevent_err03`	PASS	4002	32
`speventsystem01`	PASS	11	6
`speventtransient01`	PASS	12	6
`spextensions01`	PASS	2	7
`spfatal01`	PASS	1	5
`spfatal02`	PASS	1	5
`spfatal03`	PASS	2	6
`spfatal04`	PASS	1	5
`spfatal05`	PASS	1	6
`spfatal06`	PASS	0	2
`spfatal09`	FAIL	0	0
`spfatal10`	PASS	2	6
`spfatal11`	PASS	2	6
`spfatal12`	FAIL	0	1
`spfatal14`	PASS	1	5
`spfatal15`	PASS	1	5
`spfatal24`	PASS	1	6
`spfatal25`	PASS	1	5
`spfatal26`	PASS	1	5
`spfatal28`	PASS	1	5
`spfatal29`	PASS	11	6
`spfatal30`	FAIL	1	5
`spfatal31`	FAIL	21	5
`spfatal32`	PASS	1	5
`spfifo01`	PASS	2	6
`spfifo02`	PASS	8	25
`spfifo03`	PASS	2042	25
`spfifo04`	PASS	2	8
`spfifo05`	PASS	4	13
`spfreechain01`	PASS	2	6
`spglobalcon02`	PASS	1	5
`spheapprot`	PASS	1	5
`spinternalerror01`	FAIL	0	0
`spinternalerror02`	PASS	6	17
`spintr_err01`	PASS	2	6
`splinkersets01`	PASS	1	5
`spmisc01`	PASS	1	5
`spmkdir`	PASS	6	19
`spmountmgr01`	PASS	3	9
`spmrsp01`	FAIL	11	8
`spmsgq_err01`	PASS	3003	31
`spmsgq_err02`	PASS	4	12
`spmutex01`	PASS	85	21
`spnsext01`	FAIL	301	864
`spobjgetnext`	PASS	2	6
`sppagesize`	PASS	1	5
`sppartition_err01`	PASS	3	10
`sppercpudata01`	PASS	1	5
`spport_err01`	PASS	2	7
`spprintk`	PASS	4	13
`spprivenv01`	PASS	1022	15
`spprofiling01`	PASS	32	6
`spqreslib`	PASS	12102	11118
`spratemon_err01`	PASS	2002	34
`sprbtree01`	PASS	6755	20709
`spregion_err01`	PASS	3003	31
`spscheduler01`	PASS	2	9
`spsem01`	PASS	2	9
`spsem02`	PASS	3	10
`spsem03`	PASS	2	6
`spsem_err01`	PASS	3	10
`spsem_err02`	PASS	3002	28
`spsignal_err01`	PASS	2	6
`spsimplesched01`	PASS	34998	227
`spsimplesched02`	PASS	2	8
`spsimplesched03`	PASS	1	6
`spsize`	PASS	3	10
`spstdthreads01`	PASS	102	9
`spstkalloc`	PASS	2	6
`spstkalloc02`	PASS	2	8
`spstkalloc03`	PASS	2	6
`spstkalloc04`	PASS	2	6
`spsysinit01`	PASS	4	13
`spsyslock01`	PASS	162	13
`sptask_err01`	PASS	2	7
`sptask_err02`	PASS	6001	50
`sptask_err03`	PASS	3	10
`sptask_err04`	PASS	3	10
`sptasknopreempt01`	PASS	2	6
`spthread01`	PASS	12	6
`spthreadlife01`	PASS	2	9
`spthreadq01`	PASS	2	7
`sptimecounter01`	FAIL	0	0
`sptimecounter03`	PASS	9991	29636
`sptimecounter04`	PASS	2002	17
`sptimer_err01`	PASS	3	10
`sptimer_err02`	PASS	3	10
`sptimerserver01`	PASS	1102	14
`sptimespec01`	PASS	2	7
`sptls01`	PASS	2	6
`sptls03`	PASS	1	5
`sptls04`	PASS	1	5
`spversion01`	PASS	2	6
`spwatchdog`	PASS	4001	34
`spwkspace`	PASS	2	7

RTEMS 5 fptests — GR712RC N=1¶

1/1 passed — 1 PASS · 0 FAIL · 0 TIMEOUT — pass rate 100.0 %

Per-test rows (1)

Test	Outcome	sim (ms)	host (ms)
`fptest01`	PASS	1	12

RTEMS 5 fptests — GR740 N=1¶

1/1 passed — 1 PASS · 0 FAIL · 0 TIMEOUT — pass rate 100.0 %

Per-test rows (1)

Test	Outcome	sim (ms)	host (ms)
`fptest01`	PASS	1	6

RTEMS 5 smptests — GR712RC N=2 (SMP)¶

42/54 passed — 42 PASS · 9 FAIL · 3 TIMEOUT — pass rate 77.8 %

Per-test rows (54)

Test	Outcome	sim (ms)	host (ms)
`smp01`	PASS	200	483
`smp02`	PASS	50	142
`smp03`	PASS	100	179
`smp05`	PASS	50	128
`smp07`	PASS	2050	3151
`smp08`	PASS	40050	635
`smp09`	PASS	300	526
`smpaffinity01`	PASS	50	126
`smpatomic01`	PASS	8050	26338
`smpcache01`	PASS	50	101
`smpcapture01`	PASS	50	91
`smpcapture02`	PASS	50	103
`smpfatal01`	PASS	50	157
`smpfatal02`	PASS	50	150
`smpfatal03`	PASS	16	11
`smpfatal04`	PASS	1	1
`smpfatal05`	PASS	50	80
`smpfatal06`	PASS	50	95
`smpfatal08`	PASS	50	73
`smpfatal09`	FAIL	0	0
`smpipi01`	PASS	400	810
`smpload01`	PASS	30061	96368
`smplock01`	PASS	19050	55861
`smpmigration01`	PASS	10050	32037
`smpmigration02`	FAIL	631	1656
`smpmrsp01`	FAIL	32681	102606
`smpmulticast01`	FAIL	2365	6197
`smpmutex01`	PASS	500	286
`smpmutex02`	FAIL	160	456
`smppsxaffinity01`	PASS	50	86
`smppsxaffinity02`	PASS	50	113
`smppsxmutex01`	PASS	50	86
`smppsxsignal01`	PASS	50	87
`smpschedaffinity01`	PASS	1050	1419
`smpschedaffinity02`	FAIL	1060	2810
`smpschedaffinity03`	PASS	2050	2772
`smpschedaffinity04`	PASS	2050	5656
`smpschedaffinity05`	PASS	50	86
`smpschededf01`	PASS	3847	4998
`smpschededf02`	PASS	100	148
`smpschededf03`	TIMEOUT	43250	120107
`smpschededf04`	PASS	7	11
`smpschedsem01`	PASS	7	11
`smpscheduler01`	PASS	50	134
`smpscheduler02`	PASS	50	64
`smpscheduler03`	PASS	10	16
`smpscheduler04`	FAIL	10366	14603
`smpsignal01`	PASS	50	86
`smpstrongapa01`	PASS	50	87
`smpswitchextension01`	TIMEOUT	42350	120077
`smpthreadlife01`	TIMEOUT	60000	430
`smpthreadpin01`	FAIL	362	792
`smpunsupported01`	PASS	50	86
`smpwakeafter01`	FAIL	10388	6947

RTEMS 5 smptests — GR740 N=4 (SMP)¶

40/54 passed — 40 PASS · 8 FAIL · 6 TIMEOUT — pass rate 74.1 %

Per-test rows (54)

Test	Outcome	sim (ms)	host (ms)
`smp01`	PASS	750	1219
`smp02`	PASS	100	273
`smp03`	PASS	250	311
`smp05`	PASS	50	66
`smp07`	PASS	2051	1379
`smp08`	PASS	40050	701
`smp09`	PASS	650	609
`smpaffinity01`	PASS	100	216
`smpatomic01`	PASS	8100	23356
`smpcache01`	PASS	100	166
`smpcapture01`	PASS	700	1141
`smpcapture02`	PASS	100	167
`smpfatal01`	PASS	100	262
`smpfatal02`	PASS	100	263
`smpfatal03`	PASS	22	10
`smpfatal04`	PASS	2	1
`smpfatal05`	PASS	50	34
`smpfatal06`	PASS	50	64
`smpfatal08`	PASS	50	33
`smpfatal09`	FAIL	1	0
`smpipi01`	PASS	1150	1187
`smpload01`	FAIL	1301	4021
`smplock01`	PASS	31100	90251
`smpmigration01`	PASS	10100	15017
`smpmigration02`	FAIL	950	1288
`smpmrsp01`	FAIL	19598	60040
`smpmulticast01`	FAIL	4757	11995
`smpmutex01`	PASS	500	183
`smpmutex02`	FAIL	996	2711
`smppsxaffinity01`	PASS	100	160
`smppsxaffinity02`	PASS	100	219
`smppsxmutex01`	PASS	50	65
`smppsxsignal01`	PASS	50	65
`smpschedaffinity01`	PASS	1050	800
`smpschedaffinity02`	PASS	1750	2163
`smpschedaffinity03`	PASS	4053	2817
`smpschedaffinity04`	PASS	4053	5734
`smpschedaffinity05`	TIMEOUT	40950	120133
`smpschededf01`	PASS	5977	2692
`smpschededf02`	TIMEOUT	60000	47956
`smpschededf03`	TIMEOUT	39950	120060
`smpschededf04`	PASS	50	94
`smpschedsem01`	PASS	15	11
`smpscheduler01`	PASS	50	68
`smpscheduler02`	PASS	100	90
`smpscheduler03`	PASS	21	16
`smpscheduler04`	TIMEOUT	60000	79183
`smpsignal01`	PASS	100	98
`smpstrongapa01`	PASS	100	175
`smpswitchextension01`	TIMEOUT	60000	92969
`smpthreadlife01`	TIMEOUT	60000	381
`smpthreadpin01`	FAIL	742	544
`smpunsupported01`	PASS	50	64
`smpwakeafter01`	FAIL	1015	1732