Tests Report for ut-extended

Date: 2022-03-12 09:56

Jenkins job: https://jenkins.aws.isc.org/job/kea-dev/job/ut-extended

Analyzed last 100 builds

Last build: 932, 2022-12-03 01:27 (0 days ago)

Failures History

Total & Passed History

Regressions

No Test Name Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-BulkLeaseQuery6ProcessTest.byRelayIdNoLink 1/5 0/19

Failures

No Test Name Last Build 932 Result Last Success Build Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-BulkLeaseQuery6ProcessTest.byRelayIdNoLink 932 latest 931 1/5 0/19
2 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-NetconfControllerTest.commandLineArgs 932 latest 916 0/5 1/20 0/69
3 run tests-alpine-3.15-amd64-alpine-3.15-amd64 results-NetconfControllerTest.commandLineArgs 932 latest 916 0/5 1/20 0/69
4 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-NetconfControllerTest.commandLineArgs 932 latest 916 0/5 1/20 0/69
5 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-MySqlConfigBackendDHCPv6Test.globalOptions6WithServerTagsTest 932 latest 0/5 0/20 0/30
6 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-MySqlConfigBackendDHCPv6Test.unassignedSharedNetworkTest 932 latest 0/5 0/20 0/30
7 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-MySqlConfigBackendDHCPv6Test.unassignedSubnet6Test 932 latest 0/5 0/20 0/30
8 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Decline 932 latest 0/5 0/20 0/30 # RADIUS
9 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Expire 932 latest 0/5 0/20 0/30 # RADIUS
10 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Release 932 latest 0/5 0/20 0/30 # RADIUS
11 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Renew 932 latest 0/5 0/20 0/30 # RADIUS
12 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Select 932 latest 0/5 0/20 0/30 # RADIUS
13 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Decline 932 latest 0/5 0/20 0/30 # RADIUS
14 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Expire 932 latest 0/5 0/20 0/30 # RADIUS
15 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Release 932 latest 0/5 0/20 0/30 # RADIUS
16 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Renew 932 latest 0/5 0/20 0/30 # RADIUS
17 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Select 932 latest 0/5 0/20 0/30 # RADIUS
18 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.badResponse 932 latest 0/5 0/20 0/30 # RADIUS
19 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.noAcctResponse 932 latest 0/5 0/20 0/30 # RADIUS
20 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.noAcctServer 932 latest 0/5 0/20 0/30 # RADIUS
21 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.response 932 latest 0/5 0/20 0/30 # RADIUS
22 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.response2 932 latest 0/5 0/20 0/30 # RADIUS
23 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.shortAcct 932 latest 0/5 0/20 0/30 # RADIUS
24 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.badResponse 932 latest 0/5 0/20 0/30 # RADIUS
25 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.noAcctResponse 932 latest 0/5 0/20 0/30 # RADIUS
26 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.noAcctServer 932 latest 0/5 0/20 0/30 # RADIUS
27 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.response 932 latest 0/5 0/20 0/30 # RADIUS
28 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.response2 932 latest 0/5 0/20 0/30 # RADIUS
29 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.shortAcct 932 latest 0/5 0/20 0/30 # RADIUS
30 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Decline 931 0/5 0/20 0/18 # RADIUS
31 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Expire 931 0/5 0/20 0/18 # RADIUS
32 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Release 931 0/5 0/20 0/18 # RADIUS
33 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Renew 931 0/5 0/20 0/18 # RADIUS
34 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Select 931 0/5 0/20 0/18 # RADIUS
35 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Decline 931 0/5 0/20 0/18 # RADIUS
36 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Expire 931 0/5 0/20 0/18 # RADIUS
37 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Release 931 0/5 0/20 0/18 # RADIUS
38 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Renew 931 0/5 0/20 0/18 # RADIUS
39 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Select 931 0/5 0/20 0/18 # RADIUS
40 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.badResponse 931 0/5 0/20 0/18 # RADIUS
41 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.noAcctResponse 931 0/5 0/20 0/18 # RADIUS
42 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.noAcctServer 931 0/5 0/20 0/18 # RADIUS
43 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.response 931 0/5 0/20 0/18 # RADIUS
44 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.response2 931 0/5 0/20 0/18 # RADIUS
45 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.shortAcct 931 0/5 0/20 0/18 # RADIUS
46 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.badResponse 931 0/5 0/20 0/18 # RADIUS
47 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.noAcctResponse 931 0/5 0/20 0/18 # RADIUS
48 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.noAcctServer 931 0/5 0/20 0/18 # RADIUS
49 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.response 931 0/5 0/20 0/18 # RADIUS
50 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.response2 931 0/5 0/20 0/18 # RADIUS
51 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.shortAcct 931 0/5 0/20 0/18 # RADIUS

Fixes

No Test Name Instability
last 5, previous 20 (6-25), earlier builds
Comments

Passes

No Test Name Last Build 932 Result Last Fail Build Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/69
2 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-Dhcpv4SrvTest.checkConfigFiles 932 latest 833 0/5 0/20 1/69
3 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-Dhcpv6SrvTest.checkConfigFiles 932 latest 833 0/5 0/20 1/69
4 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-NetconfGetCfgTest.simple 932 latest 921 0/5 2/20 0/69
5 run tests-alpine-3.15-amd64-alpine-3.15-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/69
6 run tests-alpine-3.15-amd64-alpine-3.15-amd64 results-HttpClientTest.unreachable 932 latest 882 0/5 0/20 2/69
7 run tests-alpine-3.15-amd64-alpine-3.15-amd64 results-NetconfGetCfgTest.simple 932 latest 921 0/5 2/20 0/69
8 run tests-alpine-3.15-amd64-alpine-3.15-amd64 results-UniformRandomIntegerGeneratorTest.IntegerRange 932 latest 906 0/5 2/20 0/69
9 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/69
10 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-Dhcpv4SrvTest.checkConfigFiles 932 latest 833 0/5 0/20 1/69
11 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-Dhcpv6SrvTest.checkConfigFiles 932 latest 833 0/5 0/20 1/69
12 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-HttpClientTest.unreachable 932 latest 849 0/5 0/20 2/69
13 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-HttpsClientTest.unreachable 932 latest 921 0/5 2/20 0/69
14 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-HttpsClientTest.unreachableMultiThreading 932 latest 844 0/5 0/20 2/69
15 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-NetconfGetCfgTest.simple 932 latest 921 0/5 2/20 0/69
16 run tests-centos-7-amd64-centos-7-amd64 results-BulkLeaseQuery6ProcessTest.byRemoteIdNoLink 932 latest 913 0/5 2/17
17 run tests-centos-7-amd64-centos-7-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/33
18 run tests-debian-10-amd64-debian-10-amd64 results-BulkLeaseQuery6ProcessTest.byLinkAddressLink1 932 latest 918 0/5 2/17
19 run tests-debian-10-amd64-debian-10-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/67
20 run tests-debian-10-amd64-debian-10-amd64 results-FqdnDhcpv6SrvTest.processRequestRenewFqdnFlags 932 latest 890 0/5 0/20 2/67
21 run tests-debian-11-amd64-debian-11-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/69
22 run tests-fedora-36-amd64-fedora-36-amd64 results-BulkLeaseQuery6ProcessTest.byRemoteIdNoLink1 932 latest 930 2/5 0/11
23 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/30
24 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-HAServiceTest.communicationRecoveryFailed6PartnerLoadBalancing 932 latest 901 0/5 1/20 1/30
25 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-HttpClientTest.clientRequestLateStartQueue 932 latest 880 0/5 0/20 2/30
26 run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-keactrl.start_all_servers_no_verbose_test 932 latest 884 0/5 0/20 1/30
27 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-Dhcpv6SrvTest.pdRenewCache 931 889 0/5 1/20 1/18
28 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NameChangeUDPTest.roundTripTest 931 894 0/5 2/20 0/18
29 run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-keactrl.start_all_servers_no_verbose_test 931 884 0/5 0/20 1/18
30 run tests-rhel-8-amd64-rhel-8-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/67
31 run tests-rhel-8-amd64-rhel-8-amd64 results-Dhcpv4SrvTest.checkConfigFiles 932 latest 833 0/5 0/20 1/67
32 run tests-rhel-8-amd64-rhel-8-amd64 results-Dhcpv6SrvTest.checkConfigFiles 932 latest 833 0/5 0/20 1/67
33 run tests-rhel-8-amd64-rhel-8-amd64 results-Dhcpv6SrvTest.pdRequestCache 932 latest 878 0/5 0/20 2/67
34 run tests-rhel-9-amd64-rhel-9-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/30
35 run tests-rhel-9-amd64-rhel-9-amd64 results-FqdnDhcpv6SrvTest.processRequestRenewFqdnFlags 932 latest 925 0/5 2/20 0/30
36 run tests-rhel-9-amd64-rhel-9-amd64 results-NetconfGetCfgTest.simple 932 latest 921 0/5 2/20 0/17
37 run tests-rhel-9-amd64-rhel-9-amd64 results-keactrl.version-command 932 latest 884 0/5 0/20 1/30
38 run tests-rhel-9-amd64-rhel-9-amd64 results-netconf.version 932 latest 884 0/5 0/20 1/30
39 run tests-ubuntu-18.04-amd64-ubuntu-18.04-amd64 results-BulkLeaseQuery6ProcessTest.byRelayIdLink 932 latest 927 1/5 1/17
40 run tests-ubuntu-18.04-amd64-ubuntu-18.04-amd64 results-BulkLeaseQuery6ProcessTest.byRelayIdNoLink 932 latest 930 2/5 0/17
41 run tests-ubuntu-18.04-amd64-ubuntu-18.04-amd64 results-BulkLeaseQuery6ProcessTest.byRelayIdNoLink1 932 latest 926 0/5 2/17
42 run tests-ubuntu-18.04-amd64-ubuntu-18.04-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/67
43 run tests-ubuntu-20.04-amd64-ubuntu-20.04-amd64 results-BulkLeaseQuery6ProcessTest.byRemoteIdNoLink1 932 latest 918 0/5 2/17
44 run tests-ubuntu-20.04-amd64-ubuntu-20.04-amd64 results-BulkLeaseQuery6ProcessTest.queryByClientIdActiveLeases 932 latest 930 2/5 0/17
45 run tests-ubuntu-20.04-amd64-ubuntu-20.04-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/67
46 run tests-ubuntu-20.04-amd64-ubuntu-20.04-amd64 results-FqdnDhcpv6SrvTest.processRequestRenewDiffFqdn 932 latest 863 0/5 0/20 2/67
47 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-AllocEngine6Test.reservedAddressInPoolReassignedThis 932 latest 924 0/5 2/20 0/69
48 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-BulkLeaseQuery6ProcessTest.byRelayIdNoLink 932 latest 924 0/5 2/19
49 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-CtrlAgentGetCfgTest.simple 932 latest 921 0/5 2/20 0/69
50 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-NetconfGetCfgTest.simple 932 latest 921 0/5 2/20 0/69

Tests that are mentioned in the spreadsheet, but don't exist or are not failing: