Tests Report for ut-extended

Date: 2022-11-08 13:55

Jenkins job: https://jenkins.aws.isc.org/job/kea-dev/job/ut-extended

Analyzed last 100 builds

Last build: 836, 2022-08-11 09:49 (0 days ago)

Failures History

Total & Passed History

Regressions

No Test Name Instability
last 5, previous 20 (6-25), earlier builds		 Comments

Failures

No Test Name Last Build 836 Result Last Success Build Instability
last 5, previous 20 (6-25), earlier builds		 Comments
1 run tests-debian-9-amd64-debian-9-amd64 results-PgSqlBasicsTest.ptimeTimestamp 836 latest 0/5 0/20 0/71 kea#2309
2 run tests-fedora-34-amd64-fedora-34-amd64 results-keactrl.version-command 836 latest 0/5 0/20 0/72 # error while loading shared libraries: libsysrepo.so.5: cannot open shared object file: No such file or directory
3 run tests-fedora-34-amd64-fedora-34-amd64 results-netconf.version 836 latest 0/5 0/20 0/72 # error while loading shared libraries: libsysrepo.so.5: cannot open shared object file: No such file or directory

Fixes

No Test Name Instability
last 5, previous 20 (6-25), earlier builds		 Comments

Passes

No Test Name Last Build 836 Result Last Fail Build Instability
last 5, previous 20 (6-25), earlier builds		 Comments
1 run tests-alpine-3.13-amd64-alpine-3.13-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/65
2 run tests-alpine-3.13-amd64-alpine-3.13-amd64 results-MySqlSecureConnectionTest.Tcp 836 latest 830 0/5 1/20 0/65 kea#2353 + rebuild image: MySQL doesn't listen on TCP 3306 on Alpine.
3 run tests-alpine-3.13-amd64-alpine-3.13-amd64 results-mysql.db-version-with-extra 833 830 1/5 0/20 0/62 kea#2353 + rebuild image: MySQL doesn't listen on TCP 3306 on Alpine.
4 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-Dhcpv4SrvTest.checkConfigFiles 836 latest 833 1/5 0/12
5 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-Dhcpv6SrvTest.checkConfigFiles 836 latest 833 1/5 0/12
6 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-HostTest.conflictResolutionReuseExpired 836 latest 804 0/5 0/20 2/56
7 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-MySqlSecureConnectionTest.Tcp 836 latest 830 0/5 1/20 0/56
8 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-MySqlSecureConnectionTest.Tls 836 latest 830 0/5 1/20 0/56
9 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-MySqlTest.tls 836 latest 830 0/5 1/20 0/56
10 run tests-alpine-3.14-amd64-alpine-3.14-amd64 results-mysql.db-version-with-extra 833 830 1/5 0/20 0/53
11 run tests-alpine-3.15-amd64-alpine-3.15-amd64 results-HttpsClientTest.unreachableMultiThreading 836 latest 805 0/5 0/20 2/53
12 run tests-alpine-3.15-amd64-alpine-3.15-amd64 results-MySqlSecureConnectionTest.Tcp 836 latest 830 0/5 1/20 0/53
13 run tests-alpine-3.15-amd64-alpine-3.15-amd64 results-mysql.db-version-with-extra 833 830 1/5 0/20 0/50
14 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-CommandCreatorTest.createLease6BulkApply 836 latest 778 0/5 0/20 2/53
15 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-Dhcpv4SrvTest.checkConfigFiles 836 latest 833 1/5 0/12
16 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-Dhcpv6SrvTest.checkConfigFiles 836 latest 833 1/5 0/12
17 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-HttpsClientTest.unreachableMultiThreading 836 latest 829 0/5 2/20 0/53
18 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-MySqlSecureConnectionTest.Tcp 836 latest 830 0/5 1/20 0/53
19 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-MySqlSecureConnectionTest.Tls 836 latest 830 0/5 1/20 0/53
20 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-MySqlTest.tls 836 latest 830 0/5 1/20 0/53
21 run tests-alpine-3.16-amd64-alpine-3.16-amd64 results-mysql.db-version-with-extra 833 830 1/5 0/20 0/50
22 run tests-centos-7-amd64-centos-7-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/71
23 run tests-centos-7-amd64-centos-7-amd64 results-MemfileLeaseMgrTest.leaseFileCleanup4 836 latest 738 0/5 0/20 2/71
24 run tests-centos-7-amd64-centos-7-amd64 results-MemfileLeaseMgrTest.leaseFileCleanup6 836 latest 738 0/5 0/20 2/71
25 run tests-centos-7-amd64-centos-7-amd64 results-MemfileLeaseMgrTest.leaseFileCopy 836 latest 738 0/5 0/20 2/71
26 run tests-centos-7-amd64-centos-7-amd64 results-MemfileLeaseMgrTest.leaseFileFinish 836 latest 738 0/5 0/20 2/71
27 run tests-centos-7-amd64-centos-7-amd64 results-MemfileLeaseMgrTest.leaseUpgrade4 836 latest 738 0/5 0/20 2/71
28 run tests-centos-7-amd64-centos-7-amd64 results-RequestSyncTest.noAuthServer 836 latest 815 0/5 2/20 0/71
29 run tests-debian-10-amd64-debian-10-amd64 results-AllocEngine6Test.reservedAddressInPoolReassignedOther 836 latest 756 0/5 0/20 2/71
30 run tests-debian-10-amd64-debian-10-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/71
31 run tests-debian-10-amd64-debian-10-amd64 results-MySqlTest.timestamps 836 latest 752 0/5 0/20 2/71
32 run tests-debian-10-amd64-debian-10-amd64 results-UniformRandomIntegerGeneratorTest.IntegerRange 836 latest 825 0/5 2/20 0/71
33 run tests-debian-11-amd64-debian-11-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/69
34 run tests-debian-11-amd64-debian-11-amd64 results-LeaseQueryImpl6ProcessTest.makeClientOptionSingleLink 836 latest 793 0/5 0/20 2/69
35 run tests-debian-9-amd64-debian-9-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/71
36 run tests-fedora-34-amd64-fedora-34-amd64 results-Dhcpv6SrvTest.RequestCache 836 latest 767 0/5 0/20 2/72
37 run tests-fedora-34-amd64-fedora-34-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/72
38 run tests-fedora-36-amd64-fedora-36-amd64 results-AllocEngine6Test.renewCacheThreshold6 836 latest 790 0/5 0/20 2/71
39 run tests-fedora-36-amd64-fedora-36-amd64 results-HAConfigTest.badCertFile 836 latest 766 0/5 0/20 1/71
40 run tests-fedora-36-amd64-fedora-36-amd64 results-HAConfigTest.badKeyFile 836 latest 766 0/5 0/20 1/71
41 run tests-fedora-36-amd64-fedora-36-amd64 results-HAConfigTest.badTrustAnchor 836 latest 766 0/5 0/20 1/71
42 run tests-fedora-36-amd64-fedora-36-amd64 results-HostTest.conflictResolutionReuseExpired 836 latest 795 0/5 0/20 2/71
43 run tests-fedora-36-amd64-fedora-36-amd64 results-TLSTest.configureError 836 latest 766 0/5 0/20 1/71
44 run tests-fedora-36-amd64-fedora-36-amd64 results-TLSTest.loadCertKeyFile 836 latest 766 0/5 0/20 1/71
45 run tests-fedora-36-amd64-fedora-36-amd64 results-TLSTest.loadNoCAFile 836 latest 766 0/5 0/20 1/71
46 run tests-fedora-36-amd64-fedora-36-amd64 results-TLSTest.loadNoCertFile 836 latest 766 0/5 0/20 1/71
47 run tests-fedora-36-amd64-fedora-36-amd64 results-TLSTest.loadNoKeyFile 836 latest 766 0/5 0/20 1/71
48 run tests-fedora-36-amd64-fedora-36-amd64 results-UniformRandomIntegerGeneratorTest.IntegerRange 836 latest 782 0/5 0/20 2/71
49 run tests-rhel-8-amd64-rhel-8-amd64 results-Dhcpv4SrvTest.checkConfigFiles 836 latest 833 1/5 0/14
50 run tests-rhel-8-amd64-rhel-8-amd64 results-Dhcpv6SrvTest.checkConfigFiles 836 latest 833 1/5 0/14
51 run tests-rhel-8-amd64-rhel-8-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/73
52 run tests-ubuntu-18.04-amd64-ubuntu-18.04-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/69
53 run tests-ubuntu-20.04-amd64-ubuntu-20.04-amd64 results-FormatterTest.mismatchedPlaceholders 836 latest 735 0/5 0/20 1/68
54 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-HAConfigTest.badCertFile 836 latest 766 0/5 0/20 1/46
55 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-HAConfigTest.badKeyFile 836 latest 766 0/5 0/20 1/46
56 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-HAConfigTest.badTrustAnchor 836 latest 766 0/5 0/20 1/46
57 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-TLSTest.configureError 836 latest 766 0/5 0/20 1/46
58 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-TLSTest.loadCertKeyFile 836 latest 766 0/5 0/20 1/46
59 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-TLSTest.loadNoCAFile 836 latest 766 0/5 0/20 1/46
60 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-TLSTest.loadNoCertFile 836 latest 766 0/5 0/20 1/46
61 run tests-ubuntu-22.04-amd64-ubuntu-22.04-amd64 results-TLSTest.loadNoKeyFile 836 latest 766 0/5 0/20 1/46

Tests that are mentioned in the spreadsheet, but don't exist or are not failing:
2: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Decline: # RADIUS
3: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Expire: # RADIUS
4: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Release: # RADIUS
5: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Renew: # RADIUS
6: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease4Select: # RADIUS
7: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Decline: # RADIUS
8: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Expire: # RADIUS
9: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Release: # RADIUS
10: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Renew: # RADIUS
11: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-AccountingTest.lease6Select: # RADIUS
12: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentLogTest.checkModule: # NETCONF
13: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentLogTest.checkModules: # NETCONF
14: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentLogTest.logChanges: # NETCONF
15: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentLogTest.logChanges2: # NETCONF
16: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentTest.initSysrepo: # NETCONF
17: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentTest.noValidate: # NETCONF
18: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentTest.subscribeConfig: # NETCONF
19: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentTest.update: # NETCONF
20: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentTest.validate: # NETCONF
21: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfAgentTest.yangConfig: # NETCONF
22: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfControllerTest.launchNormalShutdown: # NETCONF
23: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfControllerTest.sigintShutdown: # NETCONF
24: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfControllerTest.sigtermShutdown: # NETCONF
25: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-NetconfProcessTest.shutdown: # NETCONF
26: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.badResponse: # RADIUS
27: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.noAcctResponse: # RADIUS
28: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.noAcctServer: # RADIUS
29: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.response: # RADIUS
30: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.response2: # RADIUS
31: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestAsyncTest.shortAcct: # RADIUS
32: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.badResponse: # RADIUS
33: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.noAcctResponse: # RADIUS
34: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.noAcctServer: # RADIUS
35: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.response: # RADIUS
36: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.response2: # RADIUS
37: run tests-freebsd-12.1-amd64-freebsd-12.1-amd64 results-RequestSyncTest.shortAcct: # RADIUS
38: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Decline: # RADIUS
39: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Expire: # RADIUS
40: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Release: # RADIUS
41: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Renew: # RADIUS
42: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease4Select: # RADIUS
43: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Decline: # RADIUS
44: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Expire: # RADIUS
45: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Release: # RADIUS
46: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Renew: # RADIUS
47: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-AccountingTest.lease6Select: # RADIUS
48: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentLogTest.checkModule: # NETCONF
49: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentLogTest.checkModules: # NETCONF
50: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentLogTest.logChanges: # NETCONF
51: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentLogTest.logChanges2: # NETCONF
52: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentTest.initSysrepo: # NETCONF
53: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentTest.noValidate: # NETCONF
54: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentTest.subscribeConfig: # NETCONF
55: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentTest.update: # NETCONF
56: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentTest.validate: # NETCONF
57: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfAgentTest.yangConfig: # NETCONF
58: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfControllerTest.launchNormalShutdown: # NETCONF
59: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfControllerTest.sigintShutdown: # NETCONF
60: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfControllerTest.sigtermShutdown: # NETCONF
61: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-NetconfProcessTest.shutdown: # NETCONF
62: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.badResponse: # RADIUS
63: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.noAcctResponse: # RADIUS
64: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.noAcctServer: # RADIUS
65: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.response: # RADIUS
66: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.response2: # RADIUS
67: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestAsyncTest.shortAcct: # RADIUS
68: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.badResponse: # RADIUS
69: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.noAcctResponse: # RADIUS
70: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.noAcctServer: # RADIUS
71: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.response: # RADIUS
72: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.response2: # RADIUS
73: run tests-freebsd-13.0-amd64-freebsd-13.0-amd64 results-RequestSyncTest.shortAcct: # RADIUS
74: run tests-alpine-3.12-amd64-alpine-3.12-amd64 results-MySqlSecureConnectionTest.Tcp: kea#2353 + rebuild image: MySQL doesn't listen on TCP 3306 on Alpine.
75: run tests-alpine-3.12-amd64-alpine-3.12-amd64 results-mysql.db-version-with-extra: kea#2353 + rebuild image: MySQL doesn't listen on TCP 3306 on Alpine.
79: run tests-fedora-33-amd64-fedora-33-amd64 results-keactrl.version-command: # error while loading shared libraries: libsysrepo.so.5: cannot open shared object file: No such file or directory
80: run tests-fedora-33-amd64-fedora-33-amd64 results-netconf.version: # error while loading shared libraries: libsysrepo.so.5: cannot open shared object file: No such file or directory