Tests Report for tarball-system-tests

Date: 2022-11-08 13:43

Jenkins job: https://jenkins.aws.isc.org/job/kea-dev/job/tarball-system-tests

Analyzed last 100 builds

Last build: 653, 2022-08-11 09:24 (0 days ago)

Failures History

Total & Passed History

Regressions

No Test Name Instability
last 5, previous 20 (6-25), earlier builds		 Comments
1 run tests-fedora-34-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-postgresql] 2/5 11/18
2 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_access_by_name_removed_file_2 2/5 9/17
3 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-multiple-subnets-memfile] 1/5 6/20 30/73
4 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-multiple-subnets-mysql] 2/5 5/20 20/73
5 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-network-postgresql] 1/5 7/20 23/73
6 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-network-postgresql] 1/5 8/20 10/73
7 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-other-subnet-network] 3/5 7/20 32/73
8 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-subnet-network] 1/5 9/20 21/73
9 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_no_attributes[v4] 3/5 6/20 30/73
10 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-postgresql] 3/5 11/18

Failures

No Test Name Last Build 653 Result Last Success Build Instability
last 5, previous 20 (6-25), earlier builds		 Comments
1 run tests-fedora-34-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-postgresql] 653 latest 652 2/5 11/18
2 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_access_by_name_removed_file_2 653 latest 652 2/5 9/17
3 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-multiple-subnets-memfile] 653 latest 652 1/5 6/20 30/73
4 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-multiple-subnets-mysql] 653 latest 652 2/5 5/20 20/73
5 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-network-postgresql] 653 latest 652 1/5 7/20 23/73
6 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-network-postgresql] 653 latest 652 1/5 8/20 10/73
7 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-subnet-network] 653 latest 652 1/5 9/20 21/73
8 run tests-fedora-34-v4-tests.dhcp.v4.test_statistics.test_stats_basic 653 latest 619 0/5 0/20 1/73
9 run tests-ubuntu-20.04-v4-tests.dhcp.v4.test_statistics.test_stats_basic 653 latest 619 0/5 0/20 1/73
10 run tests-fedora-34-ddns-tests.ddns.test_ddns_sanitizer.test_ddns4_fqdn_sanitization_omit_identical_name 653 latest 571 0/5 0/20 1/74
11 run tests-fedora-34-ddns-tests.ddns.test_ddns_sanitizer.test_ddns4_hostname_sanitization_omit_identical_name 653 latest 571 0/5 0/20 1/74
12 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_sanitizer.test_ddns4_fqdn_sanitization_omit_identical_name 653 latest 571 0/5 0/20 1/74
13 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_sanitizer.test_ddns4_hostname_sanitization_omit_identical_name 653 latest 571 0/5 0/20 1/74
14 run tests-fedora-34-v4-tests.dhcp.test_logging.test_v4_loggers_all_different_levels_different_file 653 latest 0/5 0/20 0/73
15 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_gss_tsig.test_ddns4_gss_tsig_complex_scenario[system_domain1] 653 latest 0/5 0/20 0/74 wlodek
16 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_gss_tsig.test_ddns4_gss_tsig_complex_scenario[system_domain2] 653 latest 0/5 0/20 0/74 wlodek
17 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_gss_tsig.test_ddns_gss_tsig_manual_expiration[system_and_domain1] 653 latest 0/5 0/20 0/74 wlodek
18 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_gss_tsig.test_ddns_gss_tsig_manual_expiration[system_and_domain2] 653 latest 0/5 0/20 0/74 wlodek
19 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-other-subnet-network] 653 latest 652 3/5 7/20 32/73
20 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_no_attributes[v4] 653 latest 652 3/5 6/20 30/73
21 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-postgresql] 653 latest 652 3/5 11/18
22 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[MySQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
23 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[MySQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
24 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[PostgreSQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
25 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
26 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[MySQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
27 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[MySQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
28 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[PostgreSQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
29 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
30 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all[http] 653 latest 642 0/5 1/20 0/73 kea #2471
31 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all[socket] 653 latest 642 0/5 1/20 0/73 kea #2471
32 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[MySQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
33 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[MySQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
34 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[PostgreSQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
35 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
36 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[MySQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
37 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[MySQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
38 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[PostgreSQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
39 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
40 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[MySQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
41 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[MySQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
42 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[PostgreSQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
43 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
44 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all[http] 653 latest 642 0/5 1/20 0/74 kea #2471
45 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all[socket] 653 latest 642 0/5 1/20 0/74 kea #2471
46 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[MySQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
47 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[MySQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
48 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[PostgreSQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
49 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
50 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[MySQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
51 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[MySQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
52 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[PostgreSQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
53 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
54 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[MySQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
55 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[MySQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
56 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[PostgreSQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
57 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
58 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all[http] 653 latest 642 0/5 1/20 0/73 kea #2471
59 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all[socket] 653 latest 642 0/5 1/20 0/73 kea #2471
60 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[MySQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
61 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[MySQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
62 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[PostgreSQL-http] 653 latest 642 0/5 1/20 0/73 kea #2471
63 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/73 kea #2471
64 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[MySQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
65 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[MySQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
66 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[PostgreSQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
67 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
68 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[MySQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
69 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[MySQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
70 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[PostgreSQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
71 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
72 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all[http] 653 latest 642 0/5 1/20 0/74 kea #2471
73 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all[socket] 653 latest 642 0/5 1/20 0/74 kea #2471
74 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[MySQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
75 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[MySQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
76 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[PostgreSQL-http] 653 latest 642 0/5 1/20 0/74 kea #2471
77 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[PostgreSQL-socket] 653 latest 642 0/5 1/20 0/74 kea #2471
78 run tests-fedora-34-cb-tests.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4[mysql] 653 latest 0/5 0/20 0/74 kea #1600
79 run tests-fedora-34-cb-tests.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4[postgresql] 653 latest 0/5 0/20 0/74 kea #1600
80 run tests-fedora-34-cb-tests.config_backend.test_cb_v6_server_tag.test_server_tag_global_option[mysql] 653 latest 0/5 0/20 0/74 kea #1600
81 run tests-fedora-34-cb-tests.config_backend.test_cb_v6_server_tag.test_server_tag_global_option[postgresql] 653 latest 0/5 0/20 0/74 kea #1600
82 run tests-fedora-34-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_lease_get_negative 653 latest 0/5 0/20 0/73 kea #2060
83 run tests-fedora-34-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_siemens_defined_in_class 653 latest 0/5 0/20 0/73 kea #1683
84 run tests-fedora-34-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vivso_suboptions_siemens_defined_in_class 653 latest 0/5 0/20 0/73 kea #1683
85 run tests-fedora-34-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 653 latest 0/5 0/20 0/73 kea #1796
86 run tests-fedora-34-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 653 latest 0/5 0/20 0/73 kea #1796
87 run tests-fedora-34-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 653 latest 0/5 0/20 0/73 kea #1796
88 run tests-fedora-34-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 653 latest 0/5 0/20 0/74 kea #1796
89 run tests-fedora-34-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 653 latest 0/5 0/20 0/74 kea #1796
90 run tests-fedora-34-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 653 latest 0/5 0/20 0/74 kea #1796
91 run tests-ubuntu-20.04-cb-tests.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4[mysql] 653 latest 0/5 0/20 0/74 kea #1600
92 run tests-ubuntu-20.04-cb-tests.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4[postgresql] 653 latest 0/5 0/20 0/74 kea #1600
93 run tests-ubuntu-20.04-cb-tests.config_backend.test_cb_v6_server_tag.test_server_tag_global_option[mysql] 653 latest 0/5 0/20 0/74 kea #1600
94 run tests-ubuntu-20.04-cb-tests.config_backend.test_cb_v6_server_tag.test_server_tag_global_option[postgresql] 653 latest 0/5 0/20 0/74 kea #1600
95 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_lease_get_negative 653 latest 0/5 0/20 0/73 kea #2060
96 run tests-ubuntu-20.04-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_siemens_defined_in_class 653 latest 0/5 0/20 0/73 kea #1683
97 run tests-ubuntu-20.04-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vivso_suboptions_siemens_defined_in_class 653 latest 0/5 0/20 0/73 kea #1683
98 run tests-ubuntu-20.04-v4-tests.dhcp.test_logging.test_v4_loggers_all_different_levels_different_file 653 latest 0/5 0/20 0/73 kea #592
99 run tests-ubuntu-20.04-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 653 latest 0/5 0/20 0/73 kea #1796
100 run tests-ubuntu-20.04-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 653 latest 0/5 0/20 0/73 kea #1796
101 run tests-ubuntu-20.04-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 653 latest 0/5 0/20 0/73 kea #1796
102 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 653 latest 0/5 0/20 0/74 kea #1796
103 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 653 latest 0/5 0/20 0/74 kea #1796
104 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 653 latest 0/5 0/20 0/74 kea #1796

Fixes

No Test Name Instability
last 5, previous 20 (6-25), earlier builds		 Comments
1 run tests-fedora-34-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-mysql] 4/5 5/18
2 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_filter_responses 2/5 3/17
3 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-network-mysql] 2/5 8/20 28/73
4 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-multiple-subnets-memfile] 4/5 6/20 24/73
5 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-multiple-subnets-mysql] 2/5 4/20 20/73
6 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-network-mysql] 2/5 6/20 27/73
7 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-other-subnet-subnet] 2/5 10/20 24/73
8 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-subnet-network] 2/5 4/20 23/73
9 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-out-of-subnet-subnet] 2/5 8/20 24/73
10 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-out-of-subnet-network] 4/5 8/20 27/73
11 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-mysql] 3/5 9/18

Passes

No Test Name Last Build 653 Result Last Fail Build Instability
last 5, previous 20 (6-25), earlier builds		 Comments
1 run tests-fedora-34-ddns-tests.ddns.test_ddns6.test_ddns6_notsig_rev_Nflag_override_no_update 653 latest 565 0/5 0/20 1/74 logging issue in bind on fedora
2 run tests-fedora-34-ddns-tests.ddns.test_ddns6.test_ddns6_notsig_rev_success_withoutflag 653 latest 565 0/5 0/20 1/74 logging issue in bind on fedora
3 run tests-fedora-34-v4-tests.ca.test_rbac.test_rbac_cert_issuer 653 latest 635 0/5 1/17
4 run tests-fedora-34-v4-tests.ca.test_rbac.test_rbac_filter_responses 653 latest 635 0/5 1/17
5 run tests-fedora-34-v4-tests.ca.test_rbac.test_rbac_remote_address[False] 653 latest 635 0/5 1/17
6 run tests-fedora-34-v4-tests.ca.test_rbac.test_rbac_remote_address[True] 653 latest 635 0/5 1/17
7 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[MySQL-http] 653 latest 646 0/5 2/20 2/73
8 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[MySQL-socket] 653 latest 646 0/5 2/20 2/73
9 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[PostgreSQL-http] 653 latest 646 0/5 2/20 2/73
10 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[PostgreSQL-socket] 653 latest 646 0/5 2/20 2/73
11 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_by_hostname[http] 653 latest 616 0/5 0/20 2/73
12 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_by_hostname[socket] 653 latest 616 0/5 0/20 2/73
13 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_page[http] 653 latest 616 0/5 0/20 2/73
14 run tests-fedora-34-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_page[socket] 653 latest 616 0/5 0/20 2/73
15 run tests-fedora-34-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens 653 latest 565 0/5 0/20 1/73
16 run tests-fedora-34-v4-tests.dhcp.test_backend_migration.test_v4_lease_upload_duplicate[mysql] 653 latest 578 0/5 0/20 1/73 kea #2293
17 run tests-fedora-34-v4-tests.dhcp.test_backend_migration.test_v4_lease_upload_duplicate[postgresql] 653 latest 578 0/5 0/20 1/73 kea #2293
18 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[MySQL-http] 653 latest 646 0/5 2/20 2/74
19 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[MySQL-socket] 653 latest 646 0/5 2/20 2/74
20 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[PostgreSQL-http] 653 latest 646 0/5 2/20 2/74
21 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[PostgreSQL-socket] 653 latest 646 0/5 2/20 2/74
22 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_by_hostname[http] 653 latest 616 0/5 0/20 2/74
23 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_by_hostname[socket] 653 latest 616 0/5 0/20 2/74
24 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_page[http] 653 latest 616 0/5 0/20 2/74
25 run tests-fedora-34-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_page[socket] 653 latest 616 0/5 0/20 2/74
26 run tests-fedora-34-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-mysql] 653 latest 652 4/5 5/18
27 run tests-fedora-34-v6-tests.dhcp.hooks.test_radius.test_radius_framed_pool[v6-single-attribute] 653 latest 560 0/5 0/20 1/74
28 run tests-fedora-34-v6-tests.dhcp.test_backend_migration.test_v6_lease_upload_duplicate[mysql] 653 latest 578 0/5 0/20 1/74 kea #2293
29 run tests-fedora-34-v6-tests.dhcp.test_backend_migration.test_v6_lease_upload_duplicate[postgresql] 653 latest 578 0/5 0/20 1/74 kea #2293
30 run tests-fedora-34-v6-tests.dhcp.v6.test_multiple_ia.test_v6_multipleIA_addresses_release_success 653 latest 628 0/5 1/20 1/74
31 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_cert_issuer 653 latest 635 0/5 1/17
32 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_filter_responses 653 latest 652 2/5 3/17
33 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_remote_address[False] 653 latest 635 0/5 1/17
34 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_remote_address[True] 653 latest 635 0/5 1/17
35 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[MySQL-http] 653 latest 646 0/5 2/20 2/73
36 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[MySQL-socket] 653 latest 646 0/5 2/20 2/73
37 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[PostgreSQL-http] 653 latest 646 0/5 2/20 2/73
38 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[PostgreSQL-socket] 653 latest 646 0/5 2/20 2/73
39 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_by_hostname[http] 653 latest 616 0/5 0/20 2/73
40 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_by_hostname[socket] 653 latest 616 0/5 0/20 2/73
41 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_page[http] 653 latest 616 0/5 0/20 2/73
42 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_page[socket] 653 latest 616 0/5 0/20 2/73
43 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-multiple-subnets-postgresql] 653 latest 645 0/5 4/20 25/73
44 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-network-memfile] 653 latest 639 0/5 4/20 26/73
45 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-network-mysql] 653 latest 652 2/5 8/20 28/73
46 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-subnet-memfile] 653 latest 645 0/5 6/20 18/73
47 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-subnet-mysql] 653 latest 649 2/5 10/20 26/73
48 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-subnet-postgresql] 653 latest 641 0/5 4/20 26/73
49 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-multiple-subnets-memfile] 653 latest 652 4/5 6/20 24/73
50 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-multiple-subnets-mysql] 653 latest 652 2/5 4/20 20/73
51 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-multiple-subnets-postgresql] 653 latest 645 0/5 4/20 18/73
52 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-network-memfile] 653 latest 638 0/5 2/20 27/73
53 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-network-mysql] 653 latest 652 2/5 6/20 27/73
54 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-subnet-memfile] 653 latest 644 0/5 9/20 25/73
55 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-subnet-mysql] 653 latest 649 2/5 8/20 18/73
56 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-subnet-postgresql] 653 latest 649 2/5 4/20 17/73
57 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_framed_pool[v4-single-attribute] 653 latest 644 0/5 6/20 22/73
58 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-in-other-subnet-network] 653 latest 645 0/5 7/20 14/73
59 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-in-other-subnet-subnet] 653 latest 647 0/5 4/20 18/73
60 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-in-subnet-network] 653 latest 646 0/5 10/20 24/73
61 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-in-subnet-subnet] 653 latest 648 1/5 9/20 20/73
62 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-out-of-subnet-network] 653 latest 641 0/5 9/20 23/73
63 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-out-of-subnet-subnet] 653 latest 649 2/5 8/20 22/73
64 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-in-other-subnet-network] 653 latest 644 0/5 4/20 20/73
65 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-in-other-subnet-subnet] 653 latest 648 1/5 7/20 26/73
66 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-in-subnet-network] 653 latest 644 0/5 10/20 26/73
67 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-in-subnet-subnet] 653 latest 646 0/5 8/20 22/73
68 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-out-of-subnet-network] 653 latest 629 0/5 2/20 27/73
69 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-out-of-subnet-subnet] 653 latest 647 0/5 6/20 28/73
70 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-other-subnet-subnet] 653 latest 652 2/5 10/20 24/73
71 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-subnet-network] 653 latest 652 2/5 4/20 23/73
72 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-subnet-subnet] 653 latest 650 2/5 6/20 20/73
73 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-out-of-subnet-network] 653 latest 651 2/5 2/20 24/73
74 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-out-of-subnet-subnet] 653 latest 652 2/5 8/20 24/73
75 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-other-subnet-network] 653 latest 650 2/5 6/20 16/73
76 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-other-subnet-subnet] 653 latest 643 0/5 8/20 20/73
77 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-subnet-subnet] 653 latest 645 0/5 6/20 18/73
78 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-out-of-subnet-network] 653 latest 652 4/5 8/20 27/73
79 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-out-of-subnet-subnet] 653 latest 646 0/5 10/20 27/73
80 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_subnet_cmds.test_hook_v4_subnet_grow_cb_command[http] 653 latest 650 2/5 6/20 22/73
81 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_subnet_cmds.test_hook_v4_subnet_grow_cb_command[socket] 653 latest 637 0/5 6/20 31/73
82 run tests-ubuntu-20.04-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens 653 latest 565 0/5 0/20 1/73
83 run tests-ubuntu-20.04-v4-tests.dhcp.test_backend_migration.test_v4_lease_upload_duplicate[mysql] 653 latest 578 0/5 0/20 1/73 kea #2293
84 run tests-ubuntu-20.04-v4-tests.dhcp.test_backend_migration.test_v4_lease_upload_duplicate[postgresql] 653 latest 578 0/5 0/20 1/73 kea #2293
85 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[MySQL-http] 653 latest 646 0/5 2/20 2/74
86 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[MySQL-socket] 653 latest 646 0/5 2/20 2/74
87 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[PostgreSQL-http] 653 latest 646 0/5 2/20 2/74
88 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[PostgreSQL-socket] 653 latest 646 0/5 2/20 2/74
89 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_by_hostname[http] 653 latest 616 0/5 0/20 2/74
90 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_by_hostname[socket] 653 latest 616 0/5 0/20 2/74
91 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_page[http] 653 latest 616 0/5 0/20 2/74
92 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_page[socket] 653 latest 616 0/5 0/20 2/74
93 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-mysql] 653 latest 652 3/5 9/18
94 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_radius.test_radius_framed_pool[v6-single-attribute] 653 latest 560 0/5 0/20 1/74
95 run tests-ubuntu-20.04-v6-tests.dhcp.test_backend_migration.test_v6_lease_upload_duplicate[mysql] 653 latest 578 0/5 0/20 1/74 kea #2293
96 run tests-ubuntu-20.04-v6-tests.dhcp.test_backend_migration.test_v6_lease_upload_duplicate[postgresql] 653 latest 578 0/5 0/20 1/74 kea #2293

Tests that are mentioned in the spreadsheet, but don't exist or are not failing:
2: run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_kea_logging.test_v4_loggers_all_different_levels_different_file: kea #592
3: run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_kea_logging.test_v4_loggers_all_different_levels_different_file: kea #592
4: run tests-fedora-34-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens:
7: run tests-ubuntu-20.04-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens: