Tests Report for tarball-system-tests

Date: 2022-06-10 14:05

Jenkins job: https://jenkins.aws.isc.org/job/kea-dev/job/tarball-system-tests

Analyzed last 99 builds

Last build: 684, 2022-10-04 14:29 (1 days ago)

Failures History

Total & Passed History

Regressions

No Test Name Instability
last 5, previous 20 (6-25), earlier builds
Comments

Failures

No Test Name Last Build 684 Result Last Success Build Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-ubuntu-20.04-ha-tests.HA.test_sync.test_HA_and_RADIUS[v4-radius-reservaton-in-pool-multiple-subnets-alphabetical-hot-standby-memfile] 684 latest 0/1
2 run tests-ubuntu-20.04-ha-tests.HA.test_sync.test_HA_and_RADIUS[v4_bootp-radius-reservaton-in-pool-multiple-subnets-alphabetical-hot-standby-memfile] 684 latest 0/1
3 run tests-fedora-36-ddns-tests.ddns.test_ddns6_non_global.test_ddns6_all_levels_resend_without_ddns 684 latest 674 0/5 1/8 forge #333
4 run tests-fedora-36-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_add[memfile] 684 latest 674 0/5 1/8 forge #333
5 run tests-fedora-36-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_add[mysql] 684 latest 674 0/5 1/8 forge #333
6 run tests-fedora-36-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_add[postgresql] 684 latest 674 0/5 1/8 forge #333
7 run tests-fedora-36-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_lease_add_negative 684 latest 674 0/5 1/8 forge #333
8 run tests-fedora-36-v6-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v6_lease_cmds_add_negative 684 latest 674 0/5 1/8 forge #333
9 run tests-fedora-36-v6-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v6_lease_cmds_add_notvalid 684 latest 674 0/5 1/8 forge #333
10 run tests-fedora-36-v6-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v6_lease_cmds_update_negative 684 latest 674 0/5 1/8 forge #333
11 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns6_non_global.test_ddns6_all_levels_resend_without_ddns 684 latest 674 0/5 1/20 0/64 forge #333
12 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_add[memfile] 684 latest 674 0/5 1/20 0/63 forge #333
13 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_add[mysql] 684 latest 674 0/5 1/20 0/63 forge #333
14 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_add[postgresql] 684 latest 674 0/5 1/20 0/63 forge #333
15 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_lease_add_negative 684 latest 674 0/5 1/20 0/63 forge #333
16 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v6_lease_cmds_add_negative 684 latest 674 0/5 1/20 0/64 forge #333
17 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v6_lease_cmds_add_notvalid 684 latest 674 0/5 1/20 0/64 forge #333
18 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v6_lease_cmds_update_negative 684 latest 674 0/5 1/20 0/64 forge #333
19 run tests-fedora-36-cb-tests.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4[mysql] 684 latest 0/5 0/8 kea #1600
20 run tests-fedora-36-cb-tests.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4[postgresql] 684 latest 0/5 0/8 kea #1600
21 run tests-fedora-36-cb-tests.config_backend.test_cb_v6_server_tag.test_server_tag_global_option[mysql] 684 latest 0/5 0/8 kea #1600
22 run tests-fedora-36-cb-tests.config_backend.test_cb_v6_server_tag.test_server_tag_global_option[postgresql] 684 latest 0/5 0/8 kea #1600
23 run tests-fedora-36-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_lease_get_negative 684 latest 0/5 0/8 kea #2060
24 run tests-fedora-36-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_siemens_defined_in_class 684 latest 0/5 0/8 kea #1683
25 run tests-fedora-36-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vivso_suboptions_siemens_defined_in_class 684 latest 0/5 0/8 kea #1683
26 run tests-fedora-36-v4-tests.dhcp.test_logging.test_v4_loggers_all_different_levels_different_file 684 latest 0/5 0/8 kea #592
27 run tests-fedora-36-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 684 latest 0/5 0/8 kea #1796
28 run tests-fedora-36-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 684 latest 0/5 0/8 kea #1796
29 run tests-fedora-36-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 684 latest 0/5 0/8 kea #1796
30 run tests-fedora-36-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_add_reservation_client_data[MySQL-http] 684 latest 0/5 0/8 kea #2538
31 run tests-fedora-36-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_add_reservation_client_data[PostgreSQL-http] 684 latest 0/5 0/8 kea #2538
32 run tests-fedora-36-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 684 latest 0/5 0/8 kea #1796
33 run tests-fedora-36-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 684 latest 0/5 0/8 kea #1796
34 run tests-fedora-36-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 684 latest 0/5 0/8 kea #1796
35 run tests-ubuntu-20.04-cb-tests.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4[mysql] 684 latest 0/5 0/20 0/64 kea #1600
36 run tests-ubuntu-20.04-cb-tests.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4[postgresql] 684 latest 0/5 0/20 0/64 kea #1600
37 run tests-ubuntu-20.04-cb-tests.config_backend.test_cb_v6_server_tag.test_server_tag_global_option[mysql] 684 latest 0/5 0/20 0/64 kea #1600
38 run tests-ubuntu-20.04-cb-tests.config_backend.test_cb_v6_server_tag.test_server_tag_global_option[postgresql] 684 latest 0/5 0/20 0/64 kea #1600
39 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.leases_cmds.test_leases_cmds.test_v4_lease_cmds_lease_get_negative 684 latest 0/5 0/20 0/63 kea #2060
40 run tests-ubuntu-20.04-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_siemens_defined_in_class 684 latest 0/5 0/20 0/63 kea #1683
41 run tests-ubuntu-20.04-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vivso_suboptions_siemens_defined_in_class 684 latest 0/5 0/20 0/63 kea #1683
42 run tests-ubuntu-20.04-v4-tests.dhcp.test_logging.test_v4_loggers_all_different_levels_different_file 684 latest 0/5 0/20 0/63 kea #592
43 run tests-ubuntu-20.04-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 684 latest 0/5 0/20 0/63 kea #1796
44 run tests-ubuntu-20.04-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 684 latest 0/5 0/20 0/63 kea #1796
45 run tests-ubuntu-20.04-v4-tests.dhcp.v4.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 684 latest 0/5 0/20 0/63 kea #1796
46 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_add_reservation_client_data[MySQL-http] 684 latest 0/5 0/8 kea #2538
47 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_add_reservation_client_data[PostgreSQL-http] 684 latest 0/5 0/8 kea #2538
48 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 684 latest 0/5 0/20 0/64 kea #1796
49 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 684 latest 0/5 0/20 0/64 kea #1796
50 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 684 latest 0/5 0/20 0/64 kea #1796

Fixes

No Test Name Instability
last 5, previous 20 (6-25), earlier builds
Comments

Passes

No Test Name Last Build 684 Result Last Fail Build Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_gss_tsig.test_ddns4_gss_tsig_complex_scenario[system_domain1] 684 latest 658 0/5 1/20 0/64 wlodek
2 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_gss_tsig.test_ddns4_gss_tsig_complex_scenario[system_domain2] 684 latest 658 0/5 1/20 0/64 wlodek
3 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_gss_tsig.test_ddns_gss_tsig_manual_expiration[system_and_domain1] 684 latest 658 0/5 1/20 0/64 wlodek
4 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_gss_tsig.test_ddns_gss_tsig_manual_expiration[system_and_domain2] 684 latest 658 0/5 1/20 0/64 wlodek
5 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_sanitizer.test_ddns4_fqdn_sanitization_omit_identical_name 684 latest 658 0/5 1/20 0/64
6 run tests-ubuntu-20.04-ddns-tests.ddns.test_ddns_sanitizer.test_ddns4_hostname_sanitization_omit_identical_name 684 latest 658 0/5 1/20 0/64
7 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_access_by_name_removed_file_2 684 latest 658 0/5 4/20 8/15
8 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_cert_issuer 684 latest 635 0/5 0/20 1/15
9 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_filter_responses 684 latest 652 0/5 2/20 3/15
10 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_remote_address[False] 684 latest 635 0/5 0/20 1/15
11 run tests-ubuntu-20.04-v4-tests.ca.test_rbac.test_rbac_remote_address[True] 684 latest 635 0/5 0/20 1/15
12 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[MySQL-http] 684 latest 658 0/5 1/20 1/63
13 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[MySQL-socket] 684 latest 658 0/5 1/20 1/63
14 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[PostgreSQL-http] 684 latest 658 0/5 1/20 1/63
15 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation[PostgreSQL-socket] 684 latest 658 0/5 1/20 1/63
16 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[MySQL-http] 684 latest 658 0/5 1/20 1/63
17 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[MySQL-socket] 684 latest 658 0/5 1/20 1/63
18 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[PostgreSQL-http] 684 latest 658 0/5 1/20 1/63
19 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_get_reservation_2[PostgreSQL-socket] 684 latest 658 0/5 1/20 1/63
20 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all[http] 684 latest 658 0/5 1/20 1/63
21 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all[socket] 684 latest 658 0/5 1/20 1/63
22 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[MySQL-http] 684 latest 658 0/5 1/20 1/63
23 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[MySQL-socket] 684 latest 658 0/5 1/20 1/63
24 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[PostgreSQL-http] 684 latest 658 0/5 1/20 1/63
25 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_database[PostgreSQL-socket] 684 latest 658 0/5 1/20 1/63
26 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[MySQL-http] 684 latest 646 0/5 1/20 3/63
27 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[MySQL-socket] 684 latest 646 0/5 1/20 3/63
28 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[PostgreSQL-http] 684 latest 646 0/5 1/20 3/63
29 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_all_page_database[PostgreSQL-socket] 684 latest 646 0/5 1/20 3/63
30 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_by_hostname[http] 684 latest 616 0/5 0/20 2/63
31 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_by_hostname[socket] 684 latest 616 0/5 0/20 2/63
32 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_page[http] 684 latest 616 0/5 0/20 2/63
33 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_hosts_cmds.test_v4_hosts_cmds_reservation_get_page[socket] 684 latest 616 0/5 0/20 2/63
34 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-multiple-subnets-memfile] 682 668 0/5 6/20 23/62
35 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-multiple-subnets-mysql] 682 653 0/5 5/20 10/62
36 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-multiple-subnets-postgresql] 682 669 0/5 3/20 20/62
37 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-network-memfile] 682 668 0/5 2/20 18/62
38 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-network-mysql] 682 668 0/5 4/20 17/62
39 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-network-postgresql] 682 654 0/5 4/20 18/62
40 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-subnet-memfile] 682 645 0/5 1/20 16/62
41 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-subnet-mysql] 682 654 0/5 4/20 27/62
42 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-no-reservation-in-radius-subnet-postgresql] 682 641 0/5 0/20 20/62
43 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-multiple-subnets-memfile] 682 670 0/5 6/20 20/62
44 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-multiple-subnets-mysql] 682 652 0/5 2/20 14/62
45 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-multiple-subnets-postgresql] 682 645 0/5 1/20 13/62
46 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-network-memfile] 682 656 0/5 2/20 18/62
47 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-network-mysql] 682 668 0/5 4/20 18/62
48 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-network-postgresql] 682 668 0/5 4/20 12/62
49 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-subnet-memfile] 682 668 0/5 2/20 21/62
50 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-subnet-mysql] 682 668 0/5 4/20 18/62
51 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius[v4-client-has-reservation-in-radius-subnet-postgresql] 682 656 0/5 4/20 11/62
52 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_framed_pool[v4-single-attribute] 684 latest 644 0/5 0/20 20/63
53 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-in-other-subnet-network] 684 latest 645 0/5 0/20 12/63
54 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-in-other-subnet-subnet] 684 latest 647 0/5 2/20 14/63
55 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-in-subnet-network] 684 latest 658 0/5 5/20 21/63
56 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-in-subnet-subnet] 684 latest 656 0/5 4/20 20/63
57 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-out-of-subnet-network] 684 latest 669 0/5 2/20 20/63
58 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-_-out-of-subnet-subnet] 684 latest 668 0/5 8/20 18/63
59 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-in-other-subnet-network] 684 latest 654 0/5 2/20 16/63
60 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-in-other-subnet-subnet] 684 latest 669 0/5 6/20 24/63
61 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-in-subnet-network] 684 latest 644 0/5 0/20 28/63
62 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-in-subnet-subnet] 684 latest 670 0/5 5/20 22/63
63 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-out-of-subnet-network] 684 latest 629 0/5 0/20 16/63
64 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-_-leading_subnet-out-of-subnet-subnet] 684 latest 647 0/5 1/20 25/63
65 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-other-subnet-network] 684 latest 669 0/5 8/20 27/63
66 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-other-subnet-subnet] 684 latest 670 0/5 6/20 24/63
67 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-subnet-network] 684 latest 668 0/5 6/20 15/63
68 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-in-subnet-subnet] 684 latest 650 0/5 4/20 16/63
69 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-out-of-subnet-network] 684 latest 670 0/5 6/20 17/63
70 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-_-out-of-subnet-subnet] 684 latest 658 0/5 4/20 18/63
71 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-other-subnet-network] 684 latest 670 0/5 8/20 12/63
72 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-other-subnet-subnet] 684 latest 643 0/5 0/20 20/63
73 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-subnet-network] 684 latest 653 0/5 2/20 20/63
74 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-in-subnet-subnet] 684 latest 669 0/5 4/20 18/63
75 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-out-of-subnet-network] 684 latest 652 0/5 4/20 22/63
76 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_giaddr[v4-reselect-leading_subnet-out-of-subnet-subnet] 684 latest 646 0/5 1/20 23/63
77 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_radius.test_radius_no_attributes[v4] 684 latest 653 0/5 4/20 25/63
78 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_subnet_cmds.test_hook_v4_subnet_grow_cb_command[http] 684 latest 654 0/5 4/20 16/63
79 run tests-ubuntu-20.04-v4-tests.dhcp.hooks.test_subnet_cmds.test_hook_v4_subnet_grow_cb_command[socket] 684 latest 637 0/5 0/20 26/63
80 run tests-ubuntu-20.04-v4-tests.dhcp.v4.test_statistics.test_stats_basic 684 latest 658 0/5 1/20 1/63
81 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[MySQL-http] 684 latest 658 0/5 1/20 1/64
82 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[MySQL-socket] 684 latest 658 0/5 1/20 1/64
83 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[PostgreSQL-http] 684 latest 658 0/5 1/20 1/64
84 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation[PostgreSQL-socket] 684 latest 658 0/5 1/20 1/64
85 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[MySQL-http] 684 latest 658 0/5 1/20 1/64
86 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[MySQL-socket] 684 latest 658 0/5 1/20 1/64
87 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[PostgreSQL-http] 684 latest 658 0/5 1/20 1/64
88 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_get_reservation_2[PostgreSQL-socket] 684 latest 658 0/5 1/20 1/64
89 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all[http] 684 latest 658 0/5 1/20 1/64
90 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all[socket] 684 latest 658 0/5 1/20 1/64
91 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[MySQL-http] 684 latest 658 0/5 1/20 1/64
92 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[MySQL-socket] 684 latest 658 0/5 1/20 1/64
93 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[PostgreSQL-http] 684 latest 658 0/5 1/20 1/64
94 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_database[PostgreSQL-socket] 684 latest 658 0/5 1/20 1/64
95 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[MySQL-http] 684 latest 646 0/5 1/20 3/64
96 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[MySQL-socket] 684 latest 646 0/5 1/20 3/64
97 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[PostgreSQL-http] 684 latest 646 0/5 1/20 3/64
98 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_all_page_database[PostgreSQL-socket] 684 latest 646 0/5 1/20 3/64
99 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_by_hostname[http] 684 latest 616 0/5 0/20 2/64
100 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_by_hostname[socket] 684 latest 616 0/5 0/20 2/64
101 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_page[http] 684 latest 616 0/5 0/20 2/64
102 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_hosts_cmds.test_v6_hosts_cmds_reservation_get_page[socket] 684 latest 616 0/5 0/20 2/64
103 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-mysql] 684 latest 652 0/5 4/20 8/16
104 run tests-ubuntu-20.04-v6-tests.dhcp.hooks.test_limits.test_lease_limits_subnet[v6-postgresql] 684 latest 656 0/5 6/20 9/16
105 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_enabled[memfile-parameter0] 684 latest 677 1/5 1/20 0/64
106 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_lease_cache.test_lease_cache_enabled[memfile-parameter1] 684 latest 676 0/5 2/20 0/64
107 run tests-ubuntu-20.04-v6-tests.dhcp.v6.test_prefix_delegation.test_prefix_delegation_multiple_PD_and_IA_request_partial_fail 684 latest 658 0/5 2/20 0/64

Tests that are mentioned in the spreadsheet, but don't exist or are not failing:
2: run tests-fedora-36-v4-tests.dhcpv4.kea_only.test_kea_logging.test_v4_loggers_all_different_levels_different_file: kea #592
3: run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_kea_logging.test_v4_loggers_all_different_levels_different_file: kea #592
4: run tests-fedora-36-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens:
7: run tests-ubuntu-20.04-v4-tests.dhcp.protocol.test_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens:
38: run tests-fedora-36-ddns-tests.ddns.test_ddns6.test_ddns6_notsig_rev_success_withoutflag: logging issue in bind on fedora
39: run tests-fedora-36-ddns-tests.ddns.test_ddns6.test_ddns6_notsig_rev_Nflag_override_no_update: logging issue in bind on fedora