Tests Report for pkg-system-tests

Date: 2021-30-07 22:22

Jenkins job: https://jenkins.aws.isc.org/job/kea-dev/job/pkg-system-tests

Analyzed last 60 builds

Last build: 264, 2021-07-30 18:24 (0 days ago)

Failures History

Total & Passed History

Regressions

No Test Name Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-fedora-34-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[postgresql-parameter0] 1/5 0/19

Failures

No Test Name Last Build 264 Result Last Success Build Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-fedora-34-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[postgresql-parameter0] 264 latest 263 1/5 0/19
2 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_statistics.test_stats_basic 264 latest 230 0/5 1/20 0/24
3 run tests-fedora-34-v4-tests.dhcpv4.kea_only.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4 264 latest 0/5 0/19
4 run tests-fedora-34-v4-tests.dhcpv4.kea_only.radius.test_radius.test_class_and_subnet_assign_complex 264 latest 0/5 0/19
5 run tests-fedora-34-v4-tests.dhcpv4.kea_only.radius.test_radius.test_select_by_class_in_subnet 264 latest 0/5 0/19
6 run tests-fedora-34-v4-tests.dhcpv4.kea_only.radius.test_radius.test_select_from_radius_and_ignore_complex_subnets_with_classes 264 latest 0/5 0/19
7 run tests-fedora-34-v4-tests.dhcpv4.kea_only.radius.test_radius.test_static_in_pool[network] 264 latest 0/5 0/19
8 run tests-fedora-34-v4-tests.dhcpv4.kea_only.radius.test_radius.test_static_in_pool[subnet] 264 latest 0/5 0/19
9 run tests-fedora-34-v4-tests.dhcpv4.kea_only.radius.test_radius.test_static_out_of_pool[network] 264 latest 0/5 0/19
10 run tests-fedora-34-v4-tests.dhcpv4.kea_only.radius.test_radius.test_static_out_of_pool[subnet] 264 latest 0/5 0/19
11 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_kea_logging.test_v4_loggers_all_different_levels_different_file 264 latest 0/5 0/19
12 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 264 latest 0/5 0/19
13 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 264 latest 0/5 0/19
14 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 264 latest 0/5 0/19
15 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_legalloghook.test_v4_legal_log_assigned_address_via_relay 264 latest 0/5 0/19
16 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_legalloghook.test_v4_legal_log_assigned_address_via_relay_db[mysql] 264 latest 0/5 0/19
17 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_legalloghook.test_v4_legal_log_assigned_address_via_relay_db[postgresql] 264 latest 0/5 0/19
18 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_legalloghook.test_v4_legal_log_assigned_address_via_relay_one_address 264 latest 0/5 0/19
19 run tests-fedora-34-v4-tests.dhcpv4.kea_only.test_statistics.test_stats_basic 264 latest 0/5 0/19
20 run tests-fedora-34-v4-tests.dhcpv4.options.test_v4_rai_options.test_v4_rai_option11_server_identifier_override 264 latest 0/5 0/19
21 run tests-fedora-34-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens 264 latest 0/5 0/19
22 run tests-fedora-34-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vendor_encapsulated_siemens_defined_in_class 264 latest 0/5 0/19
23 run tests-fedora-34-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vivso_suboptions_siemens_defined_in_class 264 latest 0/5 0/19
24 run tests-fedora-34-v6-tests.dhcpv6.ddns.test_ddns_no_tsig_release_sanitization.test_ddns6_notsig_forw_and_rev_release_fqdn_sanitization_omit_1 264 latest 0/5 0/19
25 run tests-fedora-34-v6-tests.dhcpv6.ddns.test_ddns_no_tsig_request.test_ddns6_notsig_rev_Nflag_override_no_update 264 latest 0/5 0/19
26 run tests-fedora-34-v6-tests.dhcpv6.ddns.test_ddns_no_tsig_request.test_ddns6_notsig_rev_success_withoutflag 264 latest 0/5 0/19
27 run tests-fedora-34-v6-tests.dhcpv6.kea_only.config_backend.test_cb_v6_server_tag.test_server_tag_global_option 264 latest 0/5 0/19
28 run tests-fedora-34-v6-tests.dhcpv6.kea_only.control_channel.test_lease_get_by.test_control_channel_lease6_get_by 264 latest 0/5 0/19
29 run tests-fedora-34-v6-tests.dhcpv6.kea_only.test_kea_logging.test_v6_loggers_all_different_levels_different_file 264 latest 0/5 0/19
30 run tests-fedora-34-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 264 latest 0/5 0/19
31 run tests-fedora-34-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 264 latest 0/5 0/19
32 run tests-fedora-34-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 264 latest 0/5 0/19
33 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 264 latest 0/5 0/20 0/24
34 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 264 latest 0/5 0/20 0/24
35 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 264 latest 0/5 0/20 0/24
36 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_legalloghook.test_v4_legal_log_assigned_address_via_relay 264 latest 0/5 0/20 0/24
37 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_legalloghook.test_v4_legal_log_assigned_address_via_relay_db[mysql] 264 latest 0/5 0/20 0/24
38 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_legalloghook.test_v4_legal_log_assigned_address_via_relay_db[postgresql] 264 latest 0/5 0/20 0/24
39 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_legalloghook.test_v4_legal_log_assigned_address_via_relay_one_address 264 latest 0/5 0/20 0/24
40 run tests-ubuntu-20.04-v6-tests.dhcpv6.ddns.test_ddns_no_tsig_release_sanitization.test_ddns6_notsig_forw_and_rev_release_fqdn_sanitization_omit_1 264 latest 0/5 0/20 0/33
41 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-memfile] 264 latest 0/5 0/20 0/33
42 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-mysql] 264 latest 0/5 0/20 0/33
43 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_disabled[parameter1-postgresql] 264 latest 0/5 0/20 0/33
44 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4 264 latest 0/5 0/20 0/24
45 run tests-ubuntu-20.04-v4-tests.dhcpv4.kea_only.test_kea_logging.test_v4_loggers_all_different_levels_different_file 264 latest 0/5 0/20 0/24
46 run tests-ubuntu-20.04-v4-tests.dhcpv4.options.test_v4_rai_options.test_v4_rai_option11_server_identifier_override 264 latest 0/5 0/20 0/24
47 run tests-ubuntu-20.04-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens 264 latest 0/5 0/20 0/24
48 run tests-ubuntu-20.04-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vendor_encapsulated_siemens_defined_in_class 264 latest 0/5 0/20 0/24
49 run tests-ubuntu-20.04-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vivso_suboptions_siemens_defined_in_class 264 latest 0/5 0/20 0/24
50 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.config_backend.test_cb_v6_server_tag.test_server_tag_global_option 264 latest 0/5 0/20 0/33
51 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.control_channel.test_lease_get_by.test_control_channel_lease6_get_by 264 latest 0/5 0/20 0/33

Fixes

No Test Name Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[mysql-parameter0] 4/5 11/20 17/33

Passes

No Test Name Last Build 264 Result Last Fail Build Instability
last 5, previous 20 (6-25), earlier builds
Comments
1 run tests-fedora-34-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[memfile-parameter0] 264 latest 259 1/5 1/19
2 run tests-ubuntu-20.04-v6-tests.dhcpv6.ddns.test_ddns_control_channel.test_ddns6_control_channel_config_reload 264 latest 212 0/5 0/20 2/33
3 run tests-ubuntu-20.04-v6-tests.dhcpv6.ddns.test_ddns_control_channel.test_ddns6_control_channel_config_set 264 latest 212 0/5 0/20 2/33
4 run tests-ubuntu-20.04-v6-tests.dhcpv6.ddns.test_ddns_control_channel.test_ddns6_control_channel_config_set_all_values 264 latest 212 0/5 0/20 2/33
5 run tests-ubuntu-20.04-v6-tests.dhcpv6.ddns.test_ddns_control_channel.test_ddns6_control_channel_config_write 264 latest 212 0/5 0/20 2/33
6 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[memfile-parameter0] 264 latest 245 0/5 2/20 13/33
7 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[memfile-parameter1] 264 latest 257 0/5 8/20 4/33
8 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[mysql-parameter0] 264 latest 263 4/5 11/20 17/33
9 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[mysql-parameter1] 264 latest 258 0/5 10/20 15/33
10 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[postgresql-parameter0] 264 latest 255 0/5 10/20 4/33
11 run tests-ubuntu-20.04-v6-tests.dhcpv6.kea_only.test_lease_cache.test_lease_cache_enabled[postgresql-parameter1] 264 latest 262 2/5 4/20 10/33

not used comments:
2: run tests-fedora-32-v4-tests.dhcpv4.options.test_v4_rai_options.test_v4_rai_option11_server_identifier_override: kea #1695
3: run tests-fedora-32-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vendor_encapsulated_options_space_siemens: kea #1518
4: run tests-fedora-32-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vendor_encapsulated_siemens_defined_in_class: kea #1518
5: run tests-fedora-32-v4-tests.dhcpv4.options.test_v4_vendor_options.test_v4_options_vivso_suboptions_siemens_defined_in_class: kea #1518
6: run tests-fedora-32-v6-tests.dhcpv6.kea_only.test_kea_logging.test_v6_loggers_all_different_levels_different_file: bug in test
11: run tests-fedora-32-v4-tests.dhcpv4.kea_only.config_backend.test_cb_v4_server_tag.test_server_tag_global_option4: bug in kea #1600
12: run tests-fedora-32-v4-tests.dhcpv4.kea_only.test_kea_logging.test_v4_loggers_all_different_levels_different_file: kea bug: #592
13: run tests-fedora-32-v6-tests.dhcpv6.kea_only.config_backend.test_cb_v6_server_tag.test_server_tag_global_option: kea bug #1600
14: run tests-fedora-32-v6-tests.dhcpv6.kea_only.control_channel.test_lease_get_by.test_control_channel_lease6_get_by: possible bug, #1622
19: run tests-fedora-32-v6-tests.dhcpv6.ddns.test_ddns_no_tsig_request.test_ddns6_notsig_rev_Nflag_override_no_update:
20: run tests-fedora-32-v6-tests.dhcpv6.ddns.test_ddns_no_tsig_request.test_ddns6_notsig_rev_success_withoutflag:
21: run tests-fedora-32-v6-tests.dhcpv6.ddns.test_ddns_no_tsig_release_sanitization.test_ddns6_notsig_forw_and_rev_release_fqdn_sanitization_omit_1:
22: run tests-ubuntu-20.04-v6-tests.dhcpv6.ddns.test_ddns_no_tsig_release_sanitization.test_ddns6_notsig_forw_and_rev_release_fqdn_sanitization_omit_1: