QA Automation Test Plan Report

Generated from Test Case Editor • 2026-05-22

86 test cases • 39.5% automated
TOTAL TESTS
86
AUTOMATED
34
39.5%
PARTIAL
16
18.6%
MANUAL
36
41.9%
TEST CASES
# ID Group Status Description
1 core-repository-check-presence_of_release_notes_and_changelog core-repository automated Verify Release Notes and Changelog are present in the software repository
2 core-repository-check-presence_of_trouble_shooting_guide core-repository automated Verify Troubleshooting Guide is present in the repository
3 core-repository-check-presence_of_all_mandatory_core-documentation_files core-repository automated Verify all mandatory core documentation files are listed in the repository
4 core-repository-check-presence_of_main_software_version_all_hypervisors core-repository automated Verify main software version packages are available for all supported hypervisors
5 core-repository-check-presence_of_patch_version_and_its_compatibility core-repository automated Verify patch version packages and compatibility matrices are present
6 core-repository-check-presence_of_companion_tools_and_supporting_scripts core-repository automated Verify companion tools and supporting scripts are available in the repository
7 core-documentation-write-release_notes_feature_changes_and_known_issues core-documentation automated Extract and record Release Notes, feature changes, and known issues
8 core-documentation-check-accuracy_installation_and_configuration_guide core-documentation manual Verify accuracy of the Installation and Configuration Guide against actual system behaviour
9 core-documentation-check-accuracy_trouble_shooting_guide core-documentation manual Verify the Troubleshooting Guide procedures are accurate and complete
10 core-documentation-write-changed_cli_configuration_commands core-documentation automated Extract and record changed CLI configuration commands for this release
11 core-features-write-summary_of_each_new_feature_per_release core-features automated Extract and record a summary of each new feature included in this release
12 core-features-check-integration_of_new_features_with_existing_call_processing_and_modules core-features partial Verify new features integrate correctly with existing call processing and system modules
13 core-features-check-backward_compatibility_of_new_features core-features partial Verify new features are backward-compatible with existing configurations and older endpoint firmware
14 core-features-check-performance_and_resource_impact_assessment_of_new_features core-features manual Assess CPU/memory/network resource impact of new features under representative call load
15 core-features-write-analysis_of_new_security_risks core-features manual Identify, analyse, and document new security risks introduced by features in this release
16 core-features-write-ui_ux_and_admin_portal_changes_validation core-features automated Capture and record all UI/UX changes in the admin portal for this release
17 core-features-check-provisioning_changes_for_new_features core-features automated Verify provisioning settings for new features are accessible in the admin portal
18 core-virtualization-write-supported_hypervisors_deployment core-virtualization automated Record the list of supported hypervisors and deployment methods from the download portal
19 core-virtualization-write-guest_agent_integration core-virtualization manual Record guest agent integration status for each supported hypervisor
20 core-virtualization-write-resource_allocation_vcpu_vram_vdisk core-virtualization manual Record vCPU, vRAM, and vDisk resource allocation for deployment templates
21 core-virtualization-write-virtual_networking_configuration core-virtualization manual Record virtual networking configuration: virtual switches, VLANs, NIC assignments
22 core-virtualization-check-live_migration_and_active_call_preservation core-virtualization manual Verify VM live migration preserves active calls without interruption
23 core-virtualization-check-snapshot_backup_restore_and_consistency core-virtualization partial Verify VM snapshot and restore operations maintain full system consistency
24 core-virtualization-check-hypervisor_level_high_availability core-virtualization manual Verify hypervisor-level HA restarts the PBX VM after a host failure
25 core-virtualization-write-storage_thin_vs_thick_provisioning core-virtualization manual Record storage provisioning type and performance implications for each hypervisor
26 core-security-write-strong_password_policy core-security automated Navigate to security settings and record the current password policy configuration
27 core-security-check-sip_tls_and_srtp_encryption_enabled_by_default core-security automated Verify SIP TLS and SRTP media encryption are enabled by default
28 core-security-check-ip_access_control_lists core-security automated Verify IP Access Control Lists are properly configured and enforced
29 core-security-check-unnecessary_services_and_ports_are_disabled core-security partial Verify unnecessary services and network ports are disabled
30 core-security-check-security_event_logging_and_audit_trail_is_active core-security automated Verify security event logging and audit trail are active and recording events
31 core-security-check-auto_enrollment_certificate_management_process core-security automated Verify auto-enrollment certificate management (ACME/Let's Encrypt) is configured and functional
32 core-security-check-known_vulnerable_dependencies_in_release_artifacts core-security partial Verify release artifacts do not contain known vulnerable dependencies (CVE scan)
33 core-security-check-previous_security_findings_have_been_remediated_before_release core-security manual Verify all previously identified security findings are remediated before release
34 core-security-check-obtain_formal_security_team_sign_off_for_the_new_version core-security manual Obtain formal written sign-off from the Security team approving the release
35 core-security-check-verify_role_based_access_control_and_least_privilege_principle core-security automated Verify RBAC roles are correctly defined and least-privilege principle is enforced
36 core-security-check-encryption_of_sensitive_data_at_rest_and_in_transit core-security partial Verify sensitive data is encrypted at rest (DB) and in transit (HTTPS/TLS)
37 core-installation-check-fresh_installation core-installation manual Verify complete fresh installation from scratch succeeds on each supported hypervisor
38 core-installation-check-post_install_service_status_and_port_verification core-installation partial Verify all required services are running and expected ports are open after installation
39 core-installation-check-initial_configuration core-installation automated Verify the initial configuration wizard completes successfully
40 core-installation-check-license_activation core-installation automated Verify license activation completes successfully and licensed features are unlocked
41 core-upgrade-check-in_place_upgrade_from_previous_major_version core-upgrade manual Verify in-place upgrade from the previous major version completes successfully without data loss
42 core-upgrade-check-configuration_and_database_migration_validation core-upgrade partial Verify configuration objects and database content migrate correctly after upgrade
43 core-upgrade-check-schema_upgrade_and_data_integrity_check core-upgrade manual Verify database schema is correctly upgraded and all data maintains integrity
44 core-upgrade-check-rollback_procedure_execution_and_verification core-upgrade manual Verify the rollback procedure successfully reverts the system to the previous version
45 core-upgrade-check-post_upgrade_regression_of_core_features core-upgrade automated Run automated regression checks on core portal features after upgrade
46 core-upgrade-check-zero_downtime_upgrade_where_supported core-upgrade manual Verify zero-downtime upgrade keeps the service available throughout the upgrade process
47 core-interoperability-check-addm core-interoperability automated Verify ADDM integration is configured and reporting discovery data correctly
48 core-interoperability-check-siem core-interoperability automated Verify SIEM integration is configured and forwarding security events
49 pbx-configuration-check-initial_system_setup_and_network_settings pbx-configuration automated Verify initial PBX system setup and network settings are correctly configured
50 pbx-configuration-check-dialplan_route_and_outbound_rule_creation pbx-configuration automated Verify creation and validation of dial plan rules and outbound routes
51 pbx-configuration-check-backup_restore_full_system_configuration pbx-configuration automated Verify full system configuration backup and restore operations work correctly
52 pbx-configuration-check-bulk_csv_import_export_of_settings pbx-configuration automated Verify bulk CSV import and export of settings
53 pbx-extensions-check-create_modify_delete_sip_extensions pbx-extensions automated Verify full CRUD lifecycle for SIP extensions in the admin portal
54 pbx-extensions-check-extension_registration_with_deskphones_softphones pbx-extensions manual Verify SIP extension registers successfully from a desk phone and a softphone client
55 pbx-extensions-check-device_provisioning pbx-extensions partial Verify automatic device provisioning: profile generation and server URL accessible
56 pbx-calls-check-internal_extension_to_extension_audio_call pbx-calls manual Verify internal extension-to-extension audio call connects with bi-directional audio
57 pbx-calls-check-inbound_call_from_sip_trunk_pstn pbx-calls manual Verify inbound call from a SIP trunk/PSTN routes correctly to the configured destination
58 pbx-calls-check-outbound_call_to_sip_trunk_pstn_with_caller_id pbx-calls manual Verify outbound call via SIP trunk presents the correct Caller ID on the receiving end
59 pbx-calls-check-caller_id_presentation_restriction_and_pai pbx-calls manual Verify Caller ID presentation, Anonymous restriction (CLIR), and P-Asserted-Identity header
60 pbx-calls-check-call_hold_resume_and_music_on_hold pbx-calls manual Verify call hold, resume, and Music on Hold playback work correctly
61 pbx-calls-check-call_waiting_notification_and_switching pbx-calls manual Verify call waiting notification and switching between active and waiting calls
62 pbx-calls-check-three_way_conference_and_multi_party_bridge pbx-calls manual Verify three-way conference calling and multi-party conference bridge functionality
63 pbx-codecs-check-codec_negotiation_g711_g729_opus_g722 pbx-codecs manual Verify successful codec negotiation for G.711, G.729, Opus, and G.722
64 pbx-codecs-check-dtmf_transmission_rfc2833_inband_sip_info pbx-codecs manual Verify DTMF digit transmission via RFC2833, in-band audio, and SIP INFO methods
65 pbx-codecs-check-t38_fax_passthrough_and_error_correction pbx-codecs manual Verify T.38 fax passthrough and error correction (ECM) work correctly
66 pbx-calls-security-check-srtp_sdes_or_dtls_media_encryption pbx-calls-security partial Verify SRTP with SDES or DTLS-SRTP is enabled for media encryption on calls
67 pbx-calls-security-check-acl_ip_whitelisting_and_rate_limiting pbx-calls-security partial Verify ACL IP whitelisting rules and SIP rate limiting are configured and enforced
68 pbx-calls-security-check-toll_fraud_prevention_rules_and_alerting pbx-calls-security automated Verify toll fraud prevention rules and alert notifications are configured
69 pbx-performance-check-cpu_memory_disk_io_utilization_under_sustained_load pbx-performance manual Verify CPU, memory, and disk I/O remain within limits under sustained call load
70 pbx-performance-check-long_duration_stability_72h_test pbx-performance manual Verify system stability under continuous call load over a 72-hour period
71 pbx-performance-check-memory_leak_and_resource_cleanup_detection pbx-performance manual Detect memory leaks and verify proper resource cleanup over extended operation
72 pbx-availability-check-active_passive_or_active_active_failover pbx-availability manual Verify Active-Passive or Active-Active failover transitions correctly on node failure
73 pbx-availability-check-database_replication_and_sync_integrity pbx-availability manual Verify database replication between HA nodes maintains consistency and acceptable lag
74 pbx-availability-check-automatic_failover_and_call_preservation pbx-availability manual Verify automatic failover preserves active calls (no drops, no audio interruption > 200ms)
75 pbx-availability-check-geographic_redundancy_and_geo_distribution pbx-availability manual Verify geo-distributed deployment handles site failover without service interruption
76 pbx-management-check-cli_management pbx-management partial Verify CLI management interface is accessible and key management commands execute correctly
77 pbx-management-check-gui_management pbx-management automated Verify all main admin portal sections load correctly and management actions are functional
78 pbx-logs-check-cdr_generation_accuracy_completeness_and_export pbx-logs automated Verify CDR records contain all required fields and can be exported to CSV/PDF
79 pbx-logs-check-real_time_active_call_and_registration_monitoring pbx-logs automated Verify real-time monitoring dashboard shows active calls and SIP registrations
80 pbx-logs-check-detailed_logging_levels_rotation_and_search pbx-logs automated Verify logging levels, log rotation, and log search/filter functionality
81 pbx-logs-check-threshold_alarms_cpu_channels_disk_memory pbx-logs automated Verify threshold-based alarms for CPU, active channels, disk, and memory usage
82 pbx-logs-check-call_quality_metrics_mos_jitter_loss_per_call pbx-logs partial Verify per-call quality metrics (MOS score, jitter, packet loss) are collected and displayed
83 pbx-regression-check-core_call_features_after_any_code_change pbx-regression partial Run regression checks on core features after any code change to detect regressions
84 pbx-regression-check-previously_fixed_bugs_and_edge_cases_reverification pbx-regression partial Verify all previously fixed bugs and known edge cases have not regressed
85 pbx-regression-check-performance_baselines_comparison_against_previous_version pbx-regression manual Compare key performance metrics against baselines from the previous version
86 pbx-regression-check-security_hardening_and_vulnerability_scan_baseline pbx-regression partial Verify security hardening settings and compare vulnerability scan baseline against previous version
Generated by Test Case Editor • Data source: editor/data/testcases.json