# QA Automation Test Plan Report

Generated from Test Case Editor • 2026-05-22

86 test cases • 39.5% automated
TOTAL TESTS
86
AUTOMATED
34
39.5%
PARTIAL
16
18.6%
MANUAL
36
41.9%
TEST CASES

# | ID | Group | Status | Description
--- | --- | --- | --- | ---
1 | core-repository-check-presence_of_release_notes_and_changelog | core-repository | automated | Verify Release Notes and Changelog are present in the software repository
2 | core-repository-check-presence_of_trouble_shooting_guide | core-repository | automated | Verify Troubleshooting Guide is present in the repository
3 | core-repository-check-presence_of_all_mandatory_core-documentation_files | core-repository | automated | Verify all mandatory core documentation files are listed in the repository
4 | core-repository-check-presence_of_main_software_version_all_hypervisors | core-repository | automated | Verify main software version packages are available for all supported hypervisors
5 | core-repository-check-presence_of_patch_version_and_its_compatibility | core-repository | automated | Verify patch version packages and compatibility matrices are present
6 | core-repository-check-presence_of_companion_tools_and_supporting_scripts | core-repository | automated | Verify companion tools and supporting scripts are available in the repository
7 | core-documentation-write-release_notes_feature_changes_and_known_issues | core-documentation | automated | Extract and record Release Notes, feature changes, and known issues
8 | core-documentation-check-accuracy_installation_and_configuration_guide | core-documentation | manual | Verify accuracy of the Installation and Configuration Guide against actual system behaviour
9 | core-documentation-check-accuracy_trouble_shooting_guide | core-documentation | manual | Verify the Troubleshooting Guide procedures are accurate and complete
10 | core-documentation-write-changed_cli_configuration_commands | core-documentation | automated | Extract and record changed CLI configuration commands for this release
11 | core-features-write-summary_of_each_new_feature_per_release | core-features | automated | Extract and record a summary of each new feature included in this release
12 | core-features-check-integration_of_new_features_with_existing_call_processing_and_modules | core-features | partial | Verify new features integrate correctly with existing call processing and system modules
13 | core-features-check-backward_compatibility_of_new_features | core-features | partial | Verify new features are backward-compatible with existing configurations and older endpoint firmware
14 | core-features-check-performance_and_resource_impact_assessment_of_new_features | core-features | manual | Assess CPU/memory/network resource impact of new features under representative call load
15 | core-features-write-analysis_of_new_security_risks | core-features | manual | Identify, analyse, and document new security risks introduced by features in this release
16 | core-features-write-ui_ux_and_admin_portal_changes_validation | core-features | automated | Capture and record all UI/UX changes in the admin portal for this release
17 | core-features-check-provisioning_changes_for_new_features | core-features | automated | Verify provisioning settings for new features are accessible in the admin portal
18 | core-virtualization-write-supported_hypervisors_deployment | core-virtualization | automated | Record the list of supported hypervisors and deployment methods from the download portal
19 | core-virtualization-write-guest_agent_integration | core-virtualization | manual | Record guest agent integration status for each supported hypervisor
20 | core-virtualization-write-resource_allocation_vcpu_vram_vdisk | core-virtualization | manual | Record vCPU, vRAM, and vDisk resource allocation for deployment templates
21 | core-virtualization-write-virtual_networking_configuration | core-virtualization | manual | Record virtual networking configuration: virtual switches, VLANs, NIC assignments
22 | core-virtualization-check-live_migration_and_active_call_preservation | core-virtualization | manual | Verify VM live migration preserves active calls without interruption
23 | core-virtualization-check-snapshot_backup_restore_and_consistency | core-virtualization | partial | Verify VM snapshot and restore operations maintain full system consistency
24 | core-virtualization-check-hypervisor_level_high_availability | core-virtualization | manual | Verify hypervisor-level HA restarts the PBX VM after a host failure
25 | core-virtualization-write-storage_thin_vs_thick_provisioning | core-virtualization | manual | Record storage provisioning type and performance implications for each hypervisor
26 | core-security-write-strong_password_policy | core-security | automated | Navigate to security settings and record the current password policy configuration
27 | core-security-check-sip_tls_and_srtp_encryption_enabled_by_default | core-security | automated | Verify SIP TLS and SRTP media encryption are enabled by default
28 | core-security-check-ip_access_control_lists | core-security | automated | Verify IP Access Control Lists are properly configured and enforced
29 | core-security-check-unnecessary_services_and_ports_are_disabled | core-security | partial | Verify unnecessary services and network ports are disabled
30 | core-security-check-security_event_logging_and_audit_trail_is_active | core-security | automated | Verify security event logging and audit trail are active and recording events
31 | core-security-check-auto_enrollment_certificate_management_process | core-security | automated | Verify auto-enrollment certificate management (ACME/Let's Encrypt) is configured and functional
32 | core-security-check-known_vulnerable_dependencies_in_release_artifacts | core-security | partial | Verify release artifacts do not contain known vulnerable dependencies (CVE scan)
33 | core-security-check-previous_security_findings_have_been_remediated_before_release | core-security | manual | Verify all previously identified security findings are remediated before release
34 | core-security-check-obtain_formal_security_team_sign_off_for_the_new_version | core-security | manual | Obtain formal written sign-off from the Security team approving the release
35 | core-security-check-verify_role_based_access_control_and_least_privilege_principle | core-security | automated | Verify RBAC roles are correctly defined and least-privilege principle is enforced
36 | core-security-check-encryption_of_sensitive_data_at_rest_and_in_transit | core-security | partial | Verify sensitive data is encrypted at rest (DB) and in transit (HTTPS/TLS)
37 | core-installation-check-fresh_installation | core-installation | manual | Verify complete fresh installation from scratch succeeds on each supported hypervisor
38 | core-installation-check-post_install_service_status_and_port_verification | core-installation | partial | Verify all required services are running and expected ports are open after installation
39 | core-installation-check-initial_configuration | core-installation | automated | Verify the initial configuration wizard completes successfully
40 | core-installation-check-license_activation | core-installation | automated | Verify license activation completes successfully and licensed features are unlocked
41 | core-upgrade-check-in_place_upgrade_from_previous_major_version | core-upgrade | manual | Verify in-place upgrade from the previous major version completes successfully without data loss
42 | core-upgrade-check-configuration_and_database_migration_validation | core-upgrade | partial | Verify configuration objects and database content migrate correctly after upgrade
43 | core-upgrade-check-schema_upgrade_and_data_integrity_check | core-upgrade | manual | Verify database schema is correctly upgraded and all data maintains integrity
44 | core-upgrade-check-rollback_procedure_execution_and_verification | core-upgrade | manual | Verify the rollback procedure successfully reverts the system to the previous version
45 | core-upgrade-check-post_upgrade_regression_of_core_features | core-upgrade | automated | Run automated regression checks on core portal features after upgrade
46 | core-upgrade-check-zero_downtime_upgrade_where_supported | core-upgrade | manual | Verify zero-downtime upgrade keeps the service available throughout the upgrade process
47 | core-interoperability-check-addm | core-interoperability | automated | Verify ADDM integration is configured and reporting discovery data correctly
48 | core-interoperability-check-siem | core-interoperability | automated | Verify SIEM integration is configured and forwarding security events
49 | pbx-configuration-check-initial_system_setup_and_network_settings | pbx-configuration | automated | Verify initial PBX system setup and network settings are correctly configured
50 | pbx-configuration-check-dialplan_route_and_outbound_rule_creation | pbx-configuration | automated | Verify creation and validation of dial plan rules and outbound routes
51 | pbx-configuration-check-backup_restore_full_system_configuration | pbx-configuration | automated | Verify full system configuration backup and restore operations work correctly
52 | pbx-configuration-check-bulk_csv_import_export_of_settings | pbx-configuration | automated | Verify bulk CSV import and export of settings
53 | pbx-extensions-check-create_modify_delete_sip_extensions | pbx-extensions | automated | Verify full CRUD lifecycle for SIP extensions in the admin portal
54 | pbx-extensions-check-extension_registration_with_deskphones_softphones | pbx-extensions | manual | Verify SIP extension registers successfully from a desk phone and a softphone client
55 | pbx-extensions-check-device_provisioning | pbx-extensions | partial | Verify automatic device provisioning: profile generation and server URL accessible
56 | pbx-calls-check-internal_extension_to_extension_audio_call | pbx-calls | manual | Verify internal extension-to-extension audio call connects with bi-directional audio
57 | pbx-calls-check-inbound_call_from_sip_trunk_pstn | pbx-calls | manual | Verify inbound call from a SIP trunk/PSTN routes correctly to the configured destination
58 | pbx-calls-check-outbound_call_to_sip_trunk_pstn_with_caller_id | pbx-calls | manual | Verify outbound call via SIP trunk presents the correct Caller ID on the receiving end
59 | pbx-calls-check-caller_id_presentation_restriction_and_pai | pbx-calls | manual | Verify Caller ID presentation, Anonymous restriction (CLIR), and P-Asserted-Identity header
60 | pbx-calls-check-call_hold_resume_and_music_on_hold | pbx-calls | manual | Verify call hold, resume, and Music on Hold playback work correctly
61 | pbx-calls-check-call_waiting_notification_and_switching | pbx-calls | manual | Verify call waiting notification and switching between active and waiting calls
62 | pbx-calls-check-three_way_conference_and_multi_party_bridge | pbx-calls | manual | Verify three-way conference calling and multi-party conference bridge functionality
63 | pbx-codecs-check-codec_negotiation_g711_g729_opus_g722 | pbx-codecs | manual | Verify successful codec negotiation for G.711, G.729, Opus, and G.722
64 | pbx-codecs-check-dtmf_transmission_rfc2833_inband_sip_info | pbx-codecs | manual | Verify DTMF digit transmission via RFC2833, in-band audio, and SIP INFO methods
65 | pbx-codecs-check-t38_fax_passthrough_and_error_correction | pbx-codecs | manual | Verify T.38 fax passthrough and error correction (ECM) work correctly
66 | pbx-calls-security-check-srtp_sdes_or_dtls_media_encryption | pbx-calls-security | partial | Verify SRTP with SDES or DTLS-SRTP is enabled for media encryption on calls
67 | pbx-calls-security-check-acl_ip_whitelisting_and_rate_limiting | pbx-calls-security | partial | Verify ACL IP whitelisting rules and SIP rate limiting are configured and enforced
68 | pbx-calls-security-check-toll_fraud_prevention_rules_and_alerting | pbx-calls-security | automated | Verify toll fraud prevention rules and alert notifications are configured
69 | pbx-performance-check-cpu_memory_disk_io_utilization_under_sustained_load | pbx-performance | manual | Verify CPU, memory, and disk I/O remain within limits under sustained call load
70 | pbx-performance-check-long_duration_stability_72h_test | pbx-performance | manual | Verify system stability under continuous call load over a 72-hour period
71 | pbx-performance-check-memory_leak_and_resource_cleanup_detection | pbx-performance | manual | Detect memory leaks and verify proper resource cleanup over extended operation
72 | pbx-availability-check-active_passive_or_active_active_failover | pbx-availability | manual | Verify Active-Passive or Active-Active failover transitions correctly on node failure
73 | pbx-availability-check-database_replication_and_sync_integrity | pbx-availability | manual | Verify database replication between HA nodes maintains consistency and acceptable lag
74 | pbx-availability-check-automatic_failover_and_call_preservation | pbx-availability | manual | Verify automatic failover preserves active calls (no drops, no audio interruption > 200ms)
75 | pbx-availability-check-geographic_redundancy_and_geo_distribution | pbx-availability | manual | Verify geo-distributed deployment handles site failover without service interruption
76 | pbx-management-check-cli_management | pbx-management | partial | Verify CLI management interface is accessible and key management commands execute correctly
77 | pbx-management-check-gui_management | pbx-management | automated | Verify all main admin portal sections load correctly and management actions are functional
78 | pbx-logs-check-cdr_generation_accuracy_completeness_and_export | pbx-logs | automated | Verify CDR records contain all required fields and can be exported to CSV/PDF
79 | pbx-logs-check-real_time_active_call_and_registration_monitoring | pbx-logs | automated | Verify real-time monitoring dashboard shows active calls and SIP registrations
80 | pbx-logs-check-detailed_logging_levels_rotation_and_search | pbx-logs | automated | Verify logging levels, log rotation, and log search/filter functionality
81 | pbx-logs-check-threshold_alarms_cpu_channels_disk_memory | pbx-logs | automated | Verify threshold-based alarms for CPU, active channels, disk, and memory usage
82 | pbx-logs-check-call_quality_metrics_mos_jitter_loss_per_call | pbx-logs | partial | Verify per-call quality metrics (MOS score, jitter, packet loss) are collected and displayed
83 | pbx-regression-check-core_call_features_after_any_code_change | pbx-regression | partial | Run regression checks on core features after any code change to detect regressions
84 | pbx-regression-check-previously_fixed_bugs_and_edge_cases_reverification | pbx-regression | partial | Verify all previously fixed bugs and known edge cases have not regressed
85 | pbx-regression-check-performance_baselines_comparison_against_previous_version | pbx-regression | manual | Compare key performance metrics against baselines from the previous version
86 | pbx-regression-check-security_hardening_and_vulnerability_scan_baseline | pbx-regression | partial | Verify security hardening settings and compare vulnerability scan baseline against previous version

Generated by Test Case Editor • Data source: editor/data/testcases.json