añadido karpathy y refactorizacion del proyecto
This commit is contained in:
@@ -0,0 +1,102 @@
|
||||
# Test Case & Test Plan Schema (Canonical)
|
||||
|
||||
This is the **source of truth** for all testcases and testplans in the repository.
|
||||
Everything is stored as individual YAML files so they can be versioned with git.
|
||||
|
||||
## Directory Structure
|
||||
|
||||
```
|
||||
testcases/<project>/<module>/<group>/<testcase-id>.yaml
|
||||
testplans/<project>/<plan-id>.yaml
|
||||
```
|
||||
|
||||
Current projects: `pbx`, `core` (add new projects at the same level).
|
||||
|
||||
## Rules
|
||||
|
||||
- Every `id` must be **globally unique** across the entire system.
|
||||
- Testplans **reference** testcases by their `id` (never embed content).
|
||||
- Each **step** inside a testcase can be marked individually as automatable or not.
|
||||
- `custom_fields` is a free-form object for future extensibility.
|
||||
- Generated artifacts (from testplan export) live only under `tests/generated/<plan-id>/` and are never considered source of truth.
|
||||
- Manual export of a testplan includes **only the steps where `automatable: false`**.
|
||||
|
||||
## testcase.yaml (example)
|
||||
|
||||
```yaml
|
||||
id: pbx-extensions-check-create_modify_delete_sip_extensions
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: extensions
|
||||
title: Create, modify and delete SIP extensions
|
||||
description: Verify full CRUD lifecycle of SIP extensions via admin portal
|
||||
priority: High
|
||||
tags: [sip, provisioning]
|
||||
references: []
|
||||
dependencies: [] # other global testcase ids that must run before this one
|
||||
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
|
||||
steps:
|
||||
- id: step-01
|
||||
action: Open Extensions page in admin portal
|
||||
expected: List of extensions is visible and searchable
|
||||
automatable: true
|
||||
- id: step-02
|
||||
action: Create new SIP extension with random number and register on physical phone
|
||||
expected: Extension appears in list and can register
|
||||
automatable: false
|
||||
reason_not_automatable: Requires physical phone hardware registration and audio validation
|
||||
- id: step-03
|
||||
action: Modify extension settings and verify changes
|
||||
expected: Changes are persisted and reflected in the system
|
||||
automatable: true
|
||||
|
||||
automation_status: partial # automated | partial | manual (can be derived from steps)
|
||||
file: tests/pbx/extensions.spec.ts # TEMPORARY during transition only
|
||||
custom_fields: {}
|
||||
```
|
||||
|
||||
## testplan.yaml (example)
|
||||
|
||||
```yaml
|
||||
id: pbx-regression-2026-05
|
||||
name: PBX Regression Test Plan - May 2026
|
||||
project: pbx
|
||||
description: Full regression after v1.2.3
|
||||
environment:
|
||||
base_url: https://pbx.local:4443
|
||||
tenant: lab-qa
|
||||
|
||||
testcases:
|
||||
- ref: pbx-extensions-check-create_modify_delete_sip_extensions
|
||||
severity: High
|
||||
- ref: core-repository-check-presence_of_release_notes_and_changelog
|
||||
severity: Medium
|
||||
- ref: pbx-calls-check-internal_extension_to_extension_audio_call
|
||||
severity: Critical
|
||||
must_run_after:
|
||||
- pbx-extensions-check-create_modify_delete_sip_extensions
|
||||
|
||||
execution_notes: |
|
||||
Run in isolated lab environment. Have physical phones ready for media tests.
|
||||
|
||||
custom_fields: {}
|
||||
```
|
||||
|
||||
## Export Behavior (when implemented)
|
||||
|
||||
From a composed testplan:
|
||||
- **Manual deliverable**: HTML containing only steps where `automatable: false`
|
||||
- **Automated deliverable**: Playwright `.spec.ts` placed in `tests/generated/<plan-id>/` (usable directly by Playwright + MCP agent)
|
||||
|
||||
## Transition Notes
|
||||
|
||||
- Until migration is complete, the old `editor/data/testcases.json` and existing `tests/*.spec.ts` remain the temporary source of truth.
|
||||
- Once the YAML tree is populated and the editor reads from it, the YAML files become the single source of truth.
|
||||
- New testcases must be created as YAML files following this schema.
|
||||
|
||||
## Versioning
|
||||
|
||||
All changes to these YAML files are tracked with normal git. No application-level versioning is required.
|
||||
+59
@@ -0,0 +1,59 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.868Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-documentation-check-accuracy_installation_and_configuration_guide
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-documentation
|
||||
title: Verify accuracy of the Installation and Configuration Guide against actual system behaviour
|
||||
description: Verify accuracy of the Installation and Configuration Guide against actual system behaviour
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/documentation.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- 'Requires expert human review: QA engineer must follow the guide step-by-step on a clean system'
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: 'Requires expert human review: QA engineer must follow the guide step-by-step on a clean system'
|
||||
+59
@@ -0,0 +1,59 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.872Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-documentation-check-accuracy_trouble_shooting_guide
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-documentation
|
||||
title: Verify the Troubleshooting Guide procedures are accurate and complete
|
||||
description: Verify the Troubleshooting Guide procedures are accurate and complete
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/documentation.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires expert human review to validate each troubleshooting scenario on a real system
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires expert human review to validate each troubleshooting scenario on a real system
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.873Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-documentation-write-changed_cli_configuration_commands
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-documentation
|
||||
title: Extract and record changed CLI configuration commands for this release
|
||||
description: Extract and record changed CLI configuration commands for this release
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/documentation.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.874Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-documentation-write-release_notes_feature_changes_and_known_issues
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-documentation
|
||||
title: Extract and record Release Notes, feature changes, and known issues
|
||||
description: Extract and record Release Notes, feature changes, and known issues
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/documentation.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+68
@@ -0,0 +1,68 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.875Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-features-check-backward_compatibility_of_new_features
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-features
|
||||
title: >-
|
||||
Verify new features are backward-compatible with existing configurations and older endpoint
|
||||
firmware
|
||||
description: >-
|
||||
Verify new features are backward-compatible with existing configurations and older endpoint
|
||||
firmware
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/core/features.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Configuration import checks automated; functional compatibility with older endpoints requires
|
||||
manual testing
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
Configuration import checks automated; functional compatibility with older endpoints requires
|
||||
manual testing
|
||||
+60
@@ -0,0 +1,60 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.880Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-features-check-integration_of_new_features_with_existing_call_processing_and_modules
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-features
|
||||
title: Verify new features integrate correctly with existing call processing and system modules
|
||||
description: Verify new features integrate correctly with existing call processing and system modules
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/core/features.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- UI config checks automated; actual call-flow integration requires active telephony endpoints
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: UI config checks automated; actual call-flow integration requires active telephony endpoints
|
||||
+61
@@ -0,0 +1,61 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.882Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-features-check-performance_and_resource_impact_assessment_of_new_features
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-features
|
||||
title: Assess CPU/memory/network resource impact of new features under representative call load
|
||||
description: Assess CPU/memory/network resource impact of new features under representative call load
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/features.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires SIPp load generator, performance monitoring infrastructure, and sustained load
|
||||
testing
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires SIPp load generator, performance monitoring infrastructure, and sustained load testing
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.884Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-features-check-provisioning_changes_for_new_features
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-features
|
||||
title: Verify provisioning settings for new features are accessible in the admin portal
|
||||
description: Verify provisioning settings for new features are accessible in the admin portal
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/features.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,61 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.886Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-features-write-analysis_of_new_security_risks
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-features
|
||||
title: Identify, analyse, and document new security risks introduced by features in this release
|
||||
description: Identify, analyse, and document new security risks introduced by features in this release
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/features.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Security risk analysis requires expert threat modelling, source code review, and human
|
||||
judgment
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Security risk analysis requires expert threat modelling, source code review, and human judgment
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.888Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-features-write-summary_of_each_new_feature_per_release
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-features
|
||||
title: Extract and record a summary of each new feature included in this release
|
||||
description: Extract and record a summary of each new feature included in this release
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/features.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.892Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-features-write-ui_ux_and_admin_portal_changes_validation
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-features
|
||||
title: Capture and record all UI/UX changes in the admin portal for this release
|
||||
description: Capture and record all UI/UX changes in the admin portal for this release
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/features.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,59 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.893Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-installation-check-fresh_installation
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-installation
|
||||
title: Verify complete fresh installation from scratch succeeds on each supported hypervisor
|
||||
description: Verify complete fresh installation from scratch succeeds on each supported hypervisor
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/installation.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires provisioning a clean VM, mounting ISO/OVA, and running the installation wizard
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires provisioning a clean VM, mounting ISO/OVA, and running the installation wizard
|
||||
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.894Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-installation-check-initial_configuration
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-installation
|
||||
title: Verify the initial configuration wizard completes successfully
|
||||
description: Verify the initial configuration wizard completes successfully
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/installation.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.895Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-installation-check-license_activation
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-installation
|
||||
title: Verify license activation completes successfully and licensed features are unlocked
|
||||
description: Verify license activation completes successfully and licensed features are unlocked
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/installation.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+64
@@ -0,0 +1,64 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.896Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-installation-check-post_install_service_status_and_port_verification
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-installation
|
||||
title: Verify all required services are running and expected ports are open after installation
|
||||
description: Verify all required services are running and expected ports are open after installation
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/core/installation.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Service status via admin portal automated; TCP port verification requires nmap from external
|
||||
host
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
Service status via admin portal automated; TCP port verification requires nmap from external
|
||||
host
|
||||
@@ -0,0 +1,61 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.897Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-interoperability-check-addm
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-interoperability
|
||||
title: Verify ADDM integration is configured and reporting discovery data correctly
|
||||
description: Verify ADDM integration is configured and reporting discovery data correctly
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: External Systems
|
||||
value: SIEM server (Splunk, ELK, QRadar) and/or ADDM/ADDM collector
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/interoperability.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: External Systems
|
||||
value: SIEM server (Splunk, ELK, QRadar) and/or ADDM/ADDM collector
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,61 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.898Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-interoperability-check-siem
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-interoperability
|
||||
title: Verify SIEM integration is configured and forwarding security events
|
||||
description: Verify SIEM integration is configured and forwarding security events
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: External Systems
|
||||
value: SIEM server (Splunk, ELK, QRadar) and/or ADDM/ADDM collector
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/interoperability.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: External Systems
|
||||
value: SIEM server (Splunk, ELK, QRadar) and/or ADDM/ADDM collector
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.898Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-repository-check-presence_of_all_mandatory_core-documentation_files
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-repository
|
||||
title: Verify all mandatory core documentation files are listed in the repository
|
||||
description: Verify all mandatory core documentation files are listed in the repository
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/repository.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.899Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-repository-check-presence_of_companion_tools_and_supporting_scripts
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-repository
|
||||
title: Verify companion tools and supporting scripts are available in the repository
|
||||
description: Verify companion tools and supporting scripts are available in the repository
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/repository.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.899Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-repository-check-presence_of_main_software_version_all_hypervisors
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-repository
|
||||
title: Verify main software version packages are available for all supported hypervisors
|
||||
description: Verify main software version packages are available for all supported hypervisors
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/repository.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.900Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-repository-check-presence_of_patch_version_and_its_compatibility
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-repository
|
||||
title: Verify patch version packages and compatibility matrices are present
|
||||
description: Verify patch version packages and compatibility matrices are present
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/repository.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.900Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-repository-check-presence_of_release_notes_and_changelog
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-repository
|
||||
title: FASE1-TEST-1779730773816
|
||||
description: FASE1-TEST-1779730773816
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/repository.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.901Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-repository-check-presence_of_trouble_shooting_guide
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-repository
|
||||
title: Verify Troubleshooting Guide is present in the repository
|
||||
description: Verify Troubleshooting Guide is present in the repository
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the download / documentation portal
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Search or locate the relevant file/link by filename pattern
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert presence and visibility of the expected document
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/repository.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.902Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-auto_enrollment_certificate_management_process
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify auto-enrollment certificate management (ACME/Let's Encrypt) is configured and functional
|
||||
description: Verify auto-enrollment certificate management (ACME/Let's Encrypt) is configured and functional
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+62
@@ -0,0 +1,62 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.904Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-encryption_of_sensitive_data_at_rest_and_in_transit
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify sensitive data is encrypted at rest (DB) and in transit (HTTPS/TLS)
|
||||
description: Verify sensitive data is encrypted at rest (DB) and in transit (HTTPS/TLS)
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
HTTPS/TLS configuration verified via portal; DB-level at-rest encryption requires SSH/CLI
|
||||
access
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: HTTPS/TLS configuration verified via portal; DB-level at-rest encryption requires SSH/CLI access
|
||||
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.905Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-ip_access_control_lists
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify IP Access Control Lists are properly configured and enforced
|
||||
description: Verify IP Access Control Lists are properly configured and enforced
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+63
@@ -0,0 +1,63 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.905Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-known_vulnerable_dependencies_in_release_artifacts
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify release artifacts do not contain known vulnerable dependencies (CVE scan)
|
||||
description: Verify release artifacts do not contain known vulnerable dependencies (CVE scan)
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Vulnerability report page in portal automated; actual CVE scanning requires Trivy/OWASP-DC in
|
||||
CI
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Full CVE / dependency scanning (Trivy, Grype, OWASP Dependency-Check) in CI pipeline
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: Vulnerability report page in portal automated; actual CVE scanning requires Trivy/OWASP-DC in CI
|
||||
+59
@@ -0,0 +1,59 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.906Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-obtain_formal_security_team_sign_off_for_the_new_version
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Obtain formal written sign-off from the Security team approving the release
|
||||
description: Obtain formal written sign-off from the Security team approving the release
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Governance gate requiring human decision and formal sign-off document; cannot be automated
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Governance gate requiring human decision and formal sign-off document; cannot be automated
|
||||
+61
@@ -0,0 +1,61 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.907Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-previous_security_findings_have_been_remediated_before_release
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify all previously identified security findings are remediated before release
|
||||
description: Verify all previously identified security findings are remediated before release
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires access to security issue tracker and cross-referencing CVEs with the release
|
||||
changelog
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires access to security issue tracker and cross-referencing CVEs with the release changelog
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.908Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-security_event_logging_and_audit_trail_is_active
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify security event logging and audit trail are active and recording events
|
||||
description: Verify security event logging and audit trail are active and recording events
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.909Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-sip_tls_and_srtp_encryption_enabled_by_default
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify SIP TLS and SRTP media encryption are enabled by default
|
||||
description: Verify SIP TLS and SRTP media encryption are enabled by default
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+60
@@ -0,0 +1,60 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.910Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-unnecessary_services_and_ports_are_disabled
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify unnecessary services and network ports are disabled
|
||||
description: Verify unnecessary services and network ports are disabled
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- Service status via admin portal automated; port scanning requires nmap from external host
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: Service status via admin portal automated; port scanning requires nmap from external host
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.910Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-check-verify_role_based_access_control_and_least_privilege_principle
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Verify RBAC roles are correctly defined and least-privilege principle is enforced
|
||||
description: Verify RBAC roles are correctly defined and least-privilege principle is enforced
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.911Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-security-write-strong_password_policy
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-security
|
||||
title: Navigate to security settings and record the current password policy configuration
|
||||
description: Navigate to security settings and record the current password policy configuration
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/security.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+64
@@ -0,0 +1,64 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.912Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-upgrade-check-configuration_and_database_migration_validation
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-upgrade
|
||||
title: Verify configuration objects and database content migrate correctly after upgrade
|
||||
description: Verify configuration objects and database content migrate correctly after upgrade
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/core/upgrade.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
UI configuration checks automated; DB schema integrity validation requires direct database
|
||||
access
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
UI configuration checks automated; DB schema integrity validation requires direct database
|
||||
access
|
||||
+59
@@ -0,0 +1,59 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.912Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-upgrade-check-in_place_upgrade_from_previous_major_version
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-upgrade
|
||||
title: Verify in-place upgrade from the previous major version completes successfully without data loss
|
||||
description: Verify in-place upgrade from the previous major version completes successfully without data loss
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/upgrade.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires a running instance of the previous version and dedicated upgrade test environment
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires a running instance of the previous version and dedicated upgrade test environment
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.913Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-upgrade-check-post_upgrade_regression_of_core_features
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-upgrade
|
||||
title: Run automated regression checks on core portal features after upgrade
|
||||
description: Run automated regression checks on core portal features after upgrade
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/upgrade.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+59
@@ -0,0 +1,59 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.914Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-upgrade-check-rollback_procedure_execution_and_verification
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-upgrade
|
||||
title: Verify the rollback procedure successfully reverts the system to the previous version
|
||||
description: Verify the rollback procedure successfully reverts the system to the previous version
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/upgrade.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires VM snapshot revert or package downgrade; needs physical/hypervisor-level access
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires VM snapshot revert or package downgrade; needs physical/hypervisor-level access
|
||||
+59
@@ -0,0 +1,59 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.915Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-upgrade-check-schema_upgrade_and_data_integrity_check
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-upgrade
|
||||
title: Verify database schema is correctly upgraded and all data maintains integrity
|
||||
description: Verify database schema is correctly upgraded and all data maintains integrity
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/upgrade.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires direct database access (psql/mysql) and schema comparison tooling
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires direct database access (psql/mysql) and schema comparison tooling
|
||||
+63
@@ -0,0 +1,63 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.916Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-upgrade-check-zero_downtime_upgrade_where_supported
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-upgrade
|
||||
title: Verify zero-downtime upgrade keeps the service available throughout the upgrade process
|
||||
description: Verify zero-downtime upgrade keeps the service available throughout the upgrade process
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Prepare clean or previous-version VM/image
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Perform installation or upgrade procedure
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Post-install verification via portal + external tools
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/upgrade.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires active call sessions monitored during the upgrade window; calls cannot be managed by
|
||||
Playwright
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: >-
|
||||
Requires active call sessions monitored during the upgrade window; calls cannot be managed by
|
||||
Playwright
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.916Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-virtualization-check-hypervisor_level_high_availability
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-virtualization
|
||||
title: Verify hypervisor-level HA restarts the PBX VM after a host failure
|
||||
description: Verify hypervisor-level HA restarts the PBX VM after a host failure
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/virtualization.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires physical HA cluster with multiple hypervisor hosts; host failure must be simulated
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires physical HA cluster with multiple hypervisor hosts; host failure must be simulated
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.917Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-virtualization-check-live_migration_and_active_call_preservation
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-virtualization
|
||||
title: Verify VM live migration preserves active calls without interruption
|
||||
description: Verify VM live migration preserves active calls without interruption
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/virtualization.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires HA infrastructure with 2+ hypervisor hosts and active SIP call sessions during
|
||||
migration
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: >-
|
||||
Requires HA infrastructure with 2+ hypervisor hosts and active SIP call sessions during
|
||||
migration
|
||||
+70
@@ -0,0 +1,70 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.917Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-virtualization-check-snapshot_backup_restore_and_consistency
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-virtualization
|
||||
title: Verify VM snapshot and restore operations maintain full system consistency
|
||||
description: Verify VM snapshot and restore operations maintain full system consistency
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/core/virtualization.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Post-restore consistency checks via admin portal automated; snapshot/restore operation needs
|
||||
hypervisor access
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
Post-restore consistency checks via admin portal automated; snapshot/restore operation needs
|
||||
hypervisor access
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.918Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-virtualization-write-guest_agent_integration
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-virtualization
|
||||
title: Record guest agent integration status for each supported hypervisor
|
||||
description: Record guest agent integration status for each supported hypervisor
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/virtualization.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires direct access to hypervisor console (vCenter, Hyper-V Manager, virsh)
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires direct access to hypervisor console (vCenter, Hyper-V Manager, virsh)
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.918Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-virtualization-write-resource_allocation_vcpu_vram_vdisk
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-virtualization
|
||||
title: Record vCPU, vRAM, and vDisk resource allocation for deployment templates
|
||||
description: Record vCPU, vRAM, and vDisk resource allocation for deployment templates
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/virtualization.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Hypervisor management plane access required; not exposed in PBX admin portal
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Hypervisor management plane access required; not exposed in PBX admin portal
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.919Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-virtualization-write-storage_thin_vs_thick_provisioning
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-virtualization
|
||||
title: Record storage provisioning type and performance implications for each hypervisor
|
||||
description: Record storage provisioning type and performance implications for each hypervisor
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/virtualization.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Storage details only visible in hypervisor storage management interface
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Storage details only visible in hypervisor storage management interface
|
||||
+63
@@ -0,0 +1,63 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.919Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-virtualization-write-supported_hypervisors_deployment
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-virtualization
|
||||
title: Record the list of supported hypervisors and deployment methods from the download portal
|
||||
description: Record the list of supported hypervisors and deployment methods from the download portal
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/core/virtualization.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet:
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.920Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: core-virtualization-write-virtual_networking_configuration
|
||||
project: pbx
|
||||
module: core
|
||||
group: core-virtualization
|
||||
title: 'Record virtual networking configuration: virtual switches, VLANs, NIC assignments'
|
||||
description: 'Record virtual networking configuration: virtual switches, VLANs, NIC assignments'
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/core/virtualization.spec.ts
|
||||
custom_fields:
|
||||
original_action: write
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires access to hypervisor networking configuration and virtual switch management
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS (admin portal) + optional SSH/CLI
|
||||
- label: Hypervisor Access
|
||||
value: vCenter, Hyper-V Manager, Proxmox, or virsh (SSH/API)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires access to hypervisor networking configuration and virtual switch management
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.920Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-availability-check-active_passive_or_active_active_failover
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-availability
|
||||
title: Verify Active-Passive or Active-Active failover transitions correctly on node failure
|
||||
description: Verify Active-Passive or Active-Active failover transitions correctly on node failure
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/availability.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires HA cluster with 2+ nodes; failover must be triggered by stopping the active node
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires HA cluster with 2+ nodes; failover must be triggered by stopping the active node
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.921Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-availability-check-automatic_failover_and_call_preservation
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-availability
|
||||
title: Verify automatic failover preserves active calls (no drops, no audio interruption > 200ms)
|
||||
description: Verify automatic failover preserves active calls (no drops, no audio interruption > 200ms)
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/availability.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires active call sessions during failover and simultaneous call-state monitoring
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires active call sessions during failover and simultaneous call-state monitoring
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.922Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-availability-check-database_replication_and_sync_integrity
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-availability
|
||||
title: Verify database replication between HA nodes maintains consistency and acceptable lag
|
||||
description: Verify database replication between HA nodes maintains consistency and acceptable lag
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/availability.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires HA database cluster; verifying replication lag needs direct database access
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires HA database cluster; verifying replication lag needs direct database access
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.923Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-availability-check-geographic_redundancy_and_geo_distribution
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-availability
|
||||
title: Verify geo-distributed deployment handles site failover without service interruption
|
||||
description: Verify geo-distributed deployment handles site failover without service interruption
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/availability.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires multi-site infrastructure across geographic locations or WAN simulation
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires multi-site infrastructure across geographic locations or WAN simulation
|
||||
+74
@@ -0,0 +1,74 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.936Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-security-check-acl_ip_whitelisting_and_rate_limiting
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls-security
|
||||
title: Verify ACL IP whitelisting rules and SIP rate limiting are configured and enforced
|
||||
description: Verify ACL IP whitelisting rules and SIP rate limiting are configured and enforced
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/pbx/calls-security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
ACL/rate-limit config via portal automated; functional enforcement testing requires
|
||||
network-level testing from non-whitelisted IP
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
ACL/rate-limit config via portal automated; functional enforcement testing requires
|
||||
network-level testing from non-whitelisted IP
|
||||
+74
@@ -0,0 +1,74 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.938Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-security-check-srtp_sdes_or_dtls_media_encryption
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls-security
|
||||
title: Verify SRTP with SDES or DTLS-SRTP is enabled for media encryption on calls
|
||||
description: Verify SRTP with SDES or DTLS-SRTP is enabled for media encryption on calls
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/pbx/calls-security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Encryption config verified via admin portal; confirming live RTP is encrypted requires
|
||||
Wireshark during active call
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
Encryption config verified via admin portal; confirming live RTP is encrypted requires Wireshark
|
||||
during active call
|
||||
+67
@@ -0,0 +1,67 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.938Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-security-check-toll_fraud_prevention_rules_and_alerting
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls-security
|
||||
title: Verify toll fraud prevention rules and alert notifications are configured
|
||||
description: Verify toll fraud prevention rules and alert notifications are configured
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/calls-security.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet:
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.924Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-check-call_hold_resume_and_music_on_hold
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls
|
||||
title: Verify call hold, resume, and Music on Hold playback work correctly
|
||||
description: Verify call hold, resume, and Music on Hold playback work correctly
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/calls.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires an active two-party call; MoH requires audio monitoring with real SIP phone hardware
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires an active two-party call; MoH requires audio monitoring with real SIP phone hardware
|
||||
@@ -0,0 +1,73 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.925Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-check-call_waiting_notification_and_switching
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls
|
||||
title: Verify call waiting notification and switching between active and waiting calls
|
||||
description: Verify call waiting notification and switching between active and waiting calls
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/calls.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires concurrent call sessions on the same extension with physical/softphone capable of
|
||||
call-waiting
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: >-
|
||||
Requires concurrent call sessions on the same extension with physical/softphone capable of
|
||||
call-waiting
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.926Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-check-caller_id_presentation_restriction_and_pai
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls
|
||||
title: Verify Caller ID presentation, Anonymous restriction (CLIR), and P-Asserted-Identity header
|
||||
description: Verify Caller ID presentation, Anonymous restriction (CLIR), and P-Asserted-Identity header
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/calls.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires active call sessions and SIP packet capture to verify PAI header values
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires active call sessions and SIP packet capture to verify PAI header values
|
||||
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.927Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-check-inbound_call_from_sip_trunk_pstn
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls
|
||||
title: Verify inbound call from a SIP trunk/PSTN routes correctly to the configured destination
|
||||
description: Verify inbound call from a SIP trunk/PSTN routes correctly to the configured destination
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/calls.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires live SIP trunk connectivity to PSTN and a real DID number
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires live SIP trunk connectivity to PSTN and a real DID number
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.928Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-check-internal_extension_to_extension_audio_call
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls
|
||||
title: Verify internal extension-to-extension audio call connects with bi-directional audio
|
||||
description: Verify internal extension-to-extension audio call connects with bi-directional audio
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/calls.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires two active SIP endpoints and human verification of two-way audio quality
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires two active SIP endpoints and human verification of two-way audio quality
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.932Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-check-outbound_call_to_sip_trunk_pstn_with_caller_id
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls
|
||||
title: Verify outbound call via SIP trunk presents the correct Caller ID on the receiving end
|
||||
description: Verify outbound call via SIP trunk presents the correct Caller ID on the receiving end
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/calls.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires live SIP trunk and verification of Caller ID at receiving PSTN party
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires live SIP trunk and verification of Caller ID at receiving PSTN party
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.935Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-calls-check-three_way_conference_and_multi_party_bridge
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-calls
|
||||
title: Verify three-way conference calling and multi-party conference bridge functionality
|
||||
description: Verify three-way conference calling and multi-party conference bridge functionality
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/calls.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires three or more active SIP endpoints and audio verification by human listeners
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires three or more active SIP endpoints and audio verification by human listeners
|
||||
@@ -0,0 +1,73 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.939Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-codecs-check-codec_negotiation_g711_g729_opus_g722
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-codecs
|
||||
title: Verify successful codec negotiation for G.711, G.729, Opus, and G.722
|
||||
description: Verify successful codec negotiation for G.711, G.729, Opus, and G.722
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/codecs.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires SIP call traffic with codec-constrained endpoints and Wireshark packet capture to
|
||||
verify SDP negotiation
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: >-
|
||||
Requires SIP call traffic with codec-constrained endpoints and Wireshark packet capture to
|
||||
verify SDP negotiation
|
||||
+73
@@ -0,0 +1,73 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.940Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-codecs-check-dtmf_transmission_rfc2833_inband_sip_info
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-codecs
|
||||
title: Verify DTMF digit transmission via RFC2833, in-band audio, and SIP INFO methods
|
||||
description: Verify DTMF digit transmission via RFC2833, in-band audio, and SIP INFO methods
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/codecs.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires active call sessions with DTMF generation, packet capture, and IVR system for
|
||||
verification
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: >-
|
||||
Requires active call sessions with DTMF generation, packet capture, and IVR system for
|
||||
verification
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.940Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-codecs-check-t38_fax_passthrough_and_error_correction
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-codecs
|
||||
title: Verify T.38 fax passthrough and error correction (ECM) work correctly
|
||||
description: Verify T.38 fax passthrough and error correction (ECM) work correctly
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Ensure SIP endpoints / softphones are registered
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Initiate or receive call using the required scenario
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Verify audio path, signaling, and media parameters
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/codecs.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires fax hardware or fax emulator (HylaFAX) and T.38 stack support
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Real RTP/SRTP media path and audio quality verification (human ear or PESQ/MOS tools)
|
||||
- External SIP trunk / PSTN connectivity and DID numbers
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires fax hardware or fax emulator (HylaFAX) and T.38 stack support
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.941Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-configuration-check-backup_restore_full_system_configuration
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-configuration
|
||||
title: Verify full system configuration backup and restore operations work correctly
|
||||
description: Verify full system configuration backup and restore operations work correctly
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/configuration.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.941Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-configuration-check-bulk_csv_import_export_of_settings
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-configuration
|
||||
title: Verify bulk CSV import and export of settings
|
||||
description: Verify bulk CSV import and export of settings
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/configuration.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.942Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-configuration-check-dialplan_route_and_outbound_rule_creation
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-configuration
|
||||
title: Verify creation and validation of dial plan rules and outbound routes
|
||||
description: Verify creation and validation of dial plan rules and outbound routes
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/configuration.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.943Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-configuration-check-initial_system_setup_and_network_settings
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-configuration
|
||||
title: Verify initial PBX system setup and network settings are correctly configured
|
||||
description: Verify initial PBX system setup and network settings are correctly configured
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Log in to the admin portal (if required)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Navigate to the relevant settings section
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Read current configuration values via UI or API
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/configuration.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+65
@@ -0,0 +1,65 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.943Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-extensions-check-create_modify_delete_sip_extensions
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-extensions
|
||||
title: Verify full CRUD lifecycle for SIP extensions in the admin portal
|
||||
description: Verify full CRUD lifecycle for SIP extensions in the admin portal
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/extensions.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,72 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.944Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-extensions-check-device_provisioning
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-extensions
|
||||
title: 'Verify automatic device provisioning: profile generation and server URL accessible'
|
||||
description: 'Verify automatic device provisioning: profile generation and server URL accessible'
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/pbx/extensions.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Provisioning profile creation via admin portal automated; actual device provisioning requires
|
||||
physical phone
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
Provisioning profile creation via admin portal automated; actual device provisioning requires
|
||||
physical phone
|
||||
+67
@@ -0,0 +1,67 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.945Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-extensions-check-extension_registration_with_deskphones_softphones
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-extensions
|
||||
title: Verify SIP extension registers successfully from a desk phone and a softphone client
|
||||
description: Verify SIP extension registers successfully from a desk phone and a softphone client
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/extensions.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- Requires physical SIP desk phone (Yealink, Polycom) or softphone (Zoiper, MicroSIP)
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: SIP Endpoints
|
||||
value: 'At least 2 registered SIP clients (deskphone or softphone: Zoiper, MicroSIP, Yealink, etc.)'
|
||||
- label: Network
|
||||
value: SIP trunk or local Asterisk/FreeSWITCH simulator for PSTN simulation
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires physical SIP desk phone (Yealink, Polycom) or softphone (Zoiper, MicroSIP)
|
||||
+64
@@ -0,0 +1,64 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.946Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-logs-check-call_quality_metrics_mos_jitter_loss_per_call
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-logs
|
||||
title: Verify per-call quality metrics (MOS score, jitter, packet loss) are collected and displayed
|
||||
description: Verify per-call quality metrics (MOS score, jitter, packet loss) are collected and displayed
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/pbx/logs.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
QoS metrics display UI automated; actual metric generation requires active call sessions with
|
||||
network impairment
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
QoS metrics display UI automated; actual metric generation requires active call sessions with
|
||||
network impairment
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.947Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-logs-check-cdr_generation_accuracy_completeness_and_export
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-logs
|
||||
title: Verify CDR records contain all required fields and can be exported to CSV/PDF
|
||||
description: Verify CDR records contain all required fields and can be exported to CSV/PDF
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/logs.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.948Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-logs-check-detailed_logging_levels_rotation_and_search
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-logs
|
||||
title: Verify logging levels, log rotation, and log search/filter functionality
|
||||
description: Verify logging levels, log rotation, and log search/filter functionality
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/logs.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+57
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.948Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-logs-check-real_time_active_call_and_registration_monitoring
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-logs
|
||||
title: Verify real-time monitoring dashboard shows active calls and SIP registrations
|
||||
description: Verify real-time monitoring dashboard shows active calls and SIP registrations
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/logs.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.949Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-logs-check-threshold_alarms_cpu_channels_disk_memory
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-logs
|
||||
title: Verify threshold-based alarms for CPU, active channels, disk, and memory usage
|
||||
description: Verify threshold-based alarms for CPU, active channels, disk, and memory usage
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/logs.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
@@ -0,0 +1,64 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.950Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-management-check-cli_management
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-management
|
||||
title: Verify CLI management interface is accessible and key management commands execute correctly
|
||||
description: Verify CLI management interface is accessible and key management commands execute correctly
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/pbx/management.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Web console (if present) verified via Playwright; full CLI coverage requires SSH automation
|
||||
integrated in CI pipeline
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
Web console (if present) verified via Playwright; full CLI coverage requires SSH automation
|
||||
integrated in CI pipeline
|
||||
@@ -0,0 +1,57 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.951Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-management-check-gui_management
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-management
|
||||
title: Verify all main admin portal sections load correctly and management actions are functional
|
||||
description: Verify all main admin portal sections load correctly and management actions are functional
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: automated
|
||||
file: tests/pbx/management.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Full end-to-end execution via Playwright against the admin portal UI
|
||||
- Navigation, form interaction, and assertions are scriptable
|
||||
original_notYet: []
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
+67
@@ -0,0 +1,67 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.952Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-performance-check-cpu_memory_disk_io_utilization_under_sustained_load
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-performance
|
||||
title: Verify CPU, memory, and disk I/O remain within limits under sustained call load
|
||||
description: Verify CPU, memory, and disk I/O remain within limits under sustained call load
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/performance.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires SIPp load generator, server-side performance monitoring, and dedicated test
|
||||
environment
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires SIPp load generator, server-side performance monitoring, and dedicated test environment
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.952Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-performance-check-long_duration_stability_72h_test
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-performance
|
||||
title: Verify system stability under continuous call load over a 72-hour period
|
||||
description: Verify system stability under continuous call load over a 72-hour period
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/performance.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
72-hour test requires dedicated environment, SIPp continuous load, and automated monitoring
|
||||
with alerting
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: >-
|
||||
72-hour test requires dedicated environment, SIPp continuous load, and automated monitoring with
|
||||
alerting
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.953Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-performance-check-memory_leak_and_resource_cleanup_detection
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-performance
|
||||
title: Detect memory leaks and verify proper resource cleanup over extended operation
|
||||
description: Detect memory leaks and verify proper resource cleanup over extended operation
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/performance.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires extended monitoring with active call load and memory profiling tools (Valgrind, heap
|
||||
dumps)
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Hypervisor-level operations (vCenter, libvirt, vSphere) not reachable from browser automation
|
||||
- Long-running load or HA failover scenarios need dedicated lab infrastructure
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Load Gen
|
||||
value: SIPp or custom load generator + monitoring (Prometheus/Grafana recommended)
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: >-
|
||||
Requires extended monitoring with active call load and memory profiling tools (Valgrind, heap
|
||||
dumps)
|
||||
+64
@@ -0,0 +1,64 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.953Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-regression-check-core_call_features_after_any_code_change
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-regression
|
||||
title: Run regression checks on core features after any code change to detect regressions
|
||||
description: Run regression checks on core features after any code change to detect regressions
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/pbx/regression.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Admin portal regression automated; call-flow regression (inbound/outbound/hold/transfer)
|
||||
requires SIP endpoints
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
Admin portal regression automated; call-flow regression (inbound/outbound/hold/transfer)
|
||||
requires SIP endpoints
|
||||
+61
@@ -0,0 +1,61 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.954Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-regression-check-performance_baselines_comparison_against_previous_version
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-regression
|
||||
title: Compare key performance metrics against baselines from the previous version
|
||||
description: Compare key performance metrics against baselines from the previous version
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: false
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: false
|
||||
automation_status: manual
|
||||
file: tests/pbx/regression.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Most UI-driven configuration and verification steps via Playwright
|
||||
original_notYet:
|
||||
- >-
|
||||
Requires SIPp load tests and statistical comparison of results against previous version
|
||||
baseline
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
manualReason: Requires SIPp load tests and statistical comparison of results against previous version baseline
|
||||
+64
@@ -0,0 +1,64 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.954Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-regression-check-previously_fixed_bugs_and_edge_cases_reverification
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-regression
|
||||
title: Verify all previously fixed bugs and known edge cases have not regressed
|
||||
description: Verify all previously fixed bugs and known edge cases have not regressed
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/pbx/regression.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
UI bug regressions automated; telephony-layer bug regressions require SIP client or SSH
|
||||
verification
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
UI bug regressions automated; telephony-layer bug regressions require SIP client or SSH
|
||||
verification
|
||||
+69
@@ -0,0 +1,69 @@
|
||||
# Updated via Autotest Editor - 2026-05-25T17:39:33.955Z
|
||||
# Source of truth: this YAML file
|
||||
|
||||
id: pbx-regression-check-security_hardening_and_vulnerability_scan_baseline
|
||||
project: pbx
|
||||
module: pbx
|
||||
group: pbx-regression
|
||||
title: >-
|
||||
Verify security hardening settings and compare vulnerability scan baseline against previous
|
||||
version
|
||||
description: >-
|
||||
Verify security hardening settings and compare vulnerability scan baseline against previous
|
||||
version
|
||||
priority: Medium
|
||||
tags: []
|
||||
references: []
|
||||
dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
preconditions: []
|
||||
postconditions: []
|
||||
steps:
|
||||
- action: Open admin portal or repository URL in browser context
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Execute the main verification or configuration action described in the test
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Capture evidence (screenshot, log, API response)
|
||||
expected: ''
|
||||
automatable: true
|
||||
- action: Assert expected outcome
|
||||
expected: ''
|
||||
automatable: true
|
||||
automation_status: partial
|
||||
file: tests/pbx/regression.spec.ts
|
||||
custom_fields:
|
||||
original_action: check
|
||||
original_automatable:
|
||||
- Portal UI configuration and verification steps (already partially automated)
|
||||
- Data extraction and reporting of current settings
|
||||
original_notYet:
|
||||
- >-
|
||||
Security config checks via portal automated; full CVE scan baseline requires Trivy/OpenVAS in
|
||||
CI pipeline
|
||||
- Requires external SIP endpoints or physical phones for media/audio validation
|
||||
- Full CVE / dependency scanning (Trivy, Grype, OWASP Dependency-Check) in CI pipeline
|
||||
original_dependencies:
|
||||
- label: Admin Portal
|
||||
value: https://pbx.local:4443 (configure via $BASE_URL)
|
||||
- label: Repository URL
|
||||
value: ${BASE_URL}/downloads or $REPO_URL
|
||||
- label: Protocol
|
||||
value: HTTPS + SIP (UDP/TCP/TLS) + RTP/SRTP
|
||||
- label: Credentials
|
||||
value: Admin user with sufficient privileges (portal + SSH where needed)
|
||||
- label: Test Data
|
||||
value: Clean test tenant or lab PBX instance (recommended isolated environment)
|
||||
partialNotes: >-
|
||||
Security config checks via portal automated; full CVE scan baseline requires Trivy/OpenVAS in CI
|
||||
pipeline
|
||||
Reference in New Issue
Block a user