cambios profundos con grok

This commit is contained in:
2026-05-26 00:42:42 +02:00
parent ee8cfa03ea
commit 19ea13dadd
99 changed files with 1447 additions and 2597 deletions
+37 -19
View File
@@ -6,26 +6,30 @@ Everything is stored as individual YAML files so they can be versioned with git.
## Directory Structure
```
testcases/<project>/<module>/<group>/<testcase-id>.yaml
testplans/<project>/<plan-id>.yaml
testcases/<module>/<group>/<testcase-id>.yaml
```
Current projects: `pbx`, `core` (add new projects at the same level).
- Top level under `testcases/` is the **module** (device/product type): `core/`, `pbx/`, `gateway/`, etc.
- `core/` = generic, cross-device concerns (documentation, security posture, installation, virtualization platform, etc.).
- `pbx/` = PBX-specific telephony concerns (extensions, calls, codecs, etc.).
- Add new device types (e.g. `gateway/`, `sbc/`) as siblings of `core/` and `pbx/`.
The old `<project>` level has been removed.
## Rules
- Every `id` must be **globally unique** across the entire system.
- Testplans **reference** testcases by their `id` (never embed content).
- Each **step** inside a testcase can be marked individually as automatable or not.
- The automation decision (`automation_status`) is made **at testcase level**, not per step.
- Steps are intentionally simple (`action` + `expected` + optional `notes`).
- `automatable` and `notYet` lists at testcase level are high-level summaries for reporting.
- `custom_fields` is a free-form object for future extensibility.
- Generated artifacts (from testplan export) live only under `tests/generated/<plan-id>/` and are never considered source of truth.
- Manual export of a testplan includes **only the steps where `automatable: false`**.
## testcase.yaml (example)
```yaml
id: pbx-extensions-check-create_modify_delete_sip_extensions
project: pbx
module: pbx
group: extensions
title: Create, modify and delete SIP extensions
@@ -39,21 +43,22 @@ preconditions: []
postconditions: []
steps:
- id: step-01
action: Open Extensions page in admin portal
- action: Open Extensions page in admin portal
expected: List of extensions is visible and searchable
automatable: true
- id: step-02
action: Create new SIP extension with random number and register on physical phone
- action: Create new SIP extension with random number and register on physical phone
expected: Extension appears in list and can register
automatable: false
reason_not_automatable: Requires physical phone hardware registration and audio validation
- id: step-03
action: Modify extension settings and verify changes
notes: Requires physical phone hardware registration and audio validation
- action: Modify extension settings and verify changes
expected: Changes are persisted and reflected in the system
automatable: true
automation_status: partial # automated | partial | manual (can be derived from steps)
automation_status: partial # automated | partial | manual
reason_not_automatable: Requires physical phone for registration/audio validation (step 2)
automatable:
- Portal UI steps for creating and editing extensions
notYet:
- Physical phone registration and real audio validation
file: tests/pbx/extensions.spec.ts # TEMPORARY during transition only
custom_fields: {}
```
@@ -63,7 +68,6 @@ custom_fields: {}
```yaml
id: pbx-regression-2026-05
name: PBX Regression Test Plan - May 2026
project: pbx
description: Full regression after v1.2.3
environment:
base_url: https://pbx.local:4443
@@ -82,15 +86,29 @@ testcases:
execution_notes: |
Run in isolated lab environment. Have physical phones ready for media tests.
automation_summary:
total: 3
automated: 1
partial: 1
manual: 1
automatable_percentage: 66.7
custom_fields: {}
```
## Export Behavior (when implemented)
From a composed testplan:
- **Manual deliverable**: HTML containing only steps where `automatable: false`
- **Manual deliverable**: HTML containing testcases where `automation_status` is `manual` or `partial`
- **Automated deliverable**: Playwright `.spec.ts` placed in `tests/generated/<plan-id>/` (usable directly by Playwright + MCP agent)
## Automation Model (Simplified)
- `automation_status` is the single source of truth for whether a testcase is automated.
- Steps are kept simple on purpose (`action` + `expected` + optional free-text `notes`).
- `automatable` / `notYet` lists at testcase level are **summaries** for reporting and planning.
- Per-step automation flags were removed (decision moved to testcase level).
## Transition Notes
- Until migration is complete, the old `editor/data/testcases.json` and existing `tests/*.spec.ts` remain the temporary source of truth.