sortOfRemoteNG

E2E Tier Map

Purpose

This document is the current classification of the E2E surface into required, opt-in, nightly, and lab-only tiers.

It complements the E2E runbook and turns the E2E coverage improvement plan into a concrete, reviewable map.

Ruleset Target

The repo now contains the required smoke workflow in .github/workflows/e2e-smoke.yml, but GitHub branch protection or rulesets still have to be configured in the repository settings UI.

The check to require is:

  • Workflow: E2E Smoke
  • Job / status check: SSH/SFTP smoke

Source control cannot enforce that settings change by itself.

Classification Logic

  • required: deterministic, hosted-CI-safe, no specialty environment dependency, strong assertions expected
  • opt-in: reproducible and useful for risky PRs, but slower, timing-heavier, or broader than a universal PR gate should carry
  • nightly: useful regression signal with heavier UI coverage, weaker current signal quality, or timing-sensitive behavior
  • lab-only: vendor, cloud, real updater install, multi-window, discovery, or other environment-sensitive flows that should not be treated as standard hosted-CI coverage

WDIO Tiers

required

Core startup, local CRUD, encryption, and persistent settings flows.

opt-in

Broader deterministic flows, including Docker-backed protocol coverage and deeper configuration or session behavior.

nightly

Broader UI surfaces that are still useful, but either too timing-heavy, too shallow, or too broad for current PR-gated usage.

lab-only

Environment-sensitive, vendor, cloud, real update install, multi-window, or discovery flows that should not be considered normal hosted-CI coverage.

Rust E2E Tiers

Only the Docker-backed golden-path tests below are treated as part of the E2E tier model.

Rust required

Rust opt-in

Rust nightly

Excluded From The E2E Tier Map

These are integration or behavior tests, but they are not currently part of the environment-driven E2E tiering model:

Weak Or Misleading Specs

These files are especially important to clean up before any promotion into a stricter gate:

Promotion Candidates

Best next WDIO candidates for eventual hosted-CI promotion after cleanup:

  1. e2e/specs/06-ssh/ssh-file-transfer.spec.ts
  2. e2e/specs/06-ssh/ssh-connect.spec.ts
  3. e2e/specs/06-ssh/ssh-auth-methods.spec.ts
  4. e2e/specs/03-connections/connection-templates.spec.ts
  5. e2e/specs/04-import-export/import-connections.spec.ts