USP Lab Validation Report

Run ID: 1774367315 | Override used: False | Created: 2026-03-24T15:48:35.838829+00:00

Suite
smoke
Total Results
15
Failures
14
Blocked
0
Overall Status Coverage
FAIL (14) SKIP (1)
Acceptance Coverage
FAIL (1)

Probe Findings

Probe Status Coverage
FAIL (9)
Total Probe Checks: 9
Probe Highlights
TestStatusSummaryMetricsEvidence
clients.visibility FAIL client visibility probe complete n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_clients.log
connectivity.gateway FAIL gateway ping completed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_192_168_1_1.log
connectivity.internet FAIL internet ping completed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_1_1_1_1.log
connectivity.dns FAIL DNS resolution completed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_dns_example.com.log
connectivity.http FAIL HTTP check completed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.https FAIL HTTPS check completed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.openspeedtest FAIL OpenSpeedTest reachability completed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.speedtest.ookla FAIL Ookla speedtest completed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_speedtest_ookla.json
lan-speed.openspeedtest.browser FAIL OpenSpeedTest browser run failed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/openspeedtest_browser.json

Acceptance Summary

Total: 1
Pass: 0
Fail: 1
Skip: 0
By Severity: {'unknown': 1}
By Controller: {'oktopus': 1}
Supported Now
0
Paths that currently read and validate on this firmware.
Deferred By Firmware/Schema
0
Paths intentionally skipped because the current schema does not expose them yet.
Review Needed
1
Paths that still need remapping, vendor alternatives, or closer investigation.
Full 151-Path Checkpoint
Total Target Paths: 151
Supported Now: 57
Deferred By Firmware/Schema: 12
Review Needed: 82
Deferred Focus: Device.WiFi.MultiAP.*, Device.WiFi.DataElements.* (tracked as firmware/schema gap outside the current 151-path seed)
Goal: Checkpoint tracks the full 151 target paths while BBF TR-369 coverage is expanded over time.
Checkpoint Coverage: 37.7%
Acceptance By Section
SectionTotalPassFailSkip
unknown1010
Acceptance Interpretation
Well Tested: 0
Needs Follow-Up: 1
Unsupported/Deferred: 0
Coverage Ratio: 0.0%

Results

TestGroupDeviceControllerStatusSummaryEvidence
discovery.parameters discovery m62-parent oktopus FAIL discovery failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_discover.json
acceptance.required acceptance-required m62-parent oktopus FAIL acceptance parameter fetch failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
mesh.parent_child mesh m62-parent oktopus FAIL mesh telemetry unavailable
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
wifi.radio.status wifi m62-parent oktopus FAIL controller get failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
wan.status wan m62-parent oktopus FAIL controller get failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
clients.visibility clients m62-parent oktopus FAIL client visibility probe complete
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_clients.log
connectivity.gateway connectivity m62-parent oktopus FAIL gateway ping completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_192_168_1_1.log
connectivity.internet connectivity m62-parent oktopus FAIL internet ping completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_1_1_1_1.log
connectivity.dns connectivity m62-parent oktopus FAIL DNS resolution completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_dns_example.com.log
connectivity.http connectivity m62-parent oktopus FAIL HTTP check completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.https connectivity m62-parent oktopus FAIL HTTPS check completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.openspeedtest connectivity m62-parent oktopus FAIL OpenSpeedTest reachability completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.speedtest.ookla connectivity m62-parent oktopus FAIL Ookla speedtest completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_speedtest_ookla.json
lan-speed.openspeedtest.browser lan-speed m62-parent oktopus FAIL OpenSpeedTest browser run failed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/openspeedtest_browser.json
events.placeholder events m62-parent oktopus SKIP placeholder group ready for extension