USP Lab smoke Report

Run ID: 1774453457 | Suite: smoke | Override used: False | Created: 2026-03-25T15:44:17.364348+00:00

Suite
smoke
Total Results
19
Failures
9
Blocked
0
Overall Status Coverage
PASS (9) FAIL (9) SKIP (1)
Acceptance Coverage
FAIL (1)

Failure Attribution

Likely Missing / Schema
0
Parameters not returned by the controller response.
Blank / Placeholder
0
Returned values that are blank, partial, or clearly sentinel-like.
Format / Type Mismatch
0
Returned values present, but not matching expected type or format.
Timeout / Transport
9
Likely controller/device timeout or transport instability.
Failure Attribution Notes
Total Failing Results: 9
Other / Mixed: 0

Probe Findings

Probe Status Coverage
PASS (9)
Total Probe Checks: 9
Probe Highlights
TestStatusSummaryMetricsEvidence
clients.visibility PASS client visibility probe complete n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_clients.log
connectivity.gateway PASS gateway ping completed rtt_min_ms=0.581, rtt_avg_ms=0.658, rtt_max_ms=0.736, rtt_mdev_ms=0.077 /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_192_168_1_1.log
connectivity.internet PASS internet ping completed rtt_min_ms=4.52, rtt_avg_ms=4.77, rtt_max_ms=5.021, rtt_mdev_ms=0.25 /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_1_1_1_1.log
connectivity.dns PASS DNS resolution completed answer=104.18.27.120 STREAM example.com /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_dns_example.com.log
connectivity.http PASS HTTP check completed status_line=HTTP/1.1 200 OK, server=cloudflare /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.https PASS HTTPS check completed status_line=HTTP/2 200, server=cloudflare /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.openspeedtest PASS OpenSpeedTest reachability completed status_line=HTTP/1.1 200 OK /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.speedtest.ookla PASS Ookla speedtest completed latency_ms=2.339, jitter_ms=0.075, download_mbps=97.21, upload_mbps=284.46, packet_loss=0, server=Google Fiber, result_url=https://www.speedtest.net/result/c/48e6e5b4-bdcc-4da7-b98f-109101b2d862 /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_speedtest_ookla.json
lan-speed.openspeedtest.browser PASS OpenSpeedTest browser run completed download_mbps=256.4, upload_mbps=563.9, ping_ms=6, jitter_ms=0.7, live_status=All done, elapsed_seconds=42.1, final=True /home/lucas/projects/oktopus/artifacts/probe_outputs/openspeedtest_browser.json

151 Baseline Summary

Total: 1
Pass: 0
Fail: 1
Skip: 0
By Severity: {'unknown': 1}
By Controller: {'oktopus': 1}
Supported Now
0
Paths that currently read and validate on this firmware.
Deferred By Firmware/Schema
0
Paths intentionally skipped because the current schema does not expose them yet.
Review Needed
1
Paths that still need remapping, vendor alternatives, or closer investigation.
Full 151-Path Checkpoint
Total Target Paths: 151
Supported Now: 57
Deferred By Firmware/Schema: 12
Review Needed: 82
Deferred Focus: Device.WiFi.MultiAP.*, Device.WiFi.DataElements.* (tracked as firmware/schema gap outside the current 151-path seed)
Goal: Checkpoint tracks the full 151 target paths while BBF TR-369 coverage is expanded over time.
Checkpoint Coverage: 37.7%

151 Baseline Test Status

Supported Now
Total: 1
Pass: 0
Fail: 1
Skip: 0
Coverage: 0.0%
Deferred By Firmware/Schema
Total: 1
Pass: 0
Fail: 1
Skip: 0
Coverage: 0.0%
Review Needed
Total: 1
Pass: 0
Fail: 1
Skip: 0
Coverage: 0.0%
151 Baseline By Section
SectionTotalPassFailSkip
unknown1010
151 Baseline Interpretation
Well Tested: 0
Needs Follow-Up: 1
Unsupported/Deferred: 0
Coverage Ratio: 0.0%

Results

TestGroupDeviceControllerStatusSummaryEvidence
discovery.parameters discovery m62-parent oktopus FAIL discovery failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_discover.json
acceptance.required acceptance-required m62-parent oktopus FAIL acceptance parameter fetch failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
acceptance.deferred acceptance-deferred m62-parent oktopus FAIL deferred acceptance fetch failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
acceptance.review acceptance-review m62-parent oktopus FAIL review acceptance fetch failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
acceptance.reporting acceptance-analysis m62-parent oktopus FAIL acceptance reporting fetch failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
advertised.reporting advertised-analysis m62-parent oktopus FAIL advertised field discovery failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_discover.json
mesh.parent_child mesh m62-parent oktopus FAIL mesh telemetry unavailable
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
wifi.radio.status wifi m62-parent oktopus FAIL controller get failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
wan.status wan m62-parent oktopus FAIL controller get failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
clients.visibility clients m62-parent oktopus PASS client visibility probe complete
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_clients.log
connectivity.gateway connectivity m62-parent oktopus PASS gateway ping completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_192_168_1_1.log
connectivity.internet connectivity m62-parent oktopus PASS internet ping completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_1_1_1_1.log
connectivity.dns connectivity m62-parent oktopus PASS DNS resolution completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_dns_example.com.log
connectivity.http connectivity m62-parent oktopus PASS HTTP check completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.https connectivity m62-parent oktopus PASS HTTPS check completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.openspeedtest connectivity m62-parent oktopus PASS OpenSpeedTest reachability completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.speedtest.ookla connectivity m62-parent oktopus PASS Ookla speedtest completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_speedtest_ookla.json
lan-speed.openspeedtest.browser lan-speed m62-parent oktopus PASS OpenSpeedTest browser run completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/openspeedtest_browser.json
events.placeholder events m62-parent oktopus SKIP placeholder group ready for extension