USP Lab smoke Report

Run ID: 1774405562 | Suite: smoke | Override used: False | Created: 2026-03-25T02:26:02.286258+00:00

Suite
smoke
Total Results
16
Failures
7
Blocked
0
Overall Status Coverage
PASS (8) FAIL (7) SKIP (1)
Acceptance Coverage
FAIL (1)

Probe Findings

Probe Status Coverage
PASS (8) FAIL (1)
Total Probe Checks: 9
Probe Highlights
TestStatusSummaryMetricsEvidence
clients.visibility PASS client visibility probe complete n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_clients.log
connectivity.gateway PASS gateway ping completed rtt_min_ms=0.596, rtt_avg_ms=0.717, rtt_max_ms=0.838, rtt_mdev_ms=0.121 /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_192_168_1_1.log
connectivity.internet PASS internet ping completed rtt_min_ms=4.247, rtt_avg_ms=4.746, rtt_max_ms=5.245, rtt_mdev_ms=0.499 /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_1_1_1_1.log
connectivity.dns PASS DNS resolution completed answer=104.18.26.120 STREAM example.com /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_dns_example.com.log
connectivity.http PASS HTTP check completed status_line=HTTP/1.1 200 OK, server=cloudflare /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.https PASS HTTPS check completed status_line=HTTP/2 200, server=cloudflare /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.openspeedtest FAIL OpenSpeedTest reachability completed n/a /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.speedtest.ookla PASS Ookla speedtest completed latency_ms=2.378, jitter_ms=0.09, download_mbps=94.35, upload_mbps=282.73, packet_loss=0, server=Google Fiber, result_url=https://www.speedtest.net/result/c/e96c57a3-e6e0-4284-8f50-082a841b48a7 /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_speedtest_ookla.json
lan-speed.openspeedtest.browser PASS OpenSpeedTest browser run completed download_mbps=46.7, upload_mbps=58.7, ping_ms=13, jitter_ms=9, live_status=All done, elapsed_seconds=43.2, final=True /home/lucas/projects/oktopus/artifacts/probe_outputs/openspeedtest_browser.json

Acceptance Summary

Total: 1
Pass: 0
Fail: 1
Skip: 0
By Severity: {'unknown': 1}
By Controller: {'oktopus': 1}
Supported Now
0
Paths that currently read and validate on this firmware.
Deferred By Firmware/Schema
0
Paths intentionally skipped because the current schema does not expose them yet.
Review Needed
1
Paths that still need remapping, vendor alternatives, or closer investigation.
Full 151-Path Checkpoint
Total Target Paths: 151
Supported Now: 57
Deferred By Firmware/Schema: 12
Review Needed: 82
Deferred Focus: Device.WiFi.MultiAP.*, Device.WiFi.DataElements.* (tracked as firmware/schema gap outside the current 151-path seed)
Goal: Checkpoint tracks the full 151 target paths while BBF TR-369 coverage is expanded over time.
Checkpoint Coverage: 37.7%
Acceptance By Section
SectionTotalPassFailSkip
unknown1010
Acceptance Interpretation
Well Tested: 0
Needs Follow-Up: 1
Unsupported/Deferred: 0
Coverage Ratio: 0.0%

Results

TestGroupDeviceControllerStatusSummaryEvidence
discovery.parameters discovery m62-parent oktopus FAIL discovery failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_discover.json
acceptance.required acceptance-required m62-parent oktopus FAIL acceptance parameter fetch failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
acceptance.reporting acceptance-analysis m62-parent oktopus FAIL acceptance reporting fetch failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
mesh.parent_child mesh m62-parent oktopus FAIL mesh telemetry unavailable
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
wifi.radio.status wifi m62-parent oktopus FAIL controller get failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
wan.status wan m62-parent oktopus FAIL controller get failed
controller-payload: /home/lucas/projects/oktopus/artifacts/payloads/oktopus_m62-parent_get.json
clients.visibility clients m62-parent oktopus PASS client visibility probe complete
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_clients.log
connectivity.gateway connectivity m62-parent oktopus PASS gateway ping completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_192_168_1_1.log
connectivity.internet connectivity m62-parent oktopus PASS internet ping completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_ping_1_1_1_1.log
connectivity.dns connectivity m62-parent oktopus PASS DNS resolution completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_dns_example.com.log
connectivity.http connectivity m62-parent oktopus PASS HTTP check completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.https connectivity m62-parent oktopus PASS HTTPS check completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.openspeedtest connectivity m62-parent oktopus FAIL OpenSpeedTest reachability completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_http.log
connectivity.speedtest.ookla connectivity m62-parent oktopus PASS Ookla speedtest completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/raspberry-pi_speedtest_ookla.json
lan-speed.openspeedtest.browser lan-speed m62-parent oktopus PASS OpenSpeedTest browser run completed
probe-output: /home/lucas/projects/oktopus/artifacts/probe_outputs/openspeedtest_browser.json
events.placeholder events m62-parent oktopus SKIP placeholder group ready for extension