| Daytona (container) | realworld-better-auth | skipped · disk | Insufficient disk: 10.0 GiB free, suite needs 10 GiB |
| Daytona (container) | realworld-mastra | skipped · disk | Insufficient disk: 10.0 GiB free, suite needs 30 GiB |
| Daytona (container) | realworld-openclaw | skipped · disk | Insufficient disk: 10.0 GiB free, suite needs 25 GiB |
| Tangle Sandbox | pgbench | skipped | pts_pgbench-read-only: could not claim the root-owned baked postgres data dir (needs sudo) |
| Tangle Sandbox | pgbench | skipped | pts_pgbench-read-write: could not claim the root-owned baked postgres data dir (needs sudo) |
| Tangle Sandbox | realworld-better-auth | skipped | pts_realworld-better-auth: PTS install of local/realworld-better-auth-1.0.0 failed (exit 0, not in list-installed-tests) |
| Tangle Sandbox | realworld-mastra | skipped | pts_realworld-mastra: PTS install of local/realworld-mastra-1.0.0 failed (exit 0, not in list-installed-tests) |
| Tangle Sandbox | realworld-openclaw | skipped | pts_realworld-openclaw: PTS install of local/realworld-openclaw-1.0.0 failed (exit 0, not in list-installed-tests) |
| Baseten Sandboxes | cpu-node | failed | Failed to create sandbox: computesdk create failed: sandbox API error (HTTP 403) FORBIDDEN: This API key does not have permission to perform this operation. |
| Baseten Sandboxes | cpu-node | failed | Partial publication withheld unverified measurements: node_web_tooling_runs_per_s |
| Baseten Sandboxes | disk | failed | Failed to create sandbox: computesdk create failed: sandbox API error (HTTP 403) FORBIDDEN: This API key does not have permission to perform this operation. |
| Baseten Sandboxes | disk | failed | Partial publication withheld unverified measurements: hardlink_bogo_ops_per_s, fio_type_sequential_read_engine_linux_aio_direct_yes_block_size_1mb_job_count_1_disk_target_default_test_directory_mb_per_s, fio_type_sequential_read_engine_linux_aio_direct_yes_block_size_1mb_job_count_1_disk_target_default_test_directory_iops, fio_type_sequential_write_engine_linux_aio_direct_yes_block_size_1mb_job_count_1_disk_target_default_test_directory_mb_per_s, fio_type_sequential_write_engine_linux_aio_direct_yes_block_size_1mb_job_count_1_disk_target_default_test_directory_iops, fio_type_random_read_engine_linux_aio_direct_yes_block_size_4kb_job_count_1_disk_target_default_test_directory_mb_per_s, fio_type_random_read_engine_linux_aio_direct_yes_block_size_4kb_job_count_1_disk_target_default_test_directory_iops, fio_type_random_write_engine_linux_aio_direct_yes_block_size_4kb_job_count_1_disk_target_default_test_directory_mb_per_s, fio_type_random_write_engine_linux_aio_direct_yes_block_size_4kb_job_count_1_disk_target_default_test_directory_iops |
| Baseten Sandboxes | network | failed | Failed to create sandbox: computesdk create failed: sandbox API error (HTTP 403) FORBIDDEN: This API key does not have permission to perform this operation. |
| Baseten Sandboxes | network | failed | Partial publication withheld unverified measurements: iperf_server_address_localhost_server_port_5201_duration_10_seconds_test_tcp_parallel_1, iperf_server_address_localhost_server_port_5201_duration_10_seconds_test_tcp_parallel_10, iperf_server_address_localhost_server_port_5201_duration_10_seconds_test_udp_10000mbit_objective_parallel_1, iperf_wan_direction_download, iperf_wan_direction_upload, network_https_github_com_total_ms, network_https_api_github_com_total_ms, network_https_raw_githubusercontent_com_total_ms, network_https_registry_npmjs_org_total_ms, network_https_pypi_org_total_ms, network_https_files_pythonhosted_org_total_ms, network_https_ghcr_io_v2_total_ms, network_https_gcr_io_v2_total_ms, network_https_auth_docker_io_registry_token_total_ms, network_https_crates_io_total_ms, network_https_index_crates_io_config_total_ms, network_dns_cold_github_com_ms, network_dns_cold_registry_npmjs_org_ms, network_dns_cold_docker_io_ms, network_dns_cold_pypi_org_ms, network_dns_cold_rubygems_org_ms, network_download_node_v22_23_1_linux_x64_mbits_per_sec |
| Baseten Sandboxes | pgbench | failed | Failed to create sandbox: computesdk create failed: sandbox API error (HTTP 403) FORBIDDEN: This API key does not have permission to perform this operation. |
| Baseten Sandboxes | pgbench | failed | Partial publication withheld unverified measurements: pgbench_scaling_factor_100_clients_50_mode_read_only, pgbench_scaling_factor_100_clients_50_mode_read_only_average_latency, pgbench_scaling_factor_100_clients_50_mode_read_write, pgbench_scaling_factor_100_clients_50_mode_read_write_average_latency |
| Baseten Sandboxes | realworld-better-auth | failed | Failed to create sandbox: computesdk create failed: sandbox API error (HTTP 403) FORBIDDEN: This API key does not have permission to perform this operation. |
| Baseten Sandboxes | realworld-better-auth | failed | Partial publication withheld unverified measurements: realworld_better_auth_task_git_clone, realworld_better_auth_task_cold_install, realworld_better_auth_task_lint_biome, realworld_better_auth_task_lint_deps_knip, realworld_better_auth_task_lint_format, realworld_better_auth_task_lint_spell, realworld_better_auth_task_lint_types, realworld_better_auth_task_lint_packages, realworld_better_auth_task_typecheck, realworld_better_auth_task_build |
| Baseten Sandboxes | realworld-better-auth | failed | Step "mise run benchmark:realworld:pts:better-auth" lost its sandbox: 12 consecutive detached polls failed (last: computesdk filesystem exists failed: sandbox API error (HTTP 403)) — the sandbox stopped responding, not a quiet long step |
| Baseten Sandboxes | realworld-mastra | failed | Step "REALWORLD_TASK_TIMEOUT_SECONDS=2400 mise run benchmark:realworld:pts:mastra" lost its sandbox: 12 consecutive detached polls failed (last: computesdk filesystem exists failed: sandbox API error (HTTP 403)) — the sandbox stopped responding, not a quiet long step |
| Baseten Sandboxes | realworld-mastra | failed | Partial publication withheld unverified measurements: realworld_mastra_task_git_clone, realworld_mastra_task_cold_install, realworld_mastra_task_lint_format, realworld_mastra_task_build_core, realworld_mastra_task_test_core |
| Baseten Sandboxes | realworld-mastra | failed | Failed to create sandbox: computesdk create failed: sandbox API error (HTTP 403) FORBIDDEN: This API key does not have permission to perform this operation. |
| Baseten Sandboxes | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: sandbox API error (HTTP 403) FORBIDDEN: This API key does not have permission to perform this operation. |
| Baseten Sandboxes | realworld-openclaw | failed | Partial publication withheld unverified measurements: realworld_openclaw_task_git_clone, realworld_openclaw_task_cold_install, realworld_openclaw_task_lint_oxlint, realworld_openclaw_task_lint_extensions_all, realworld_openclaw_task_typecheck, realworld_openclaw_task_test_types |
| Baseten Sandboxes | system | failed | Failed to create sandbox: computesdk create failed: sandbox API error (HTTP 403) FORBIDDEN: This API key does not have permission to perform this operation. |
| Baseten Sandboxes | system | failed | Partial publication withheld unverified measurements: pybench_milliseconds, sqlite_speedtest_seconds, git_seconds |
| boat | realworld-mastra | failed | PTS ran but every trial failed for 1 of 5 declared metrics: realworld_mastra_task_test_core (realworld-mastra/pts_realworld-mastra.xml) — attempted, no value recorded |
| boat | realworld-mastra | failed | Partial publication withheld unverified measurements: realworld_mastra_task_test_core |
| CreateOS | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: service unavailable |
| CreateOS | realworld-openclaw | failed | Partial publication withheld unverified measurements: realworld_openclaw_task_git_clone, realworld_openclaw_task_cold_install, realworld_openclaw_task_lint_oxlint, realworld_openclaw_task_lint_extensions_all, realworld_openclaw_task_typecheck, realworld_openclaw_task_test_types |
| Daytona (container) | realworld-better-auth | failed | Partial publication withheld unverified measurements: realworld_better_auth_task_git_clone, realworld_better_auth_task_cold_install, realworld_better_auth_task_lint_biome, realworld_better_auth_task_lint_deps_knip, realworld_better_auth_task_lint_format, realworld_better_auth_task_lint_spell, realworld_better_auth_task_lint_types, realworld_better_auth_task_lint_packages, realworld_better_auth_task_typecheck, realworld_better_auth_task_build |
| Daytona (container) | realworld-mastra | failed | Partial publication withheld unverified measurements: realworld_mastra_task_git_clone, realworld_mastra_task_cold_install, realworld_mastra_task_lint_format, realworld_mastra_task_build_core, realworld_mastra_task_test_core |
| Daytona (container) | realworld-openclaw | failed | Partial publication withheld unverified measurements: realworld_openclaw_task_git_clone, realworld_openclaw_task_cold_install, realworld_openclaw_task_lint_oxlint, realworld_openclaw_task_lint_extensions_all, realworld_openclaw_task_typecheck, realworld_openclaw_task_test_types |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-198c006d-63eb-425c-b53e-2dc641c6b43c" did not reach running before the readiness wait expired |
| microsandbox | realworld-openclaw | failed | Partial publication withheld unverified measurements: realworld_openclaw_task_git_clone, realworld_openclaw_task_cold_install, realworld_openclaw_task_lint_oxlint, realworld_openclaw_task_lint_extensions_all, realworld_openclaw_task_typecheck, realworld_openclaw_task_test_types |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-b1f2648a-488f-446e-9249-0e5803bac324" did not reach running before the readiness wait expired |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-3027dc27-ae1a-4265-a2b8-5ef09bbad38e" did not reach running before the readiness wait expired |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-adecad41-020c-47b4-9c97-f997ab29cd71" did not reach running before the readiness wait expired |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-53e936ef-717a-45ab-a099-ccccf9992ce4" did not reach running before the readiness wait expired |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-dd2564dd-150b-4029-b071-87f951f3b156" did not reach running before the readiness wait expired |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-b48b9def-f970-462f-ab54-10c6df8d7ee2" did not reach running before the readiness wait expired |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-54b853c3-80d5-4a0b-851f-f753324e3cde" did not reach running before the readiness wait expired |
| microsandbox | realworld-openclaw | failed | Failed to create sandbox: computesdk create failed: runtime error: cloud sandbox "bench-cloud-4d4b401c-403b-469a-bc7f-01c0bcbb2d1a" did not reach running before the readiness wait expired |
| Modal (gVisor) † | realworld-mastra | failed | PTS ran but every trial failed for 1 of 5 declared metrics: realworld_mastra_task_test_core (realworld-mastra/pts_realworld-mastra.xml) — attempted, no value recorded |
| Modal (gVisor) † | realworld-mastra | failed | Partial publication withheld unverified measurements: realworld_mastra_task_test_core |
| Modal (VM) † | realworld-mastra | failed | Failed to create sandbox: computesdk created-request preparation and verification failed: Modal control operation exceeded 5000ms |
| Modal (VM) † | realworld-mastra | failed | Partial publication withheld unverified measurements: realworld_mastra_task_git_clone, realworld_mastra_task_cold_install, realworld_mastra_task_lint_format, realworld_mastra_task_build_core, realworld_mastra_task_test_core |
| Tangle Sandbox | network | failed | pts_iperf-wan-download: pts_iperf-wan-download did not produce 1 numeric metric value(s) |
| Tangle Sandbox | network | failed | pts_iperf-wan-upload: PTS batch-run of local/iperf-wan-1.0.0 completed but every trial errored (composite carries no values) |
| Tangle Sandbox | network | failed | Step "mise run benchmark:network:suite" failed with exit code 1 |
| Tangle Sandbox | network | failed | Partial publication withheld unverified measurements: iperf_server_address_localhost_server_port_5201_duration_10_seconds_test_tcp_parallel_1, iperf_server_address_localhost_server_port_5201_duration_10_seconds_test_tcp_parallel_10, iperf_server_address_localhost_server_port_5201_duration_10_seconds_test_udp_10000mbit_objective_parallel_1, iperf_wan_direction_download, iperf_wan_direction_upload, network_https_github_com_total_ms, network_https_api_github_com_total_ms, network_https_raw_githubusercontent_com_total_ms, network_https_registry_npmjs_org_total_ms, network_https_pypi_org_total_ms, network_https_files_pythonhosted_org_total_ms, network_https_ghcr_io_v2_total_ms, network_https_gcr_io_v2_total_ms, network_https_auth_docker_io_registry_token_total_ms, network_https_crates_io_total_ms, network_https_index_crates_io_config_total_ms, network_dns_cold_github_com_ms, network_dns_cold_registry_npmjs_org_ms, network_dns_cold_docker_io_ms, network_dns_cold_pypi_org_ms, network_dns_cold_rubygems_org_ms, network_download_node_v22_23_1_linux_x64_mbits_per_sec |
| Tangle Sandbox | pgbench | failed | Suite "pgbench" on tangle produced no pts_*.xml — PTS likely failed silently |
| Tangle Sandbox | pgbench | failed | Partial publication withheld unverified measurements: pgbench_scaling_factor_100_clients_50_mode_read_only, pgbench_scaling_factor_100_clients_50_mode_read_only_average_latency, pgbench_scaling_factor_100_clients_50_mode_read_write, pgbench_scaling_factor_100_clients_50_mode_read_write_average_latency |
| Tangle Sandbox | realworld-better-auth | failed | Suite "realworld-better-auth" on tangle produced no pts_*.xml — PTS likely failed silently |
| Tangle Sandbox | realworld-better-auth | failed | Partial publication withheld unverified measurements: realworld_better_auth_task_git_clone, realworld_better_auth_task_cold_install, realworld_better_auth_task_lint_biome, realworld_better_auth_task_lint_deps_knip, realworld_better_auth_task_lint_format, realworld_better_auth_task_lint_spell, realworld_better_auth_task_lint_types, realworld_better_auth_task_lint_packages, realworld_better_auth_task_typecheck, realworld_better_auth_task_build |
| Tangle Sandbox | realworld-mastra | failed | Suite "realworld-mastra" on tangle produced no pts_*.xml — PTS likely failed silently |
| Tangle Sandbox | realworld-mastra | failed | Partial publication withheld unverified measurements: realworld_mastra_task_git_clone, realworld_mastra_task_cold_install, realworld_mastra_task_lint_format, realworld_mastra_task_build_core, realworld_mastra_task_test_core |
| Tangle Sandbox | realworld-openclaw | failed | Suite "realworld-openclaw" on tangle produced no pts_*.xml — PTS likely failed silently |
| Tangle Sandbox | realworld-openclaw | failed | Partial publication withheld unverified measurements: realworld_openclaw_task_git_clone, realworld_openclaw_task_cold_install, realworld_openclaw_task_lint_oxlint, realworld_openclaw_task_lint_extensions_all, realworld_openclaw_task_typecheck, realworld_openclaw_task_test_types |