Non-LLM Bench Platform

Run the non-LLM pipeline locally via a companion helper server. This page connects to your local helper on https://127.0.0.1:5050 to check Docker and run the pipeline.

1. Local Helper

Connection

Unknown

Endpoint: https://127.0.0.1:5050

If the helper is not running, please install and start the local Helper (see Platforms on the homepage), then click Retry.

Health log

waiting for connection...

2. Docker Check

Verify Docker availability

Untest

This runs locally via the helper (no data leaves your machine).

Docker check output

waiting...

3. Benchmark

Task input

Link / Image / Instance ID Workload code

Inferred

Docker image: n/a

Docker command:

waiting…

Docker image download message (click to expand)

waiting…

Before patch

Mean: — · Std: —

After patch

Mean: — · Std: —

Before error

After error

Improvement

Improvement: —

4. Submit (optional)

Record your metadata locally (helper only)

Notes I agree to upload to SWEf‑data

Only runs with improvement > 15% will be uploaded; all submissions are recorded locally. By uploading, you consent to store your submission (including the provided workload and metrics) in the public repository SWEf‑data. No other local files or credentials are collected.

Submit / Upload output

waiting...

waiting...