main
ply4 git calls197 ms42 KiB2 cachedprotocol v2
28 lines2.7 KiBRaw

The probe workbench (/bench)

ply-web runs ply's probe scenarios (ply/probes, pinned in package.json) against Cloudflare Artifacts from the Worker, and shows each run. ply is the client under test; this Worker is the probe runner; Artifacts is the server under test. All of /bench is private: send Authorization: Bearer <PLY_TOKEN>, or sign in through the browser's Basic prompt with PLY_TOKEN as the password (any user name).

  • GET /bench: the catalogue (each scenario: runnable here, stock git only, or a seed too large for a Worker), the run form, recent runs.
  • POST /bench/runs (same-origin form: scenario, seed): one run. At most one at a time and 20 an hour. Answers with a redirect to the run once it is over.
  • GET /bench/runs/<id>: the verdict, the steps, the end state, the protocol waterfall, every exchange (status, timings, bytes, cf-ray, headers, pkt-line commands, advertised refs, report-status, object ids, the fault applied), the cleanup counts and the run's spans.
  • GET /bench/runs/<id>/exchanges/<i>/request|response: a raw body (R2, at most 1 MiB).
  • GET /bench/runs/<id>/<slug>.json and <slug>.test.js: the replay for ply's suite. Put both files in test/probes/replay/ of a ply checkout and run npx vitest run test/probes/replay/<slug>.test.js. That runs the plan with ply and stock git against git http-backend (the reference), and checks the recorded run with that commit's evaluator.

A run

  1. Build the seed in memory, with the same object ids as ply's runner (src/bench/seed.ts).
  2. Create pb-<seed>-<run> in the ply-loadgen namespace (binding PROBE_REPOS) and seed it.
  3. Run each step with ply through the recording fetch (src/bench/recorder.ts), applying the step's fault. Read the result back with ply (src/bench/judge.ts); there is no fsck and no merge bases, because a Worker has no git.
  4. Classify (src/bench/verdict.ts) each difference from the stated expectation:
    • client_bug: ply's outcome contradicts the report-status of the same exchange.
    • server_bug: the server confirmed an update its refs do not hold.
    • expected_incompatibility: an entry in ply's allow-list.
    • unresolved: anything else (export it to close the triangle).
  5. Clean up. Revoke every token of the repository, including the one create minted, and prove the revoked token gets 401 or 403 (cf-ray recorded). Then delete the repository and prove it is gone. ProbeBench's alarm sweeps any repository a run did not prove cleaned.

State

  • ProbeBench (SQLite Durable Object, via ctx.exports) is the source of truth: runs, the repositories it created, and admissions.
  • R2 ply-bench holds the exchange bodies.

Nothing is cached: every page is private and no-store.

1# The probe workbench (/bench)
3ply-web runs ply's probe scenarios (`ply/probes`, pinned in package.json) against Cloudflare Artifacts from the Worker, and shows each run. ply is the client under test; this Worker is the probe runner; Artifacts is the server under test. All of `/bench` is private: send `Authorization: Bearer <PLY_TOKEN>`, or sign in through the browser's Basic prompt with PLY_TOKEN as the password (any user name).
5- `GET /bench`: the catalogue (each scenario: runnable here, stock git only, or a seed too large for a Worker), the run form, recent runs.
6- `POST /bench/runs` (same-origin form: `scenario`, `seed`): one run. At most one at a time and 20 an hour. Answers with a redirect to the run once it is over.
7- `GET /bench/runs/<id>`: the verdict, the steps, the end state, the protocol waterfall, every exchange (status, timings, bytes, cf-ray, headers, pkt-line commands, advertised refs, report-status, object ids, the fault applied), the cleanup counts and the run's spans.
8- `GET /bench/runs/<id>/exchanges/<i>/request|response`: a raw body (R2, at most 1 MiB).
9- `GET /bench/runs/<id>/<slug>.json` and `<slug>.test.js`: the replay for ply's suite. Put both files in `test/probes/replay/` of a ply checkout and run `npx vitest run test/probes/replay/<slug>.test.js`. That runs the plan with ply and stock git against git http-backend (the reference), and checks the recorded run with that commit's evaluator.
11## A run
131. Build the seed in memory, with the same object ids as ply's runner (`src/bench/seed.ts`).
142. Create `pb-<seed>-<run>` in the `ply-loadgen` namespace (binding `PROBE_REPOS`) and seed it.
153. Run each step with ply through the recording fetch (`src/bench/recorder.ts`), applying the step's fault. Read the result back with ply (`src/bench/judge.ts`); there is no fsck and no merge bases, because a Worker has no git.
164. Classify (`src/bench/verdict.ts`) each difference from the stated expectation:
17 - `client_bug`: ply's outcome contradicts the report-status of the same exchange.
18 - `server_bug`: the server confirmed an update its refs do not hold.
19 - `expected_incompatibility`: an entry in ply's allow-list.
20 - `unresolved`: anything else (export it to close the triangle).
215. Clean up. Revoke every token of the repository, including the one create minted, and prove the revoked token gets 401 or 403 (cf-ray recorded). Then delete the repository and prove it is gone. ProbeBench's alarm sweeps any repository a run did not prove cleaned.
23## State
25- ProbeBench (SQLite Durable Object, via `ctx.exports`) is the source of truth: runs, the repositories it created, and admissions.
26- R2 `ply-bench` holds the exchange bodies.
28Nothing is cached: every page is private and `no-store`.
Diagnostics4 git calls · 197 ms
CallStatusSizeTime0197 ms
discover200152 B3 ms
git.upload-pack discover
http.response.status_code=200
git.upstream.cf_ray=-
git.upstream.phase=ls-refs
git.upstream.dur_ms=3
git.response.bytes=152
git.server.agent=gitty/1.0
git.server.object_format=sha1
git.server.caps=agent ls-refs fetch object-format
git.server.fetch=shallow filter sideband-all
git.protocol.version=2
git.pkt.frames=8
git.pkt.data=6
git.pkt.flush=2
git.pkt.delim=0
git.pkt.bytes=152
git.pkt.payload.max=34
ls-refs200145 B · hit3 ms
git.upload-pack ls-refs
http.response.status_code=200
git.upstream.cf_ray=-
git.upstream.phase=ls-refs
git.upstream.dur_ms=3
git.response.bytes=145
git.response.cache=HIT
git.response.duration_ms=3
git.protocol.version=2
git.pkt.frames=3
git.pkt.data=2
git.pkt.flush=1
git.pkt.delim=0
git.pkt.bytes=145
git.pkt.payload.max=76
git.ls_refs.count=2
git.ls_refs.head=refs/heads/main
fetchblob:none · deepen 1020040 KiB · hit8 ms
git.upload-pack fetch
http.response.status_code=200
git.upstream.cf_ray=-
git.upstream.phase=fetch
git.upstream.dur_ms=3
git.response.bytes=41349
git.response.cache=HIT
git.response.duration_ms=8
git.fetch.filter=blob:none
git.fetch.filter.requested=tree:0
git.fetch.filter.fallback=blob:none
git.fetch.filter.learned=false
git.fetch.wants=526b305930b8ef382f2d7a1f9c0238730a585921
git.fetch.haves.count=0
git.fetch.deepen=10
git.fetch.thin_pack=false
git.fetch.ofs_delta=true
git.protocol.version=2
git.pkt.frames=6
git.pkt.data=4
git.pkt.flush=1
git.pkt.delim=1
git.pkt.bytes=41349
git.pkt.payload.max=41254
git.sideband.band1.bytes=41253
git.sideband.band2.bytes=0
git.sideband.band3.bytes=0
git.pack.objects=61
git.pack.bytes=41253
git.pack.ofs_delta=0
git.pack.ref_delta=0
git.pack.chain.max=0
git.pack.trailer=ab60efef4b7243678c75de64a4386986ee885c1c
git.pack.full=61
Open pack map
fetch2001.4 KiB186 ms
git.upload-pack fetch
http.response.status_code=200
git.upstream.cf_ray=-
git.upstream.phase=fetch
git.upstream.dur_ms=186
git.response.bytes=1443
git.response.cache=MISS
git.response.duration_ms=186
git.fetch.wants=36c9bbbfc4eb342de7a5ce6d38d64db21d09dc08
git.fetch.haves.count=0
git.fetch.deepen=0
git.fetch.thin_pack=false
git.fetch.ofs_delta=true
git.protocol.version=2
git.pkt.frames=3
git.pkt.data=2
git.pkt.flush=1
git.pkt.delim=0
git.pkt.bytes=1443
git.pkt.payload.max=1422
git.sideband.band1.bytes=1421
git.sideband.band2.bytes=0
git.sideband.band3.bytes=0

Each row is one HTTP round trip ply made to the git server for this page, on one timeline. discover asks what the server speaks, ls-refs lists branch tips, fetch brings objects by id. A hit was served by Workers Cache. Tap a row for its wire details.

Remote
https://5ad2236b39de4c8bd8f6270ea63f3ea9.artifacts.cloudflare.net/git/public-v0/ply-web.git
Ref
refs/heads/main
Commit
526b305930b8ef382f2d7a1f9c0238730a585921
cf-ray
a5e2cb634c287929
Request
c6ad6573…
Protocol
v2 · sha1
Agent
gitty/1.0
Filter
advertised
Fetch
shallow filter sideband-all
Capabilities
agent ls-refs fetch object-format