fibers B1.3a-2: context-switch stress gate (explicit callee-saved scribble) + adversarial review
The design section-10.7 correctness gate the foundational switch owed: explicitly scribble EVERY callee-saved register, switch, and verify each survived. - Extended swap_context to the COMPLETE AAPCS64 callee-saved set: integer x19-x28 + fp/lr + sp AND the FP regs d8-d15 (21-slot context). Per AAPCS64 6.1.2 only the low 64 bits of v8-v15 are callee-saved, so d8-d15 is exactly sufficient; x18 is Apple's reserved platform register, untouched. - naked scribble_verify(self_ctx, peer, base): loads a unique sentinel into all 18 callee-saved regs, bl swap_context to yield, and on resume counts the regs that did not survive. Honors its own caller ABI via a 176-byte frame that saves+restores the caller's callee-saved; base reloaded post-swap (x2 not preserved); the original lr round-trips through the swap. - The gate is a 2-fiber MUTUAL scribble (A and B scribble DISTINCT sentinels into the same physical regs), so a value survives only if swap_context saved and restored it. A lone fiber yielding to an idle peer would NOT exercise preservation. Locked by examples/1808-concurrency-fiber-switch-stress.sx (aarch64-pinned): A/B mismatches: 0. Validity proven by negative controls: dropping the d8-d15 save/restore reports 8/8 mismatches (the FP regs); dropping x27/x28 reports 2/2. Adversarial review (worker): no critical bugs — callee-saved set complete and correct, all frame offsets / 16-alignment / the lr-sp dance verified against AAPCS64. Applied its one recommendation: boot zeroes the FP ctx slots so a first switch-to loads 0, not garbage, into d8-d15. Residual gaps (spec-correct for a call-boundary swap, documented in the header): FPCR/FPSR/NZCV + TPIDR/TLS are not swapped, fp=0 blocks unwind past a fiber trampoline — these matter at the N×M:1 / signals stages, not the single-thread switch. Suite green 734/0. Next: B1.3b (x86_64 sibling + mmap guard-page stacks).
This commit is contained in:
@@ -4,21 +4,38 @@ Companion to [PLAN-FIBERS.md](PLAN-FIBERS.md). Update after every step (one step
|
||||
per the cadence rule). New corpus category: `18xx` concurrency.
|
||||
|
||||
## Last completed step
|
||||
**B1.3a-1 — the stackful context switch works (foundational + indirect survival harness).**
|
||||
Pure sx over `abi(.naked)`: a naked `swap_context(from, to)` saves callee-saved + SP/LR into
|
||||
`*from` and loads from `*to`; fibers are bootstrapped by hand (SP = top of an `alloc_bytes`
|
||||
stack, LR = a global-asm trampoline, x19 = `*Fiber`; the trampoline `mov x0, x19; bl _fib_body`).
|
||||
Locked by `examples/1807-concurrency-fiber-context-switch.sx` (aarch64-pinned, `.build
|
||||
{"target":"macos"}`, `.ir` captured): a 2-fiber ping-pong (A⇄B, 3 rounds each → `rounds: 6`) with
|
||||
a per-fiber stack canary surviving every switch (`canary fails: 0`), plus a 64-frame deep
|
||||
recursive chain suspended at the bottom and resumed, verifying every frame's stack-local on the
|
||||
unwind (`frames verified: 64` / `depth fails: 0`). Suite green **733/0**, master clean.
|
||||
- **Honest scope:** this exercises register/stack preservation INDIRECTLY (compiler-allocated
|
||||
live values + the canary), which catches a broken SP/LR or a dropped callee-saved. It does NOT
|
||||
yet EXPLICITLY scribble every callee-saved GP (x19-x28) + FP (d8-d15) with sentinels — that
|
||||
full §10.7 gate is **B1.3a-2** (a dedicated naked scribble/verify routine, see Next step).
|
||||
- The mechanism (bootstrap + naked switch + resume-mid-stack + `alloc_bytes` stacks) is proven;
|
||||
the WIP probe lives at `.sx-tmp/fib_full.sx` / `.sx-tmp/fib_probe.sx`.
|
||||
**B1.3a-2 — the context-switch STRESS GATE (design §10.7) — DONE + adversarially reviewed.**
|
||||
The explicit every-callee-saved-register scribble that B1.3a-1 owed. `swap_context` now saves the
|
||||
COMPLETE AAPCS64 callee-saved set — integer x19-x28 + fp/lr + sp AND FP **d8-d15** (per §6.1.2
|
||||
only the low 64 bits of v8-v15 are callee-saved, so `d8-d15` is exactly sufficient; x18 is Apple's
|
||||
reserved platform reg, untouched). A naked `scribble_verify(self_ctx, peer, base)` loads a unique
|
||||
sentinel into all 18 callee-saved regs, yields, and on resume counts the ones that didn't survive
|
||||
(honoring its own caller ABI via a 176-byte frame that saves+restores the caller's callee-saved;
|
||||
base reloaded from the frame post-swap; the original lr round-trips through the swap). The gate is
|
||||
a **2-fiber MUTUAL scribble** (A and B scribble DISTINCT sentinels into the same physical regs, so
|
||||
each survives only if `swap_context` saved+restored it — a lone fiber yielding to an idle peer
|
||||
would NOT exercise preservation). Locked by `examples/1808-concurrency-fiber-switch-stress.sx`
|
||||
(aarch64-pinned): `A mismatches: 0` / `B mismatches: 0`.
|
||||
- **Validity proven by NEGATIVE controls:** dropping the d8-d15 save/restore → 8/8 mismatches
|
||||
(exactly the FP regs); dropping x27/x28 → 2/2. The gate genuinely catches a broken switch.
|
||||
- **Adversarial review (worker, per the plan): no CRITICAL bugs.** Verified the callee-saved set
|
||||
is complete + correct, all frame offsets/16-alignment, the lr/sp dance, and swap read-ordering
|
||||
against AAPCS64. Applied its one recommendation: `boot` now zeroes the FP ctx slots [13..20] so a
|
||||
first switch-to loads 0 (not garbage) into d8-d15. Residual gaps it flagged (all spec-correct
|
||||
for a call-boundary swap, documented in the example header): NZCV/FPSR not swapped; **FPCR**
|
||||
(rounding mode — thread-global, bleeds across fibers if changed) and **TPIDR_EL0/TLS** (errno,
|
||||
allocator thread-caches — shared by same-thread fibers) not swapped; fp=0 bootstrap blocks
|
||||
unwind/signal walking past a fiber trampoline. These bite at the N×M:1 / signals stages, not the
|
||||
single-thread switch.
|
||||
- Suite green **734/0**, master clean. WIP probes: `.sx-tmp/scribble2.sx` (+ `_broken`/`_gp`).
|
||||
|
||||
### Earlier — B1.3a-1 — the foundational stackful context switch (commit `b234b7d`)
|
||||
Pure sx over `abi(.naked)`: naked `swap_context` (GP-only 13-slot save) + by-hand fiber bootstrap
|
||||
(SP = `alloc_bytes` stack top, LR = global-asm trampoline, x19 = `*Fiber`). Locked by
|
||||
`examples/1807-concurrency-fiber-context-switch.sx`: 2-fiber ping-pong (`rounds: 6` / `canary
|
||||
fails: 0`) + 64-frame deep recursion (`frames verified: 64` / `depth fails: 0`). Indirect
|
||||
register/stack survival; 1808 supersedes its switch with the complete GP+FP save area + the
|
||||
explicit gate.
|
||||
|
||||
### Earlier — B1.2 COMPLETE — the async surface works end-to-end
|
||||
All three surface blockers (0151, 0152, 0153) FIXED + committed; async examples landed + green.
|
||||
@@ -204,23 +221,23 @@ fibers/Io/scheduler code yet. Grounded floor facts:
|
||||
boundary; a sharper sx diagnostic for it is a candidate polish, not a blocker.
|
||||
|
||||
## Next step
|
||||
**B1.3a-2 — the EXPLICIT register/FP scribble gate (design §10.7), then B1.3b.** The foundational
|
||||
switch (B1.3a-1) is in; the rigorous gate is still owed. Sequence:
|
||||
1. **B1.3a-2 (explicit scribble — the real §10.7 gate):** a naked `scribble_verify(self, peer,
|
||||
base)` that loads known sentinels into EVERY callee-saved GP (x19-x28) AND FP (d8-d15), saves
|
||||
the original return addr on the stack, swaps to the peer, and on resume reads every register
|
||||
back and returns a mismatch count. Mechanism worked out: a naked fn CAN `bl swap_context` and
|
||||
resume in-place (the swap saves/restores its lr), so push the caller-return on the fiber stack
|
||||
before the swap and pop it after (sp is part of the saved context, so it round-trips). Add to
|
||||
`1807` (or a sibling `1808`); expect 0 mismatches. This is the single highest-corruption-risk
|
||||
asm in the stream — **review adversarially (worker if authorized)** per the plan.
|
||||
2. **B1.3b:** the x86_64 sibling of `swap_context` (rbx/rbp/r12-r15/rsp save area — different
|
||||
slot count + regs) + `mmap` stacks **with mandatory guard pages** (`mprotect` the low page
|
||||
`PROT_NONE`; a fixed stack without a guard silently corrupts neighbors — §8.1.1). Replace the
|
||||
`alloc_bytes` stack in `1807` with the guarded `mmap` path; add the x86_64 run sibling.
|
||||
**B1.3b — the x86_64 switch sibling + `mmap` guard-page stacks.** The aarch64 switch + the §10.7
|
||||
gate (B1.3a) are done + reviewed. Sequence:
|
||||
1. **B1.3b-1 (x86_64 `swap_context`):** the per-arch sibling — System V callee-saved is
|
||||
rbx/rbp/r12/r13/r14/r15 + rsp (6 GP + sp; NO callee-saved XMM on the SysV C ABI, unlike Win64),
|
||||
so a different slot count + a different `scribble_verify` reg set. Arch-gate it like the asm
|
||||
corpus (`x86_64-linux` run on a matching CI host, ir-only on this aarch64 mac — `.ir` required).
|
||||
Carry the same 2-fiber mutual-scribble gate + the negative-control discipline. (1802 is the
|
||||
x86_64 naked-asm template.)
|
||||
2. **B1.3b-2 (`mmap` guard-page stacks):** replace the `alloc_bytes` stack with `mmap` +
|
||||
`mprotect` the low page `PROT_NONE` (mandatory — a fixed stack without a guard silently
|
||||
corrupts neighbors on overflow, §8.1.1). Add an overflow-hits-guard test (deep recursion past
|
||||
the stack → SIGSEGV/SIGBUS at the guard, NOT silent corruption). `mmap`/`mprotect` via
|
||||
`extern "c"`.
|
||||
3. Then B1.3 (fiber runtime substrate) is done → **B1.4** (`Io` impls: blocking ✅ →
|
||||
deterministic-sim KEYSTONE → event-loop) and **B1.5** (M:1 scheduler) build the real scheduler
|
||||
on top, replacing the hand-bootstrapped ping-pong with `spawn`/`yield`/`resume`.
|
||||
on top, replacing the hand-bootstrapped ping-pong with `spawn`/`yield`/`resume`. The §10.7 gate
|
||||
(1808) must keep passing as the switch grows.
|
||||
|
||||
**Deferred (do NOT block on these):** issue **0150** (`void` struct field SIGTRAP) — only
|
||||
`Future(void)`/`timeout`, which are B1.4. The **`::` callable-parameter feature** (named-fn
|
||||
@@ -394,3 +411,17 @@ done, inference incomplete); a dedicated effort; lambda workers are the B1.2 idi
|
||||
runs under JIT, ir-only on a non-arm host (`.ir` captured — `swap_context` shows `naked noinline
|
||||
nounwind`). Suite green 733/0. **Honest scope:** indirect register/stack survival only; the
|
||||
EXPLICIT every-callee-saved + FP scribble (§10.7) is B1.3a-2, still owed. Next: B1.3a-2.
|
||||
- **B1.3a-2 — the §10.7 stress gate, adversarially reviewed.** Extended `swap_context` to the
|
||||
COMPLETE AAPCS64 callee-saved set (added FP d8-d15 → 21-slot ctx) and wrote a naked
|
||||
`scribble_verify` that loads a unique sentinel into all 18 callee-saved regs, yields, and counts
|
||||
non-survivors on resume (176-byte frame saves/restores the caller's callee-saved + base; lr
|
||||
round-trips the swap). The gate is a 2-fiber MUTUAL scribble (each clobbers the other's regs, so
|
||||
survival ⇒ the switch saved+restored them). Locked by
|
||||
`examples/1808-concurrency-fiber-switch-stress.sx` (`A/B mismatches: 0`). Validity proven by
|
||||
negative controls (drop d8-d15 → 8/8; drop x27/x28 → 2/2). **Spawned an adversarial-review
|
||||
worker (per the plan + user request): NO critical bugs** — callee-saved set complete (x18 rightly
|
||||
excluded; d8-d15 suffices per §6.1.2), offsets/alignment/lr-sp dance all verified. Applied its
|
||||
one rec: `boot` zeroes FP ctx slots so first-entry loads 0, not garbage. Honest residual gaps
|
||||
(spec-correct for a call-boundary swap; in the example header): FPCR/FPSR/NZCV + TPIDR/TLS not
|
||||
swapped, fp=0 blocks unwind — relevant at N×M:1 / signals, not here. Suite green 734/0.
|
||||
Next: B1.3b (x86_64 sibling + mmap guard-page stacks).
|
||||
|
||||
Reference in New Issue
Block a user