results(linux-x64): c7i.2xlarge 10× run — isolation ratios reproduce vs Mac baseline - #3
Open
kwit75 wants to merge 1 commit into
Open
results(linux-x64): c7i.2xlarge 10× run — isolation ratios reproduce vs Mac baseline#3kwit75 wants to merge 1 commit into
kwit75 wants to merge 1 commit into
Conversation
…vs Mac baseline Runtime 3.2.1.30 (114509c6) x86_64, langchain-core 0.3.86. All 4 groups 10/10 clean: concurrent-processing (LangChain .batch crashes 0/64), fault-isolation (LC loses all 0/4), data-isolation (LC silently loses 40-89%), authoring-effort. RocketRide safe by default on every one.
5 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Linux-x64 (c7i.2xlarge, 8 fixed cores) 10× run of the isolation/concurrency harness — the diff vs
mainis the linux numbers side-by-side with the Mac baseline.Runtime
3.2.1.30(114509c6) x86_64 · langchain-core0.3.86. All four groups 10/10 reps clean, and the isolation ratios reproduce cross-platform (absolute timings differ from Mac, as expected):.batch(shared conn) crashes 0/64.abatchloses all 0/4Provisioning: the
--strip-components=1bug (strips the top-levelenginelauncher) — your fix is already onmain; this run used a correctly-extractedengine/engine+ a 3.11 venv, equivalent to it. Ran natively via the real C++./engine ai/eaas.py(not the bundled python — that would void the isolation measurement).Heads-up — a second harness bug (not blocking; not fixed in this PR):
scripts/start_engine.shreadiness gate false-passes. On connection-refused,curl -w '%{http_code}'prints000and the|| echo 000appends another →"000000", which!= "000"→ it declares the engine healthy before uvicorn is listening, somake smokeraces an ECONNREFUSED. Fix = gate on a real status, e.g.if [[ "$code" =~ ^[1-5][0-9][0-9]$ ]]. Worth landing so clean re-runs don't flake.🤖 Generated with Claude Code