Skip to content

Harden layer package stage preparation - #707

Merged
i386 merged 2 commits into
micn/split-fixingfrom
codex/pr705-stage-package-hardening
May 27, 2026
Merged

Harden layer package stage preparation#707
i386 merged 2 commits into
micn/split-fixingfrom
codex/pr705-stage-package-hardening

Conversation

@i386

@i386 i386 commented May 27, 2026

Copy link
Copy Markdown
Collaborator

This is a small stacked contribution for #705. It keeps the package-ref resolver fix from #705 intact and hardens the split startup path around exact layer-package availability and error reporting.

Changes

  • Make stage preparation for layer-package loads call resolve_stage_load_package so the assigned stage artifacts are actually resolved/downloaded before the source is marked available.
  • Make the coordinator wait for the exact layer-package preparation status instead of accepting metadata-only available_ranges. Direct/runtime GGUF slices still accept inventory availability.
  • Return structured failed StageReadyResponse values for remote stage-load failures, so callers see the materialization/download error instead of stream finished early.
  • Preserve full anyhow error chains in preparation status, including peer prefetch fallback errors.

Validation

  • cargo fmt --all -- --check
  • just build
  • cargo test -p mesh-llm-host-runtime stage_prepare_error --lib
  • cargo test -p mesh-llm-host-runtime stage_source --lib
  • cargo check -p mesh-llm

@i386
i386 merged commit 7713301 into micn/split-fixing May 27, 2026
14 checks passed
@i386
i386 deleted the codex/pr705-stage-package-hardening branch May 27, 2026 07:34
michaelneale added a commit that referenced this pull request May 27, 2026
* Fix split serving for HF layer packages

* Trim split docs quickstart

* Add two-node split smoke CI

* Watch both nodes in split smoke

* Harden layer package stage preparation (#707)

* Harden layer package stage preparation

* Reduce stage control handler complexity

* Fix split runtime partial-load test mock

---------

Co-authored-by: James Dumay <jameswdumay@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant