Skip to content

Make UnmountVolume a hard crash failure during suspend/pause. - #666

Open
Michelle Au (msau42) wants to merge 1 commit into
agent-substrate:mainfrom
msau42:unmount-detach-coordination
Open

Make UnmountVolume a hard crash failure during suspend/pause.#666
Michelle Au (msau42) wants to merge 1 commit into
agent-substrate:mainfrom
msau42:unmount-detach-coordination

Conversation

@msau42

Copy link
Copy Markdown
Collaborator

Don't try to rollback mounts during Resume/Run. Instead should introduce a way to cleanup actor resources when an actor is in a failed state. Discussion in #643.

  • Tests pass
  • Appropriate changes to documentation are included in the PR

@msau42
Michelle Au (msau42) force-pushed the unmount-detach-coordination branch from 8772310 to 2347e76 Compare July 31, 2026 20:34
Comment thread cmd/atelet/main.go
Comment thread cmd/atelet/main.go
// TODO cleanup orphaned volumes
_ = s.unmountExternalVolumes(ctx, actorUID, req.GetSpec().GetVolumes())
}
}()

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Wait... this was in AteomHerder.Run, so we were removing external volumes right after telling ateom to run the workload?

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Previous behavior tried to rollback operations on failure to try to cleanup node state.

So if Run() encountered some failure, then we would try to undo the mounts to cleanup.

But now I'm deciding that it's better to just leave the node in a partial state, and have an explicit cleanup flow to handle the cleanup.

Don't try to rollback mounts during Resume/Run. Instead should
introduce a way to cleanup actor resources when an actor
is in a failed state. Discussion in agent-substrate#643.
@msau42
Michelle Au (msau42) force-pushed the unmount-detach-coordination branch from 2347e76 to 69bb342 Compare July 31, 2026 23:57
@msau42 Michelle Au (msau42) changed the title Make UnmountVolume a hard failure during suspend/pause. Make UnmountVolume a hard crash failure during suspend/pause. Jul 31, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants