Larger workloads wont run

[maxsmythe]

Larger workloads (such as the usermem workload in benchmarking) do not currently run on GKE because the local snapshot directory (/run) is on a mount with < 1GB of space.

[thockin]

Max Smythe (@maxsmythe) This seems like a setup issue for GKE rather than for the project overall -- should we close this? Or should "/run" be configurable ?

[azr]

Some docs on how to setup with GKE correctly or alternatively know GKE issues could help here.

[maxsmythe]

+1 to GKE-specific docs.

This is a pretty big, hard-to-diagnose friction point at the moment that leads to mystery failures.

Also, documenting provider-specific quirks is a good way to smoke out oddities that could be streamlined by either making different choices (if there is a clearly better choice across cluster flavors) or providing simple configuration (if fix is a pain and everyone does something different).