Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

generate_assets.yml GitHub Actions workflow run out of space #103

Open
anthonyfok opened this issue Sep 18, 2023 · 0 comments
Open

generate_assets.yml GitHub Actions workflow run out of space #103

anthonyfok opened this issue Sep 18, 2023 · 0 comments
Assignees
Labels
Bug Something isn't working Enhancement New feature or request
Milestone

Comments

@anthonyfok
Copy link
Member

The data files have grown big enough that, as of v1.1.0, the default GitHub runner no longer has sufficient disk/build space for generate_assets.yml to complete:

  • https://github.com/OpenDRR/seismic-risk-model/actions/runs/6165904115
  • build
    System.IO.IOException: No space left on device : '/home/runner/runners/2.309.0/_diag/Worker_20230913-103452-utc.log'
    at System.IO.RandomAccess.WriteAtOffset(SafeFileHandle handle, ReadOnlySpan`1 buffer, Int64 fileOffset)
    at System.IO.Strategies.BufferedFileStreamStrategy.FlushWrite()
    at System.IO.StreamWriter.Flush(Boolean flushStream, Boolean flushEncoder)
    at System.Diagnostics.TextWriterTraceListener.Flush()
    at GitHub.Runner.Common.HostTraceListener.WriteHeader(String source, TraceEventType eventType, Int32 id)
    at GitHub.Runner.Common.HostTraceListener.TraceEvent(TraceEventCache eventCache, String source, TraceEventType eventType, Int32 id, String message)
    at System.Diagnostics.TraceSource.TraceEvent(TraceEventType eventType, Int32 id, String message)
    at GitHub.Runner.Worker.Worker.RunAsync(String pipeIn, String pipeOut)
    at GitHub.Runner.Worker.Program.MainAsync(IHostContext context, String[] args)
  • build
    unable to write file eDamage/output/QC/eD_QC_J_Misc_damages-q50_b0.csv

Potential solutions:

  • Use easimon/maximize-build-space GitHub Action
  • Download only files in data/ directory (only 2.7 GiB). The largest files reside elsewhere, e.g. in eDamage/, which we do not need to upload as release assets.
  • Download from release assets of the previous release in a piecemeal fashion, and use Git LFS only for downloading new or changed files. (same proposed method as upload_assets.yml GitHub Actions workflow run out of space earthquake-scenarios#85)
@anthonyfok anthonyfok added Bug Something isn't working Enhancement New feature or request labels Sep 18, 2023
@anthonyfok anthonyfok added this to the Sprint 82 milestone Sep 18, 2023
@anthonyfok anthonyfok self-assigned this Sep 18, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working Enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant