Sprint 57

Due by May 12, 2022 (Review on May 12)

Sprint Goals:

• Finalize views & support edits/revisions Done

  • PSRA indicator revisions - waiting on Tiegan to merge final edits, we have them in PostGIS, Drew will review and load in ES
    • Additional aggregations for PSRA if needed (Will) - Draft aggregations are completed 80-90% complete > sprint 57
    • remove ss_regions https://github.com/OpenDRR/model-factory/issues/112 Done
    • new release model-factory/opendrr-api v1.4.1 Done
    • update pygeoapi-config.yml with v1.4.1
    • consider pygeoapi-config in gh-actions

• Publish FGP records (Joost) - waiting on Charles

  • Send revised data files and MXD's to FGP (Will, Phil)
    • Physical Exposure
    • Social Fabric - Will sent on Feb 11
    • PSRA - waiting on v1.4.1 > sprint 57
    • DSRA 1KM, 5KM, 25KM
  • Review revised FGP data layers (Murray, Phil, Tiegan, Joost, Will)
    • Physical Exposure
    • Social Fabric
    • PSRA - waiting on v1.4.1
    • DSRA
  • Prep legend files (MXD's) for FGP data See issue
    • Physical Exposure
    • Social Fabric
    • PSRA
    • DSRA (Carol)
  • Dependant on model-factory/opendrr-api v1.4.1
  • Update API endpoints to prod in FGP metadata - Joost
  • Update API endpoints in Downloads Repo - Damon

• Security Documentation (Joost) > Sprint 57

  • FGP CSV document

• RiskProfiler QA/QC script (Drew) > Sprint 57 [x] Wiki Page with all checks WIP [ ] Inquire about internal quality controllers

• Move riskprofiler-cms code,issues,content etc. to riskprofiler > Sprint 58

• DSRA Dashboards in Kibana (Drew, Damon) - 5/5 done

  • onboard finance Canada - waiting for prod environment - Drew
  • create index alias in Kibana Prod - Drew/Damon
  • create user accounts for Finance Canada
  • load Kibana saved objects - Arash

• GPKG generation via GitHub Actions for release assets opendrr-api (Damon, Anthony) > sprint 58

  • Blocked by diskspace limits on GitHub Actions - Stack need to be optimized for disk usage - Anthony

• Use of XZ-compressed repos XZ- or Zstd-compressed release assets to reduce Git LFS data storage and bandwidth usage (Anthony) > sprint 58

• Fully automate riskprofiler static website generation in Docker Wordpress instance (Anthony) 90% done > sprint 57

  • March 30 version - deployed on beta.riskprofiler.ca
  • May 6 version - in progress

• Generate layer tiles (Joost, Damon, Anthony) - Done with SAUID, all but one CSD done, will work on hex bin layers next.

  • demo tutorial on tile generation in geo-server (Joost) > sprint 57

  • add 5km shakemap layer tiles for DSRA shakemaps webmercator & 4326 (Damon, Anthony) > sprint 57

  • redo 5km shakemap as "hexgrid" replace "hexbin" webmercator & 4326 (Damon, Anthony) > sprint 58

  • add 1km shakemap layer tiles for DSRA shakemaps webmercator & 4326 (Damon, Anthony) > sprint 57

  • add PSRA P/T aggregation levels blocked by no geometry (Damon, Anthony, Will) > sprint 58 * Create Vector/Image Tile of aggregated contents/structural/non-structural for 500yr loss for each P/T

  • PSRA at CSD & SAUID aggregation waiting on Phil E. re:preference (Damon, Anthony) > sprint 58

  • DSRA at CSD & SAUID aggregation (Damon, Anthony) > sprint 57

  • Automate vector tiles for DSRA scenarios (Damon, Anthony) > sprint 58

• Document on GitHub EC2 deployment procedure for Openquake runs (Anthony) > sprint 58

• Document OpenQuake deployment procedure on MacOS Monterey for Murray (Anthony) > sprint 57

• Setup cloudwatch for Jeremy to monitor EC2 resources *done with .sh script > sprint 57

Demos:

RiskProfiler Beta Deployment - New H7 updates into github pages (Anthony) > sprint 58 RiskProfiler QA/QC (Drew) PSRA Changes v1.4.1 (Will) Update on GPKG (Damon) > sprint 58

---

Scrum Notes:

Tuesday May 3

Anthony: continued riskprofiler github actions automation adding additional error checking e.g. for 0 byte files

Damon: Vector Tile generation using geoserver ogr2ogr method not going to work Noticed empty tables in Canada P/T aggregation *known issue

Joost: pygeoapi configuration Might not have the same hexgrid geometry - unclipped for some indices and clipped for others

Will: Will change names from hexgrid to hexbin working v1.4.1

Drew: Working with Phil on getting PT Canada aggregations into RiskProfiler - turns out the indices were already in ES Thinking of ways to attach geometries

Thursday May 5

Anthony
Fixing consequences.py - issue with numpy multiplication

Damon \ 5k hexbin added to scenario maps - vector tiles in leaflet updating github actions for geopackages looking into gh actions changing "hexbin" to "hexgrid"

Will \ fixed "hexbin" to "hexgrid" changes in v1.4.1 build model-factory opendrr-api PR Heard back from Charles - links fixed in FGP

Joost \ Getting revised pygeoapi config

Drew \ Working with Phil E. on Riskprofiler access HR and resource planning for next fiscal Planning to bring Finance Canada into Kibana - Phil L to reach out to interested parties

Tuesday May 10

Anthony \ Started working on deploying H7 wordpress updates (May 6) Helping Jeremy troubleshoot OpenQuake runs on EC2 Looking into optimizing OQ calcs with multi-processing

Damon \ Finished 5km tiles shakemaps vector tiles - Added to S3 - Added to Github pages Getting caught up github actions

Will \ Working on updates to v1.4.1 model-factory - PR merged Tiegan/Phil meeting - different project - Approved hexbin--> hexgrid - geopackages generated opendrr-api PR in progress v1.4.1 - merge conflict - Anthony to help

Drew \ Ran test build on my system v1.4.1 - Arash getting everything QA script