Skip to content

Sprint 55

Jump to bottom
drotheram edited this page Apr 18, 2022 · 12 revisions

Due by April 14, 2022 (Review on April 14)

Sprint Goals:

  • Finalize views & support edits/revisions

    • PSRA indicator revisions - waiting on Tiegan to merge final edits, we have them in PostGIS, Drew will review and load in ES
      • GPKG generation via GitHub Actions for release assets (Damon, Anthony) > sprint 56
      • Additional aggregations for PSRA if needed (Will) - Draft aggregations are completed, need to review with Phil/Tiegan > sprint 56

  • Publish FGP records (Joost)

    • Send revised data files and MXD's to FGP (Will, Phil)
      • Physical Exposure
      • Social Fabric - Will sent on Feb 11
      • PSRA > sprint 56
      • DSRA 1KM, 5KM, 25KM - Joost to get translations and Will to send with latest MXD's
    • Review revised FGP data layers (Murray, Phil, Tiegan, Joost, Will)
      • Physical Exposure
      • Social Fabric
      • PSRA
      • DSRA
    • Prep legend files (MXD's) for FGP data See issue
      • Physical Exposure
      • Social Fabric
      • PSRA
      • DSRA (Carol)

  • Security Documentation (Joost)

  • DSRA Dashboards in Kibana (Drew, Damon) - 2/5 done

    • dsra_sim9p0_cascadiainterfacebestfault > sprint 56
    • dsra_scm7p5_valdesbois > sprint 56
    • dsra_acm7p3_leechriverfullfault > sprint 56
    • dsra_idm7p1_sidney > sprint 56
    • dsra_acm7p0_georgiastraitfault
    • onboard finance Canada - waiting for prod environment

  • Use of XZ-compressed repos XZ- or Zstd-compressed release assets to reduce Git LFS data storage and bandwidth usage (Anthony) > sprint 56

  • Unclipped Hexbin layers (Drew) - needs to be put into ES - in staging by April 5 ** Done **

  • Add DSRA unclipped Hexbin layers to Downloads repo (Damon) - PR pending (Tiegan) ** Done **

  • Fully automate riskprofiler static website generation in Docker Wordpress instance (Anthony)

    • Deploy v1 build of beta.riskprofiler.ca > sprint 56

  • Generate layer tiles (Joost, Damon, Anthony) - Done with SAUID, all but one CSD done, will work on hex bin layers next.

    • demo tutorial on tile generation in geo-server (Joost) > sprint 56

  • Added PSRA download to github pages - CanadaSRM2 repo (Damon) ** Done **

  • ER Diagrams for Opendrr-api postgis database (Will) ** Done **

Demos:

  • FGP records (Social Vulnerability, DSRA, etc.)(Joost) > sprint 56
  • Wordpress container (Anthony)
  • FGP geospatial services (Will)
  • ElasticSearch-Dump demo (Drew)

Scrum Notes:

Thurs April 7

Joost:
Still loading geotiles
Worked with Damon setup geoserver\ Contract meeting later today\

Damon:
getting geo-server running
Re-evaluating canada-srm2 release assets
Canada-srm2 PR for Will's geopackages
New release assets in earthquake scenarios
Speed up tile generation with Tippecanoe\

Anthony:
setting up new EC2 instance - evaluating cost effectiveness
Got geo-server up and running
also testing Tippecanoe
Reviewing Damon PR - better strategies for large numbers of files
Working on static website\

Will:
Running new branch of model-factory and opendrr-api
Running Canada-srm from master
remove cDamage
Add psra hexbins
waiting on Phil/Tiegan for review
New PostGres version PGAdmin 6.7 postgres 14 - everything seems to run faster\

Drew:
Re-build stack from master - Build process ran flawlessly
Implement parallel multielasticsearch dump 8x faster than previous
Dump v1.4.0 indices to AWS S3 bucket for Arash\

Tuesday April 12

Will
minor changes to model-factory and opendrr-api
moving exposure and other minor changes
Waiting on Phil to review hexbin agg updates

Anthony \ Reviewing cost savings for EC2 spot instances on AWS
Moving TH volumes from GP2 to GP3
Realizing XZ repos have some issues robustness in compression
Looking into Zstandard (zstd) as an alternative

Damon \ 1 km hexbin vector tiles loaded to RiskProfiler (Joost)

  • way faster to load but still slower than just loading bounding box
    PR in for PSRA geopackages
    CSD vector tiles

Drew \

Thursday April 14

Damon
finding strategy for shakemap viz vector tiles
Up and running with Kibana
Testing vector tiles

Will
Edits to ER diagrams, tweak in model-factory
Provence PSRA tables (hcurve)

Anthony
Help Jeremy Rimando with OQ scenario runs (Ubuntu in VirtualBox; SSH over Session Manager)
Misc GitHub script fixing tasks

Drew
Got Damon up and running with Kibana
Slowly correcting Kibana Dashboards

Sprint Planning | Sprint Review
Wikis: data | model-factory | opendrr-api | opendrr | python-env | riskprofiler-cms

Clone this wiki locally