Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge dev into main for 2023-12-08 #3138

Merged
merged 147 commits into from
Dec 8, 2023
Merged

Merge dev into main for 2023-12-08 #3138

merged 147 commits into from
Dec 8, 2023

Conversation

zaneselvans
Copy link
Member

  • wip: add data corrections for sizable minority utilities
  • Use click for ETL CLI. Consolidate CLI under etl subpackage.
  • Update conda-lock.yml and rendered conda environment files.
  • Migrate ferc_to_sqlite to the click CLI framework.
  • Create new issue template for adding a new year of eia data
  • Address Christina's PR comments
  • Add step about plant_id mapping to eia issue template
  • update path to zenodo doi in the eia issue template
  • wip: pause video game w/ auto-generating facts to fix
  • Update conda-lock.yml and rendered conda environment files.
  • Make the annual updates template more generic and link directly to the annual updates docs page.
  • Rename eia_new_year.md template to annual_updates.md
  • Update conda-lock.yml and rendered conda environment files.
  • initial version of mannually compiling the facts to fix
  • Update conda-lock.yml and rendered conda environment files.
  • first attempt at adding these special corrections into the explode calcs
  • Update conda-lock.yml and rendered conda environment files.
  • remove duplicate fix and tweek metric tolerances
  • rename some things for clarification
  • Update conda-lock.yml and rendered conda environment files.
  • simplification and docs!
  • Extract EIA923 emissions control table and add 2022 final release data for this table
  • Add release notes for addition of the emissions_contorl table extraction
  • Update conda-lock.yml and rendered conda environment files.
  • Update conda-lock.yml and rendered conda environment files.
  • Sort DBs Fly Datasette; don't distribute Datasette's metadata.yml
  • Fix formatting in bulletized list.
  • Update conda-lock.yml and rendered conda environment files.
  • respond to pr suggestions!
  • Add support for choosing between multiprocess and inprocess executors via cli flag (Add support for choosing between multiprocess and inprocess executors via cli flag #2895)
  • Update conda-lock.yml and rendered conda environment files.
  • Remove epacems_to_parquet script
  • Migrate state_demand analysis script to Kaggle example notebook.
  • Update conda-lock.yml and rendered conda environment files.
  • Remove reference to epacems_to_parquet from CEMS dataset docs
  • Migrate pudl_check_fks to use click
  • Update conda-lock.yml and rendered conda environment files.
  • Exclude nonexistent entity_types_eia table from docs build
  • Migrate metadata_to_rst to use Click framework.
  • Update conda-lock.yml and rendered conda environment files.
  • Migrate pudl_datastore to use Click.
  • Update conda-lock.yml and rendered conda environment files.
  • Unit test pudl_datastore script
  • Remove pudl_setup script and all vestiges of legacy setup.
  • Fix cut-and-paste error in Dockerfile.
  • Improve flexibility for publishing options (Improve flexibility for publishing options #2964)
  • Clarify command for SSHing into a running GCS VM.
  • A nominally working service territory script
  • Update conda-lock.yml and rendered conda environment files.
  • Add an integration test for the pudl_service_territory script.
  • Update conda-lock.yml and rendered conda environment files.
  • Bump google-github-actions/auth from 1 to 2
  • Bump actions/checkout from 3 to 4
  • Condense and document _save_geoparquet()
  • Adjust coverage settings; move config to pyproject.toml
  • Update conda-lock.yml and rendered conda environment files.
  • Skip empty files; move coverage source config to pyproject.toml
  • Add conftest.py to test coverage; update release notes.
  • Consolidate coverage args from Makefile into pyproject.toml
  • Update conda-lock.yml and rendered conda environment files.
  • Move some console script tests from unit to integration.
  • Bump docker/login-action from 2.1.0 to 3.0.0
  • Bump docker/build-push-action from 4.0.0 to 5.1.0
  • Bump docker/setup-buildx-action from 2.5.0 to 3.0.0
  • Update conda-lock.yml and rendered conda environment files.
  • Remove unused docs/Makefile; Simplify covargs in main Makefile.
  • Skip pudl_service_territories test to see if it's causing CI failure
  • Update conda-lock.yml and rendered conda environment files.
  • Use public Zenodo cache, add single-year service territory option.
  • Update conda-lock.yml and rendered conda environment files.
  • Test both dissolve/no-dissolve, ba/util service territories
  • Fix small syntax error in gcp_pudl_etl.sh
  • Test 2 years and --limit-by-state
  • only calculate inter-table calcs once
  • Hide diffs in lock files by default. (Hide diffs in lock files by default. #3103)
  • Update conda-lock.yml and rendered conda environment files.
  • Checkout env files from 7cc80da
  • Update conda-lock.yml and rendered conda environment files.
  • Checkout env files from 7cc80da [no ci]
  • Checkout env files from dev and remove apt-get installs [no ci]
  • Add apt-get installs back and update python log level [no ci]
  • Restrict dagster-postgres version [no ci]
  • Revert debugging changes
  • Update conda-lock.yml and rendered conda environment files.
  • align environment files with dev
  • Update conda-lock.yml and rendered conda environment files.
  • Update conda-lock.yml and rendered conda environment files.
  • Update conda-lock.yml and rendered conda environment files.
  • Reorganize contributing docs + add process description. (Reorganize contributing docs + add process description. #3044)
  • Update conda-lock.yml and rendered conda environment files.
  • Update conda-lock.yml and rendered conda environment files.
  • change pks for the sizable minority fixes
  • smol docs fix
  • Add slow test marker to skip during pre-commit.
  • Tag a few more slow unit tests.
  • Update conda-lock.yml and rendered conda environment files.
  • Fix header for the v2023.12.01 release notes
  • Update conda-lock.yml and rendered conda environment files.

cmgosnell and others added 30 commits November 22, 2023 11:34
I COULD CALL THEM WRONG! I AM BEING POLITE HERE!
i plan on ripping that out in favor of handing the exploder facts
zaneselvans and others added 28 commits December 4, 2023 21:10
Clean up PUDL CLI tools; use Click framework
…-eia-annual-release

Create new issue template for adding a new year of data
* Reorganize contributing docs + add process description.

* Update conda-lock.yml and rendered conda environment files.

* Update for PR comments

---------

Co-authored-by: jdangerx <[email protected]>
…nority

add data corrections for "sizable minority" utilities
@zaneselvans zaneselvans merged commit 3df3df3 into main Dec 8, 2023
14 checks passed
@zaneselvans zaneselvans self-assigned this Dec 8, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

6 participants