Skip to content

Commit

Permalink
Dropsonde updates (eurec4a#20)
Browse files Browse the repository at this point in the history
* updated JOANNE to version 0.7.0 via IPFS
* add ipfsspec dependency
* add IPFS info to README
* link dropsonde dataset JOANNE also in the main catalog so that it
can be accessed by cat.dropsondes.JOANNE
  • Loading branch information
tmieslinger authored Dec 11, 2020
1 parent e585799 commit b9aa86a
Show file tree
Hide file tree
Showing 5 changed files with 32 additions and 13 deletions.
12 changes: 12 additions & 0 deletions JOANNE/main.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
plugins:
source:
- module: intake_xarray
- module: ipfsspec

sources:
level3:
args:
consolidated: true
urlpath: ipfs://QmWcdcXqTQhyfwtttqh2DT2BiEk67uXxuGdskghDpuXYUw
description: EUREC4A/ATOMIC JOANNE Level-3 gridded dropsonde dataset
driver: zarr
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,7 @@ campaign](http://eurec4a.eu/) stored on: 1)
University (via OPeNDAP) and 3) a zarr-backed
object-store (using [minio](https://min.io)) at https://minio.denby.eu
and 4) OPeNDAP access to files at
[NOAA's Physical Sciences Lab](https://psl.noaa.gov/thredds/catalog/Datasets/ATOMIC/data/catalog.html).
[NOAA's Physical Sciences Lab](https://psl.noaa.gov/thredds/catalog/Datasets/ATOMIC/data/catalog.html) and 5) data linked via [IPFS](https://ipfs.io/).


## Usage
Expand Down
19 changes: 7 additions & 12 deletions catalog.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,18 +21,6 @@ sources:
driver: intake.catalog.local.YAMLFileCatalog
metadata: {}

dropsondes:
args:
consolidated: true
storage_options:
s3:
anon: true
client_kwargs:
endpoint_url: https://minio.denby.eu
urlpath: simplecache::s3://eurec4a-environment/dropsondes
description: JOANNE Gridded sounding dataset
driver: zarr

halo:
args:
path: "{{CATALOG_DIR}}/halo/main.yaml"
Expand Down Expand Up @@ -60,3 +48,10 @@ sources:
path: "{{CATALOG_DIR}}/swifts.yml"
driver: intake.catalog.local.YAMLFileCatalog
metadata: {}

dropsondes:
args:
path: "{{CATALOG_DIR}}/dropsondes.yaml"
description: 'Dropsonde dataset JOANNE.'
driver: intake.catalog.local.YAMLFileCatalog
metadata: {}
11 changes: 11 additions & 0 deletions dropsondes.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
plugins:
source:
- module: intake_xarray

sources:
JOANNE:
args:
path: "{{CATALOG_DIR}}/JOANNE/main.yaml"
description: The EUREC4A dropsonde dataset JOANNE contains HALO and P3 dropsonde data.
driver: intake.catalog.local.YAMLFileCatalog
metadata: {}
1 change: 1 addition & 0 deletions requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -6,5 +6,6 @@ zarr
fsspec>=0.7.4
pydap
s3fs
ipfsspec
requests
intake-xarray>=0.3.2

0 comments on commit b9aa86a

Please sign in to comment.