Skip to content

Commit

Permalink
erge upstrea
Browse files Browse the repository at this point in the history
  • Loading branch information
kylerchin committed Feb 2, 2025
2 parents 8d1e38c + 9148561 commit 7b3215f
Show file tree
Hide file tree
Showing 479 changed files with 265 additions and 5,606 deletions.
6 changes: 6 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,12 @@ Rules for Onestop IDs in this repository:
- Name can include any alphanumeric characters in UTF-8
- The only separation or punctuation character allowed in the name component is a tilde (`~`)

## Enriching Transitland Atlas with external reference data

We welcome help from the community to expand Transitland Atlas by reviewing external reference datasets, including:

- [NTD GTFS Weblinks](./external-data-for-reference/ntd-gtfs-weblinks/readme.md)

## License

All data files in this repository are made available under the [Community Data License Agreement – Permissive, Version 1.0](LICENSE.txt). This license allows you to:
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -1017,22 +1017,6 @@
}
]
},
{
"id": "f-boston~express~bus~inc~",
"spec": "gtfs",
"urls": {
"static_current": "https://rapid.nationalrtap.org/GTFSFileManagement/UserUploadFiles/11782/fare_attributes.zip"
},
"operators": [
{
"onestop_id": "o-boston~express~bus~inc~",
"name": "Boston Express Bus, Inc.",
"tags": {
"us_ntd_id": "10133"
}
}
]
},
{
"id": "f-belknap~merrimack~cap~concord~area~transit",
"spec": "gtfs",
Expand All @@ -1049,22 +1033,6 @@
}
]
},
{
"id": "f-vna~home~healthcare~hospice~community~service",
"spec": "gtfs",
"urls": {
"static_current": "http://www.swrpc.org/wp-content/uploads/2024/03/HCS_GTFS.zip"
},
"operators": [
{
"onestop_id": "o-vna~home~healthcare~hospice~community~service",
"name": "VNA Home Healthcare, Hospice & Community Service",
"tags": {
"us_ntd_id": "10159"
}
}
]
},
{
"id": "f-nantucket~regional~transit~authority",
"spec": "gtfs",
Expand Down Expand Up @@ -1095,38 +1063,6 @@
}
]
},
{
"id": "f-tri~county~cap~inc~north~country~transit",
"spec": "gtfs",
"urls": {
"static_current": "https://tricountytransit.org/GTFS/GTFS.zip"
},
"operators": [
{
"onestop_id": "o-tri~county~cap~inc~north~country~transit",
"name": "Tri-County CAP, Inc./North Country Transit",
"tags": {
"us_ntd_id": "10172"
}
}
]
},
{
"id": "f-woods~hole~martha~s~vineyard~and~nantucket~steamship~authority",
"spec": "gtfs",
"urls": {
"static_current": "https://www-steamship-assets.s3.amazonaws.com/versioned_downloadable_forms/path/google_transit.zip"
},
"operators": [
{
"onestop_id": "o-woods~hole~martha~s~vineyard~and~nantucket~steamship~authority",
"name": "Woods Hole, Martha's Vineyard and Nantucket Steamship Authority",
"tags": {
"us_ntd_id": "10183"
}
}
]
},
{
"id": "f-mashantucket~pequot~tribal~nation",
"spec": "gtfs",
Expand Down Expand Up @@ -1175,22 +1111,6 @@
}
]
},
{
"id": "f-southwestern~community~services~transportation",
"spec": "gtfs",
"urls": {
"static_current": "https://rapid.nationalrtap.org/GTFSFileManagement/UserUploadFiles/11917/sct_agency.zip"
},
"operators": [
{
"onestop_id": "o-southwestern~community~services~transportation",
"name": "Southwestern Community Services Transportation",
"tags": {
"us_ntd_id": "11156"
}
}
]
},
{
"id": "f-niagara~frontier~transportation~authority",
"spec": "gtfs",
Expand Down
File renamed without changes.
74 changes: 74 additions & 0 deletions external-data-for-reference/ntd-gtfs-weblinks/readme.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,74 @@
# Review of US NTD GTFS weblinks

The files in this subdirectory relate to reviewing the US NTD release of GTFS weblinks and using it to update and add coverage to Transitland Atlas.

## Background

See:

- https://www.interline.io/blog/us-ntd-reporting-gtfs/
- https://www.interline.io/blog/us-ntd-reporting-gtfs-adopted/
- https://www.interline.io/blog/us-national-transit-database-releases-data-and-requests-more-feedback-2/
- https://www.transit.dot.gov/ntd/data-product/2023-annual-database-general-transit-feed-specification-gtfs-weblinks

## Files in this subdirectory

- `2023-gtfs-weblinks-checked.csv` - CSV of feeds that have been checked against Transitland contents in late 2024. The `Status` column indicates:
- "Success" - URL returns valid GTFS data
- "Success (Retried with HTTP/HTTPS)" - URL works after protocol change
- "No results" - URL is not accessible or doesn't return valid GTFS
- Note: Agencies that did not provide a URL are not included in the check results. We welcome help to politely contact these agencies directly to ask for public URLs for their GTFS feeds.
- `2023-gtfs-weblinks.dmfr.json` - a JSON file containing proposed DMFR records for potentially unmatched records

## Help wanted

To help, review the contents of `2023-gtfs-weblinks.dmfr.json`:

1) Look for records that may be missing in Transitland Atlas
2) Check for `likely_match_operator_link` and `likely_match_full` to see if the script successfully found an existing match, or if it's just noise
3) Also browse the Transitland map and website for an existing feed record in the same location but a different name (sometimes agencies change their brand name, or use a different name when reporting to NTD)
4) When adding a feed to Transitland Atlas, you can also delete the relevant portion of `2023-gtfs-weblinks.dmfr.json` in the same pull request

## Notes

To recreate these files:

```sh
wget https://www.transit.dot.gov/sites/fta.dot.gov/files/2024-10/2023%20GTFS%20Weblinks.xlsx

in2csv 2023\ GTFS\ Weblinks.xlsx > 2023-gtfs-weblinks.csv

pipenv run python check-ntd-urls.py 2023-gtfs-weblinks.csv > 2023-gtfs-weblinks-checked.csv

pipenv run python check-ntd-urls.py
```

## NTD IDs in Transitland Atlas

Operator records in DMFR files that correspond to US NTD-reporting agencies can include a `us_ntd_id` tag with the agency's NTD ID. For example:

```json
{
"feeds": [
{
"id": "f-c23-metrokingcounty",
"spec": "gtfs",
"urls": {
"static_current": "http://metro.kingcounty.gov/GTFS/google_transit.zip"
},
"operators": [
{
"onestop_id": "o-c23-metrotransit",
"name": "King County Metro",
"website": "http://metro.kingcounty.gov",
"tags": {
"us_ntd_id": "00001"
}
}
]
}
]
}
```

This will be useful for ongoing cross-referencing between Transitland and US NTD datasets.
66 changes: 56 additions & 10 deletions feeds/nationalrtap.org.dmfr.json
Original file line number Diff line number Diff line change
Expand Up @@ -32,22 +32,17 @@
"id": "f-9t9e-cityofsierravista",
"spec": "gtfs",
"urls": {
"static_current": "http://demopro.nationalrtap.org/admin/GTFSzipFiles/3746/google_transit.zip"
},
"tags": {
"status": "outdated"
"static_current": "https://rapid.nationalrtap.org/GTFSFileManagement/UserUploadFiles/12009/VistaTransit_AZ_GTFS.zip",
"static_historic": [
"http://demopro.nationalrtap.org/admin/GTFSzipFiles/3746/google_transit.zip"
]
},
"operators": [
{
"onestop_id": "o-9t9e-cityofsierravista",
"name": "City of Sierra Vista",
"short_name": "Vista Transit",
"website": "http://www.sierravistaaz.gov/city-departments/transit/",
"associated_feeds": [
{
"gtfs_agency_id": "Sierra Vista"
}
],
"website": "https://www.sierravistaaz.gov/our-city/bus-service",
"tags": {
"twitter_general": "SierraVistaAZ",
"us_ntd_id": "90239",
Expand Down Expand Up @@ -179,6 +174,23 @@
}
]
},
{
"id": "f-boston~express~bus~inc",
"spec": "gtfs",
"urls": {
"static_current": "https://rapid.nationalrtap.org/GTFSFileManagement/UserUploadFiles/11782/fare_attributes.zip"
},
"operators": [
{
"onestop_id": "o-boston~express~bus~inc",
"name": "Boston Express",
"website": "https://www.bostonexpressbus.com/",
"tags": {
"us_ntd_id": "10133"
}
}
]
},
{
"id": "f-carson~ca~us",
"spec": "gtfs",
Expand Down Expand Up @@ -216,6 +228,23 @@
}
]
},
{
"id": "f-cranberry~isles",
"spec": "gtfs",
"urls": {
"static_current": "https://rapid.nationalrtap.org/GTFSFileManagement/UserUploadFiles/13051/CranberryIslesGTFS.zip"
},
"operators": [
{
"onestop_id": "o-cranberry~isles",
"name": "Town of Cranberry Isles Commuter Ferry",
"website": "https://www.cranberryisles-me.gov/public-services/transportation/",
"tags": {
"us_ntd_id": "10153"
}
}
]
},
{
"id": "f-djq-sunshinebuscompany~fl~us",
"spec": "gtfs",
Expand Down Expand Up @@ -693,6 +722,23 @@
}
]
},
{
"id": "f-southwestern~community~services~transportation",
"spec": "gtfs",
"urls": {
"static_current": "https://rapid.nationalrtap.org/GTFSFileManagement/UserUploadFiles/11917/sct_agency.zip"
},
"operators": [
{
"onestop_id": "o-southwestern~community~services~transportation",
"name": "Southwestern Community Services Transportation",
"website": "https://www.scshelps.org/transportation/",
"tags": {
"us_ntd_id": "11156"
}
}
]
},
{
"id": "f-springfield~oh~us",
"spec": "gtfs",
Expand Down
20 changes: 20 additions & 0 deletions feeds/s3.amazonaws.com.dmfr.json
Original file line number Diff line number Diff line change
Expand Up @@ -103,6 +103,26 @@
"tags": {
"mdb_source_id": "2026"
}
},
{
"id": "f-steamshipauthority~ma~us",
"spec": "gtfs",
"urls": {
"static_current": "https://www-steamship-assets.s3.amazonaws.com/versioned_downloadable_forms/path/google_transit.zip",
"static_historic": [
"https://github.com/transitland/gtfs-archives-not-hosted-elsewhere/raw/master/steamshipauthority-ma-us.zip"
]
},
"operators": [
{
"onestop_id": "o-steamshipauthority~ma~us",
"name": "Steamship Authority",
"website": "https://www.steamshipauthority.com/",
"tags": {
"us_ntd_id": "10183"
}
}
]
}
],
"license_spdx_identifier": "CDLA-Permissive-1.0"
Expand Down
24 changes: 24 additions & 0 deletions feeds/swrpc.org.dmfr.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
{
"$schema": "https://dmfr.transit.land/json-schema/dmfr.schema-v0.5.1.json",
"feeds": [
{
"id": "f-vna~home~healthcare~hospice~community~service",
"spec": "gtfs",
"urls": {
"static_current": "http://www.swrpc.org/wp-content/uploads/2024/03/HCS_GTFS.zip"
},
"operators": [
{
"onestop_id": "o-vna~home~healthcare~hospice~community~service",
"name": "VNA Home Healthcare, Hospice & Community Service",
"short_name": "City Express",
"website": "https://www.hcsservices.org/services/transportation/city-express/",
"tags": {
"us_ntd_id": "10159"
}
}
]
}
],
"license_spdx_identifier": "CDLA-Permissive-1.0"
}
12 changes: 0 additions & 12 deletions feeds/transitland.github.com.dmfr.json
Original file line number Diff line number Diff line change
Expand Up @@ -306,18 +306,6 @@
}
]
},
{
"id": "f-steamshipauthority~ma~us",
"spec": "gtfs",
"urls": {
"static_historic": [
"https://github.com/transitland/gtfs-archives-not-hosted-elsewhere/raw/master/steamshipauthority-ma-us.zip"
]
},
"license": {
"url": "https://github.com/transitland/gtfs-archives-not-hosted-elsewhere/blob/master/interline-gtfs-license.md"
}
},
{
"id": "f-tf34-metropolitantransportcorporation",
"spec": "gtfs",
Expand Down
24 changes: 24 additions & 0 deletions feeds/tricountytransit.org.dmfr.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,24 @@
{
"$schema": "https://dmfr.transit.land/json-schema/dmfr.schema-v0.5.1.json",
"feeds": [
{
"id": "f-tri~county~cap~inc~north~country~transit",
"spec": "gtfs",
"urls": {
"static_current": "https://tricountytransit.org/GTFS/GTFS.zip"
},
"operators": [
{
"onestop_id": "o-tri~county~cap~inc~north~country~transit",
"name": "Tri-County CAP, Inc./North Country Transit",
"short_name": "TCT",
"website": "https://tricountytransit.org/",
"tags": {
"us_ntd_id": "10172"
}
}
]
}
],
"license_spdx_identifier": "CDLA-Permissive-1.0"
}
Loading

0 comments on commit 7b3215f

Please sign in to comment.