Medium badge
Medium 18673213 10159101362455157 3411827820256446276 o Matthew Gotth-Olsen

Proof of Automation

Automated uploading of datasets to the open data portal, and subsequent ingestion into the catalog.

  • December 1, 2017 at 10:10 AM
  • Visible to public
I created a text file of urls that is processed by cron on, that loops through each file url, downloads and imports it into the Open Data catalog. From there, it uses drush to automatically import a select group of datasets into MySQL, which also makes those datasets available via a REST API.