Medium badge

Automation Machine

Louisville-Metro-Badges/Automation-Machine

Work to automate some process in the data life cycle- from data collection to data visualization.

 

Matthew Gotth-Olsen

Expert

Awarded badge on December 6, 2017

Medium 18673213 10159101362455157 3411827820256446276 o

Endorsements & Feedback

Feedback

Great work looks like you earned your badge!

Small 18673213 10159101362455157 3411827820256446276 o mattgolsen About 2 years ago

Badge Portfolio

Proof of Automation

Evidence visible to public
Write up a summary about how you were able to change the process, and how the current automation process works. More Info

Automated uploading of datasets to the open data portal, and subsequent ingestion into the catalog.

I created a text file of urls that is processed by cron on data.louisvilleky.gov, that loops through each file url, downloads and imports it into the Open Data catalog. From there, it uses drush to automatically import a select group of datasets into MySQL, which also makes those datasets available via a REST API.