| Title | Author | Date |
|---|---|---|
Automating Data Download with Python |
John Fay |
Fall 2022 |
These are some notebooks demonstrating various ways to download data using Python packages. These examples are intended to be run using an ArcGIS Desktop install of Python.
- A refresher on ways to import local data files using native file objects,
csv,numpy, andpandas - Accessing web-hosted csv and txt files directly using
pandas - Fetching files on a web server with
urllib - Fetching files on an ftp server with
ftplib - Grabbing HTML tables with
pandas - Scraping data with
requestsandbs4 - Using specialized Python packages for data download
Census
- First, it will reveal some actual strategies for automating data download for your course projects or for other tasks.
- Second, it introduces concepts relating to "web-GIS" and "cloud computing" that we will follow up in subsequent lectures...