Summer SEES
-Brent Porter
Activities
- Project Overview
- Python Basics
- ArcPy Library
- GIS Web Services
- Web App Data Integration
Project Overview
-
We will be working on data processing and services for a near real-time emergency response web application called MOVES
-
Harvesting daily Quantitative Precipitation Estimates (QPE)
-
Creating rain-based color symbology point and raster surfaces
-
Building Spatial Rest Endpoints out of the data
-
Consuming the endpoints through JavaScript Ajax functionality in MOVES application
QPE
Qualitative Precipitation Estimates
-
National Weather Service website - http://water.weather.gov/precip/
-
Done on many different time frequencies
-
For our purposes, they are made into shapefiles which can be downloaded
Downloaded Data
-
Current workflow has the downloaded shapefile brought into ArcGIS Project that goes through a variety of processes that do the following
-
reproject into common spatial projection
-
visualize the data into standard symbology
-
transform the data points into a raster image
-
-
This is all done manually!
After Data Transformation
- The QPE points dataset is used to create a QPE points Rest-based Web Service
- The QPE raster dataset is used to create a QPE raster Rest-based Web Service
- Example end products are here - Coming Soon (check back for more info here)
- This is also done manually
MOVES Web App
- Once the web services are created they are ready to be integrated into MOVES Web App
- This app uses javascript/html5,leafletjs and ajax libraries to consume the web services
- There is both a visualization component to the consumption and a data discovery component.
- New services require the editing of the js files/variables to reflect the most currently available QPE services - this is also done manually
So...
- There are several areas by which we can expedite the flow of data into MOVES thru automation
- Python scripts to download a daily shapefile archive
- Geoprocessing with (ArcPy - a gis python library) to build a workflow for automating the transformation of the data into web services
- The javascript variables and files that have pointers to the services
Pre Meeting Activities
- First do this - this url will get you a free trial
of ArcGIS - a prerequisite for these tutorials
You should be able to use the profile you create to also sign up for the free training from the links that follow.
http://www.esri.com/software/arcgis/free-trial
Intro GIS Training june 14
Getting Started with ArcGIS Pro(2 Hours and 30 Minutes)
https://www.esri.com/training/catalog/57660c6ebb54adb30c945412/get-started-with-arcgis-pro/
Getting Started with ArcGIS (4 Hours)
https://www.esri.com/training/catalog/57630434851d31e02a43ef28/getting-started-with-gis/
Python Intro (3 Hours)
https://www.esri.com/training/catalog/57630436851d31e02a43f13c/python-for-everyone/
Basics to Coordinate Systems (3 Hours)
https://www.esri.com/training/catalog/57630435851d31e02a43efe7/basics-of-geographic-coordinate-systems/
Web GIS & Map Caches
ESRI Javascript Web Map API (1 Hour)
https://www.esri.com/training/catalog/57630435851d31e02a43f03c/discover-the-next-generation-arcgis-api-4-for-javascript/
Introduction to ArcGIS Server (1 Hour)
https://www.esri.com/training/catalog/57eb1ef8ee85c0f5204bb7f3/arcgis-for-server:-an-introduction-(2016)/
Sharing Cached Imagery in ArcGIS (1 Hour)
https://www.esri.com/training/catalog/57630433851d31e02a43eedd/sharing-cached-imagery-in-arcgis/
Intro to ArcGIS Server Rest API (3 Hours)
https://www.esri.com/training/catalog/57630436851d31e02a43f16a/introduction-to-the-arcgis-for-server-rest-api/
HTML/Javascript/Python Background
There are many tutorials on HTML, CSS, Javascript and Python on the web - if you feel you need a little more practice with them, here are a few:
HTML Background Tutorials
https://www.w3schools.com/html/
CSS Tutorial
https://www.w3schools.com/css/default.asp
Javascript Tutorials
https://www.w3schools.com/Js/
Python Tutorials - depending on time & other issues we may or may not get to the point where we are processing data with python. Here is an intro tutorial on working with python. If we are able to work on it, it will be grabbing data and processing it.
http://www.learnpython.org/
More about QPE/NWS/Rivers
About Precipitation - National Weather Service
http://water.weather.gov/precip/about.php
Interactive Map - Chose the QPE Tab - you can see the estimated accumulated precipitation(rainfall) for a given area. The map is interactive, you can zoom in and see the data overlaid on top of other typical baseman data
River Gauges - National Weather Service
http://water.weather.gov/ahps/
(this is another interactive application that shows rivers and their flood stage if any)
MOVES Web App/Leaflet
LeafletJS - this is an excellent open source mapping library that we use for MOVES application.
--data integration
--interaction and visualization of the QPE dataset river gauges
Tutorials for leaflet are available here - http://leafletjs.com/examples.html
--Check out the Leaflet Quick Start Guide
--Using GeoJSON with Leaflet
http://leafletjs.com/examples/geojson/
One instance of the Moves Web App can be found at this url -
http://magic.csr.utexas.edu/public/views/
Summer SEES presentation 2017
By organizedchaos
Summer SEES presentation 2017
- 359