Pre-class pollWelcome! Before we begin our adventure on “spatial thinking,” please take a minute to take this poll.
After the workshop, please take this survey:
- Background: Geographical information in the U.S.
- Hello Map: Thematic Mapping and the basics
- Connecting a folder
- Adding Layers
- Setting the projection
- Choropleth Maps
- Acquiring data
- The LA Data Portal
- Project the data
- Hot spot analysis
Part I: Introduction to GIS and ESRI
Gettin’ down and dirty with ESRI
The first step in this tutorial is to understand that we are covering the basics of desktop GIS analysis using ESRI’s ArcGIS software suite. This is by no means an all encompassing “entirety of GIS” tutorial, but rather a view on how GIS can be used to build maps from ESRI’s perspective, limited by the functionalities of the software being covered. There are many other tools you may want to consider to do your spatial analysis, including R, Python, Carto, Mapbox, D3, and qGIS.
The core function of the ESRI ArcGIS suite lies within two programs:
- ArcCatalog – for managing GIS datasets
- ArcMap – for mapping GIS datasets
What about OpenSource alternatives?
QGIS is as an alternative to ArcGIS that is free and openly available to the public on all computing platforms. Despite the accessibility of QGIS, there is a steeper learning curve for those learning GIS for the first time. However, those seeking a free low-cost alternative to ArcGIS can apply the concepts learned in this workshop with that program.
With geographical ideas in mind, it is finally time to map something! For this exercise, you are provided with a Workshop [simple_tooltip content=’A geodatabase is shown as a folder. ‘]geodatabase[/simple_tooltip], which is a collection of GIS datasets. A GIS dataset can be any of the following:
- a vector layer – points, lines or polygons
- a raster layer – an image, Satellite imagery, elevation data
- tabular data – excel spreadsheet, csv, etc.
Vector vs. RastersGeographic data is stored either as vector data (as points, lines, or polygons) or raster data (as pixel grids).
Because of these differences in data storage, vector data is best suited for a human geography context (ex. urban planning, transportation forecasting, asset mapping), while raster data are best used for storing data on physical geography (ex. satellite imagery, elevation, watersheds, vegetation).
In ArcGIS, vector data is stored as individual .shp files or feature classes within a geodatabase. Raster data is stored as .tiffs, .jpgs, or other image formats.
Our geodatabase contains multiple GIS feature classes.
Download and [simple_tooltip content=’Extracting means using a program, such as 7zip to unzip files from a single file.’]extract[/simple_tooltip] Workshop.zip. Locate Workshop.gdb, and put it in a project folder for this workshop. You will learn how to inspect the geodatabase data in ArcCatalog, then use ArcMap to create some maps.
Here is a look at our Workshop geodatabase:
workshop2018.gdb |--us_cities |--us_counties |--us_states
Connecting a folder in ArcCatalog
Open up ArcCatalog and click the second button to the left, which is the “Connect Folder” button.
Navigate to the Folder where you extracted the “workshopData2018.zip” file and then select “OK”.
Do not try to connect a file!If you try to connect files, you will notice that the “OK” button is grayed out, connecting folders allows you only to choose folders.
View and Preview the data
After you’ve connected the folder, you can check Folder Connections and open the Folder which you’ve connected. Locate “workshop2018.gdb” and double click it to view its contents. Browse for us_states and click the “Preview” tab.
Hello Egypt: Setting the projection
Geographic coordinate systems are typically measured in decimal degrees, and are useful when your data is global and/or comes with latitude and longitude coordinates. However, because of its angular units, it is not recommended for spatial analysis. Instead, one should consider using a projected coordinate system that is suited to the region of analysis. Given that we are only working with Egypt based data, let’s set our projection to the following UTM zone that is specifically optimized for our region of interest:
- WGS 1984 UTM Zone 36N
Let’s set our projection with this in mind:
- Right click on “Layers” and go to “properties” (or just double click on “Layers”)
- Select the “Coordinate Systems” tab
- Go to “Projected Coordinate Systems“, “UTM“, “WGS 1984“, “Northern Hemisphere“, and choose “WGS 1984 UTM Zone 36N“
It's on the fly!The software will warn you that you are projecting your datasets on the fly (note that it is not reprojecting the actual data, it is doing so only within the scope of this project space). If you want to perform spatial analysis, it is recommended that all layers in your project be reprojected to an appropriate coordinate system. More information on how to do this can be found here.
Now the time has come to fire up ArcMap and become a digital cartographer! The first step for any GIS project is to have data (more on this later). In order to add data to your project click on the “Add data” button:
Notice how the connected folder can be selected and datasets be added now? Also, if your map is feeling a bit empty, you can add base maps by clicking the upside down triangle next to the Add Data button. Adding a basemap only provides reference information and nothing else.
Order your layers
Vector layers are also referred to as “feature classes” in ESRI-Land. All GIS datasets can be added in this same way. Now drag each layer and re-order them. If you are familiar with Adobe Photoshop or Illustrator, you will recognize conceptual similarities with layering. What happens when layers are re-ordered? How does this dictate your strategy on building a single flattened map with multiple layers?
Challenge ExerciseModify your map by changing fill colors, outline colors, symbol sizes, symbol colors to make it look like this:
Outlines, fills, colors, weight, action! Here is where the artist in you comes out and the design phase of creating a map begins. Consider color choices: grayscale? Color schemes? Color hierarchy? Inevitably, you will find yourselves in the throes of ESRI’s symbolization quagmire…
Map elements need labels at times. Consider what needs to be labeled, and what does not. Label sizes, fonts, weights, placement, colors are all things to consider for your map. Understand the relationship between labels, attributes, and layers.
Labels hard to read? Halo it!Sometimes your labels may be hard to read, depending on what resides in the background. In this situation, you can add a white “halo” to your labels to make them “pop” some more. This feature is very, very hidden in ArcMap, but here is how to get to it:
- Go the Label tab
- Click “Symbol“
- Click “Edit symbol“
- Click “Mask“
- Choose “Halo“
Every layer (feature class) comes with attributes. This is the all-important “information” part of geographic “information” systems mapping. Data in the attribute tables dictates what can get mapped. Open the attribute table of each layer (right click on the layer from the table of contents, Open Attribute Table):
Study how each row and column is tied to the mapped element. Questions we will answer include:
- What is the unique identifier for each row?
- What other attributes exist?
- What happens when you select a row on the attribute table?
- How do you sort elements?
- Can you build custom queries?
- Can you build graphs?
For this section, we will focus on creating a choropleth (which just means a colored map based on numerical data)!
When creating a choropleth the following needs to be considered:
- Is the data choropleth-able?
- Choropleths work best when representing data where boundaries are important
- Conversely, choropleths do not work well when attempting to show data where boundaries are NOT important/irrelevant
- Do you have the data in the geographic scale you wish to map it at?
- Can you connect the data to an existing layer?
- Which coloring style best represents your data?
- If your information is continuous then use a single color gradient
- If your information has a positive or negative range, use an opposite color scheme
To create a choropleth map, follow these steps:
- Right click on us_counties and go to properties (or just double click it!)
- Select the Symbology tab, click on Quantities, and select POP2010 for the Value field.
Now click on the Classify button. There are several methods to choose from. Look at the following documentation to determine which method is best suited for your data.
Part 2: Working with spatial data
The open data movement has made more and more data available for academics to download and use for their research. But how can we map this data? This workshop will take you through the process of acquiring data from the Los Angeles Open Data portal and visualizing it on ArcGIS for further analysis.
Los Angeles Open Data portal
The Los Angeles Open Data Portal
Search for crime data
Inspect the data
Almost 2 million records! Let’s filter it down to something more manageable.
Now add the filter to narrow down the data to one month:
Export the data
Cleaning up those coordinates
Open the downloaded data in Excel. Scroll to the right until you see the Location column.
Hmm, that’s strange, the latitude and longitude columns are in the same column! ArcGIS does not like this. Let’s clean this up.
First, find and replace the brackets.
- Select the Location column
- Bring up the find and replace tool (ctrl-h)
- For “Find what”, enter an open bracket “(“
- Click Replace All
Repeat for the closing bracket.
Split the column into two:
Choose, delimited, check the “Comma” box, and finish.
Rename the column headers to Latitude and Longitude
Let’s map it!
Start a brand new ArcMap project and add the csv file (remember the Add Data button?). Right click on the csv file and Display XY Data.
- Set X to Longitude
- Set Y to Latitude
- Click Edit for the coordinate system
- Enter “WGS 1984” in the search box
- Choose WGS 1984
Now save your new layer as a shapefile, or geodatabase:
Project the data
Our data is currently in a geographic coordinate system (WGS1984). Let’s change this to a projected coordinate system. The UTM zone for Los Angeles is UTM Zone 11N.
Click on the search tool
Type “project” and click on Project (Data Management)
Now, set the projection of the data frame. Right click on Layers, and go to properties. Then, set the coordinate system to NAD 1983 UTM Zone 11N
Let’s find crime hot spots by race. Select incidents where the person arrested was classified as Hispanic (H). In the menu bar, go to Selection, Select by attribute. Enter the following SQL statement:
Victim_Decent = ‘H’
Now perform a kernel density to visualize the density of Hispanic arrests in Los Angeles. In the search box, enter “kernel” and click on the Kernel Density (Spatial Analyst) tool. Enter the four boxes as shown below:
Add a basemap, and change the symbology to make the visual more powerful:
Repeat the process for other race categories: