Purpose
Instructions on how to install and use ArcMap v10.5 to create age-adjusted, smoothed sub-county estimates, and to interpret the output and results of the tool.
Overview
*** Files needed for exercise: NC_HeartDisease0608.dbf, and North Carolina census tract shapefile: NC_tracts_2010prj.shp
Goals: Consider and use a tool to produce age-adjusted, smoothed sub county estimates. Interpreted the output and results of the tool.
Objectives:
- Gain experience installing the tool and managing the user interface.
- Develop an understanding of the required data inputs.
- Consider and interpret the output.
Problem: You have been provided with individual-level, heart disease, death data for 2006 to 2008, which have been geocoded to the US 2010 Census tract level. Using the Rate Stabilizer Tool (RST), you will generate age-adjusted, smoothed rates. By using the information generated by the RST, you will be able to map tract-level death rates for heart disease for the state of North Carolina.
Obtain a US census API key
1. Go to Census Key Sign up site: https://api.census.gov/data/key_signup.html
Fill all blanks; in a few minutes you should receive an e-mail like this:
Activate your key and you are ready to use the Census API. You will need to use this key after you have downloaded the RST toolbox.
Loading the toolbox
- Download the tool.
- Save the zipped file to your workspace folder.
- Extract zipped file to your workspace folder. This tool has been built using Python and can be added as a toolbox into the ArcGIS Desktop interface.
- Save the zipped file to your workspace folder.
- Add your API key. In your workspace folder RST folder, use notepad to open fetch_data.py
Then, in line 14, paste the API key that you received from the US Census.
Close the fetch_data.py and save your changes.
3. Open a new blank map in ArcMap.
4. Activate the ArcToolbox window by left clicking on the toolbox icon. This tool has been built using Python and can be added as a toolbox into the ArcGIS Desktop interface.
5. Right click on the ArcToolbox icon again in the ArcToolbox window and select Add toolbox.
6. Navigate to the location where you have saved the extracted folder locally on your machine RateStabilizerTool > tbx and click open
7. The RateStabilizingTool toolbox will now appear, expand the toolbox to reveal the Script tools in this toolbox.
Adding your data
1. The RateStabilizerTool TestData folder contains a shapefile: shp. Add this shapefile for some geographical context.
2. Next, add the record-level, heart disease, death data: dbf
Open this table and take a look at the attribute fields:
OID – an automatically generated object identifier.
GEOID10 – the geographic identifier for the US Census tract unit for which you will be calculating a stabilized age-adjusted rate; this is a required field for the tool.
DDR_ID – the unique-identifier for each record.
Yr_Death – the year of the death record.
Age – the age at which the individual represented by the record died; this is also a required field for the tool.
Male – the sex of the decedent, with 1 indicating male and 0 indicating female (to be used in a future version of the tool).
GEOIDCNTY – alternatively, the geographic identifier for the US Census county unit can also be used to calculate a stabilized age-adjusted rate.
Using the tool
Since this tool makes use of the US Decennial Census API to obtain census population data for age adjustment calculation, we offer two options of running this tool depending on your situation.
Option One: You may run the all-in-one RST tool in an open environment (with internet access) – using census population data that has been fetched dynamically via US Decennial Census API.
or
Option Two: You may run the 3-step RST tool in a secure environment – using census population data that has been fetched, downloaded, and saved in a secure location (behind a firewall for example).
1. Let's use Option Two assuming that you want to run the RST in a secure environment. To do this you will need to first run the (Step 1) Fetch Population by Age to File Script tool. Double left click on the icon to open the tool.
2. Let's consider each of the parameters/inputs.
- Output folder: The output folder location for the results. Please single click your desired folder and then click "Add" on the lower right side of the dialog box.
- Year for Standard Population: To adjust for age, a standard population must be selected. The adjusted weight will be generated from the standard population. Select the desired year of the standard age structure for the entire US. We will use 2010.
- State: Select the state for which population data will be used to generate crude rates. Choose North Carolina.
- Year of base population in Research Area: Select the desired year of the chosen state's base population that will be used for calculating crude rates. We will use 2010.
- Geographic Level of Study: Select the desired geographic level of analysis for the population data. We will perform the analysis at the tract level.
Click OK to run the tool, and you should see this:
Once the tool has successfully run, it will generate a data file that can be used to run the tool behind your firewall. In our case, the file will be named: RawData_state37_tract.data.
3. The RST tool can optionally perform spatial Bayesian smoothing when given a neighborhood dictionary. Run the (Step 2 Optional) Build Neighborhood Dictionary Script tool to generate a matrix of adjacency relationships between geographic units. Double left click on the icon to open the tool.
4. Let's consider each of the parameters/inputs for the tool.
- Shapefile for Spatial Bayesian: Select a shapefile containing all the geographic units at the level of study for the state of interest. Add the NC_tract_2010prj.shp shapefile.
- GeoID in shapefile: Index the field name containing each geographic unit's GeoID. Select GEOID10.
- Output folder: The output folder location for the results. Please single click your desired folder and then click "Add" on the lower right side of the dialog box.
Click OK to run the tool. You should see something like this:
After the tool has successfully run, it will generate a new neighborhood_dict.data file. In our case, the file will be named: NC_tract_2010prj_neighborhood_dict.data.
5. Now that we have the population data from the US Census to manage a proper age adjustment tool locally and a neighborhood dictionary for optional spatial smoothing, we can run the (Step 3) Rate Stabilizing with Local Data Script tool. Double left click on the icon to open the tool.
6. Let's consider each of these parameters/inputs for the tool.
Input deidentified point level death data: Select your records table for calculation. The age and GEOID fields are required for the calculation. Please de-identify the point level data before using the tool. Browse to the NC_HeartDisease0608.dbf file.
Output folder: Select the output folder location for the results. Please single click your desired folder and then click "Add" on the lower right side of the dialog box.
Geographic Identification Field: Index the field name containing the GeoID's.
Age field: Index the field name of the patients' age.
Downloaded Raw Data: Point the tool to the folder that you have placed the downloaded Census data (RawData_state37_tract.data). Remember in generating this data you have:
- Selected Year for standard US population 2010. In order to adjust for age, a standard population must be selected. The adjusted weight will be generated from standard population
- Selected the select State of interest: NC or 37.
- Selected the Year of base population 2010 for NC.
- Specified the geographic level of study: Tract
Age Structure: Specify your own age group structure. Enter the lower-bound of each age group. One negative value can be used to control the max age of consideration.For example, for the following group structure:
- Younger than 1 years; 1-5 years; 6-20 years; 21-45 years; 46-60 years, Over 61 years.
- The following numbers should be entered: 0, 1, 6, 21, 46, 61 (one line at a time by pressing the plus).
- For an age group structure: Younger than 5 years; 5-10 years; 10-17 years.
- The following number should be entered: 0, 5, 10, -18.
Number of Years in data: Enter in the total number of years represented by the input death data. Decimals can be used to represent partial years.
- For our example, enter 3.
I'm not analyzing the entire state: Check this if your input data only reflects a portion of the state's geographies rather than the entire state. Why? If we tell the tool that the base population is for the entire state, it will smooth to that population. If the data only comes from select counties, we only want to consider the base population for these counties combined.
- For our example, check this box since we are analyzing data from a select set of counties rather than from every county in North Carolina.
Neighborhood Dictionary for Spatial Bayesian (optional): If you would like to include spatial Bayesian smoothing, select the neighborhood dictionary data file built in Step 2. Otherwise, leave blank.
- Navigate to and select the NC_tract_2010prj_neighborhood_dict.data file.
Here is how your completed test run of the tool should look once you have input the parameters:
Click OK to run the tool.
Let's talk about what is going on while the script is running:
- The tool is using the Census data file you created to calculate population in each age group and the standard age structure.
- The tool is calculating crude rates for each age category you specified. Once these are calculated, age adjusted rates (both smoothed and non-smoothed) are calculated for each age category and standard age structure.
- If there are GeoIDs (census Identifiers in this case) that are missing, or cannot be recognized in census data, you will receive a warning.
- All output file paths can be viewed under the Messages section in the Results window.
Understanding the output
1. Once the tool has completed all processes, 3 tables will be placed in the Output folder you specified. These include:
- Two intermediate tables required for calculations, which can be used for verification:
PopAge_structure_state37.csv: This file includes the population for each geographic unit in the state of interest by age category. You defined these age categories when you set up the tool.
Standard_Age_structure.csv: This file includes the proportion of the population in each age category in the standard year of choice. This age structure was calculated using the population data from the whole United States. The structure works as the weight when calculating the weighted average for age adjusted mortality rate.
- And the table with your results: age_adjust_NC_HeartDisease0608.csv
2. Add the results table to ArcMap and open it up to see what has been produced.
- Age_adjust_rate: the non-smoothed rate per 100,000;
- SpBay_AAR: the spatially smoothed rate per 100,000;
- SpBay_2p5 & SpBay_97p5: the lower and upper boundaries for 95% confidence interval for spatially smoothed age adjusted rate.
- Baye_AAR: the smoothed rate per 100,000;
- Baye_2p5 & Baye_97p5: the lower and upper boundaries for 95% confidence interval for smoothed age adjusted rate.
NSpUnreli: This field will be 0 when non-spatial Bayesian estimate is reliable.
SpUnreli: This field will be 0 when spatial Bayesian estimate is reliable.
Potential Alert Messages: When the width of the confidence interval (Upper limit – Lower limit) is larger than the estimate, the estimate is unreliable. These rates should NOT be mapped.
- Alert:Unreliable non-Spatial Bayesian Estimate!!!! – The empirical Bayesian estimate is not reliable in the region. In this case, NSpUnreli will be 1 and SpUnreli will be 0.
- Alert:Unreliable Spatial Bayesian Estimate!!!! – The spatial Bayesian Estimate is not reliable in the region. In this case, NSpUnreli will be 0 and SpUnreli will be 1.
- Alert:Unreliable Estimate!!!! – Both estimates are not reliable in the region. In this case, both NSpUnreli and SpUnreli will be 1.