1. UrbanFootprint Module 3: Base Data Preparation and Updating Materials prepared with funding support from the California Governor’s Office of Planning and Research, and the California Strategic Growth Council, and are copyright 2015 by the California Strategic Growth Council This Material is Licensed as: Creative Commons Attribution-ShareAlike 4.0. UrbanFootprint has been developed by and is copyrighted by Calthorpe Analytics

2. Goals Describe the required fields for base data Walk through the steps used for SACOG’s base data preparation. Work through an example of preparing data for a county.

3. Base Data Schema: SACOG The structure and field names are critical. There is a base land use table, and many supporting tables Which will be uploaded to PostGIS For convenience the discussion of fields in the base land use table will be divided into groups – Metadata and Geography – Paint Configuration – Parcel Areas/Types – Residential/Housing – Employment – Building Square footage – Outdoor Irrigated Area

4. Fields: Metadata and Geography Field NameDescription idUF unique id geography_idoriginal geometry id (from SACOG) wkb_geometryPostGreSQL geometry field (will not be visible in ArcGIS) region_lu_codeSACOG land use code built_form_keyidentifier (name of) for building type or place type key createddate of data creation/import into UF system updateddate of data change or modifiction within UF system

5. Fields: Paint Configuration Field NameDescription dev_pct development percent - proportion of geography receiving building type or place type application density_pct density percent - proportional intensity of building type or place type application gross_net_pct gross-to-net percent - proportion of developed acreage that receives building type or place type application clear_base_flag bullion field to indicate clearance of development program (removal of all base year dwelling units and employees) redevelopment_flagbullion field to indicate/track redevelopment on geography dirty_flagused internally by UF during paint application These fields are not used in the base features dataset, but are included to maintain an identical structure to the End State data.

6. Fields: Parcel Area/Type Field NameDescription intersection_density_sqmi density of walkable street intersections in the geography (calculated as a weighted square mile density) acres_grossgross/total acreage of the geography acres_parcelgross/total acreage of the parcel(s) sqft_parcelparcel square footage acres_parcel_resresidential acreage of the parcel acres_parcel_res_detsf_slacreage of parcel with single family small lot detached homes (<5500sf) acres_parcel_res_detsf_llacreage of parcel with single family large lot detached homes (>5500sf) acres_parcel_res_attsfacreage of parcel with single family attached homes/townhomes acres_parcel_res_mfacreage of parcel with multifamily housing acres_parcel_empacreage of parcel with employment acres_parcel_emp_offacreage of parcel with office employment acres_parcel_emp_retacreage of parcel with retail employment acres_parcel_emp_indacreage of parcel with industrial employment acres_parcel_emp_agacreage of parcel with agricultural employment acres_parcel_emp_mixedacreage of parcel with mixed employment uses acres_parcel_emp_militaryacreage of parcel with military employment acres_parcel_mixedacreage of parcel with mixed use (residential and employment) acres_parcel_mixed_w_off acreage of mixed use parcels with residential and employment (includes office employment) acres_parcel_mixed_no_off acreage of mixed use parcels with residential and employment (no office employment acres_parcel_no_useacreage of parcel with no use

7. Fields: Residential/Housing Field NameDescription hhhouseholds dudwelling units du_detsfdetached single family dwelling units du_detsf_sldetached single family small lot dwelling units du_detsf_lldetached single family large lot dwelling units du_attsfattached single family dwelling units du_mfmultifamily dwelling units du_mf2to4units in multifamily buildings with 2 to 4 dwelling units du_mf5punits in multifamily buildings with 5 or more dwelling units

8. Fields: Employment Field NameDescription empnumber of employees emp_retnumber of retail employees emp_retail_servicesnumber of retail services employees emp_restaurant number of restaurant employees emp_accommodationnumber of accommodation employees emp_arts_entertainmentnumber of arts and entertainment employees emp_other_servicesnumber of other services employees emp_offnumber of office employees emp_office_servicesnumber of office services employees emp_public_adminnumber of public administration employees emp_educationnumber of education employees emp_medical_servicesnumber of medical services employees emp_indnumber of industrial employees emp_manufacturingnumber of manufacturing employees emp_wholesalenumber of wholesale employees emp_transport_warehousingnumber of transportation and warehousing employees emp_utilitiesnumber of utilities employees emp_constructionnumber of construction employees emp_agnumber of agricultural/extration employees emp_agriculturenumber of agricultural employees emp_extractionnumber of extraction employees emp_militarynumber of military employees

9. Fields: Building Square Footage Field NameDescription bldg_sqft_detsf_slbuilding square footage of detached single family small lot homes bldg_sqft_detsf_llbuilding square footage of detached single family large lot homes bldg_sqft_attsfbuilding square footage of attached single family homes/townhomes bldg_sqft_mfbuilding square footage of multifamily units bldg_sqft_retail_servicesbuilding square footage of retail services bldg_sqft_restaurantbuilding square footage of restaurants bldg_sqft_accommodationbuilding square footage of accommodation bldg_sqft_arts_entertainmentbuilding square footage of arts and entertainment bldg_sqft_other_servicesbuilding square footage of other services bldg_sqft_office_servicesbuilding square footage of office services bldg_sqft_public_adminbuilding square footage of public administration bldg_sqft_educationbuilding square footage of education bldg_sqft_medical_servicesbuilding square footage of medical services bldg_sqft_transport_warehousingbuilding square footage of transportation and warehousing bldg_sqft_wholesalebuilding square footage of wholesale

10. Fields: Outdoor Irrigated Area Field NameDescription residential_irrigated_sqftresidential outdoor irrigated square feet commercial_irrigated_sqftcommercial outdoor irrigated square feet

11. PROCESSING STEPS

12. Input Data SACOG parcel data – SACOG Land Use – Dwelling Units SACOG TAZ Census 2010 Blockgroups Census 2010 Tracts

13. Data Preparation: Topology Parcels must not overlap Clip the dataset to the county border Remove roads and waterbodies

14. Dwelling Units Total DU = SACOG Parcel DU Controlled to TAZ totals Assign DU type using crosswalk (right), and assign DU totals to du_detsf Du_detsf_sl and du_detsf_ll based on sf/du calculation. ACS rates for Attached SF, MF 2-4, and MF 5 plus are applied to all parcels with MF units TAZ SACOG Use CodeDwelling Unit Type Rural ResidentialSingle Family Farm HomeSingle Family Very Low Density Res. Single Family Low Density Res.Single Family Large Lot Not Farm Home Single Family Medium Density Res. Multifamily Medium-High Density Res. Multifamily High Density ResMultifamily Urban ResidentialMultifamily

15. Households HH from SACOG 2008 DU from Parcel Data Occupancy rate = HH/DU

16. Population Calculate Average HH by block group from census data Ave. HH size = pop/hh Then multiply the HH count in each parcel by the Ave. HH size.

17. Employment Parcel employment from SACOG 2008 Crosswalk using the table Use LEHD to disaggregate where needed. (next page) Accommodation extracted using SACOG Employment Inventory Retail emp_retail_services44‐45: Retail Trade emp_restaurant 72*: Food Services (does not include accommodation jobs) emp_accommodation and Boarding Houses 7211‐7213: Traveler Accommodation, RV Parks, Rooming emp_entrec 71: Arts, Entertainment and recreation emp_other_services81: Other Services Office emp_office_services 51‐56: Information, FIRE, Professional, Management/Admin emp_education61: Education Services emp_medical_services 62: Health Care and Social Assistance emp_public_admin92: Public Administration Industrial emp_manufacturing31‐33: Manufacturing emp_transport_warehousing 48‐49: Transportation and Warehousing emp_utilities22: Utilities emp_wholesale42: Wholesale Trade emp_construction23: Construction Agricultural emp_agriculture 11: Agriculture, Forestry, Fishing and Hunting emp_extract21: Mining Military emp_military 9281: National Security and International Affairs SACOG Category UrbanFootprint Employment Category EmpGovEmp_Public_admin EmpOfcEmp_Office_services EmpMedEmp_Medical_services EmpEduEmp_Education EmpRetEmp_Retail_services EmpFoodEmp_Restaurant EmpSvc Emp_Entrec, Emp_Othe_services, Emp_Accomodation EmpInd Emp_Utilities, Emp_Transware, Emp_Warehouse, Emp_Wholesale, Emp_Construction, Emp_Manufacturing, Emp_Agriculture, Emp_Extract EmpOthEmp_military

18. Employment Source and Processing UF Employment Sub Category Method For Spatially Deriving Field at Parcel SACSIM Category Emp_PublicDirect Crosswalk from SACSIM CategoryEmpGov Emp_OfficeDirect Crosswalk from SACSIM CategoryEmpOfc Emp_MedssDirect Crosswalk from SACSIM CategoryEmpMed Emp_EducDirect Crosswalk from SACSIM CategoryEmpEdu Emp_RetailDirect Crosswalk from SACSIM CategoryEmpRet Emp_RestaurantDirect Crosswalk from SACSIM CategoryEmpFood Emp_EntrecLEHD 2010 Near Imputed Rate (Block)EmpSvc Emp_OtherLEHD 2010 Near Imputed Rate (Block)EmpSvc Emp_AccommodationSACOG Employment InventoryEmpSvc Emp_TranswareLEHD 2010 Near Imputed Rate (Block)EmpInd Emp_WarehouseLEHD 2010 Near Imputed Rate (Block)EmpInd Emp_WholeLEHD 2010 Near Imputed Rate (Block)EmpInd Emp_ConstrLEHD 2010 Near Imputed Rate (Block)EmpInd Emp_ManufLEHD 2010 Near Imputed Rate (Block)EmpInd Emp_AgricultureLEHD 2010 Near Imputed Rate (Block)EmpInd Emp_ExtractLEHD 2010 Near Imputed Rate (Block)EmpInd Emp_AFDirect Crosswalk from SACSIM CategoryEmpOth

19. Disaggregation Dataset 1 (higher accuracy): 95 employees Dataset 2: 50 retail, 30 service, and 20 industrial employees. Concerns: Zeros and Nulls Total Emp Ret. %Ser. %Ind. %# Ret.# Ser.# Ind 9550302047.528.519

20. Disaggregation This technique is used several times. Calculate the proportion of each SACOG category that goes into each UF Employment Category. Use the LEHD 2010 near imputed rate dataset. i.e. %emp_entrec = 100*emp_entrec/ (emp_entrec+emp_other_services+emp_accom odation)

21. Building Square Footage Assessor’s Data Assumed FAR Commercial Data Sources

22. Irrigated square footage Averages by Place Type Estimates from other data sources (Remote sensing)

23. Alternate Method: SANDAG Base Schema – Expanded compared to SACOG – Includes HH income – Population Educational Attainment Data Sources – 2012 parcels, have DU and land use – 2012 EDD employment points with 2-4 digit NAICS codes – MGRA with Pop (by gender and age), and Households by income category – ACS Data (5 year block group and 1 year PUMS)

24. Loading Base Data into UrbanFootprint Load into a staging database (PostGIS) Upload via ftp (see installation instructions) Build into UrbanFootprint (see installation instructions)

25. Keep the Goal in Mind Data for your region will be unique This process should serve as a starting point for developing your data, not a fixed recipe.

26. Exercise Download XXXX And unzip it into a folder. Inside the folder here will be a mxd and folders with data and scripts We’re going to step through the scripts.

27. For more information: http://urbanfootprintcurriculum.readthedocs.org/en/ latest/datapreparation.html