Batch geocoding street intersections in R - r

Question

I am currently working with data that is formatted like this:
tribble(
~street1, ~street2, ~county, ~state
N BENTON WY, W TEMPLE ST, LOS ANGELES, CA,
11TH PL, BLAINE ST, LOS ANGELES, CA,
W 6TH ST, HOPE ST, LOS ANGELES, CA,
S GRAND AV, W 18TH ST, LOS ANGELES, CA,
BROADWAY, 5TH ST, LOS ANGELES, CA,
)
This corresponds to a dataset containing around 825,000 observations with missing coordinates. These data have only the names of the nearest cross streets, county, and state information (note they not include street numbers). I need to geocode these observations and recover coordinates so that my final data will look something like this:
tribble(
~street1, ~street2, ~county, ~state, ~latitude, ~longitude
N BENTON WY, W TEMPLE ST, LOS ANGELES, CA, XX.XXXX, -YY.YYYY,
11TH PL, BLAINE ST, LOS ANGELES, CA, XX.XXXX, -YY.YYYY,
W 6TH ST, HOPE ST, LOS ANGELES, CA, XX.XXXX, -YY.YYYY,
S GRAND AV, W 18TH ST, LOS ANGELES, CA, XX.XXXX, -YY.YYYY,
BROADWAY, 5TH ST, LOS ANGELES, CA, XX.XXXX, -YY.YYYY,
)
I have already researched a few possible solutions but haven't found a method that will work.
While the Google Maps API (ggmap package) is very good at identifying coordinates from cross streets as inputs, the cost to geocode this many observations (4.00 USD per 1000 queries according to their website) makes that option infeasible.
I've looked through the documentation of other packages such as RDSTK and tidygeocoder but they don't seem to support API queries using two street names as inputs. The Census Geocoder similarly does not have that option, allowing only single address inputs.
Using the OpenStreetMap API through the osmdata package seemed like a promising option after reading this very detailed StackOverflow answer, but attempting to replicate this code with much bigger bounding boxes has produced runtime errors every time.
See for example the following code using Los Angeles county, following the format of user hugh-allan in the above post:
library(sf)
library(tidyverse)
library(osmdata)
tribble(
~point, ~lat, ~lon,
1, 32.75004, -118.951721,
2, 34.823302, -118.951721,
3, 34.823302, -117.646374,
4, 32.75004, -117.646374,
) %>%
st_as_sf(
coords = c('lon', 'lat'),
crs = 4326
) %>%
{. ->> LA_bounds}
st_bbox(LA_bounds) %>%
opq %>%
add_osm_feature(key = 'highway') %>%
osmdata_sf %>%
`[[`('osm_lines') %>%
{. ->> LA_streets}
If anyone knows how to get around this error with OpenStreetMaps or otherwise adjust the syntax of another package to accommodate cross streets and counties as inputs, I would greatly appreciate it.

Answer 1

I don't have the solution for osmdata. However, I did try it on tidygeocoder. If you're looking for batch encoding without requiring an API key, the only free method would be the US Census Bureau in tidygeocoder, but is computationally expensive. To do this, I combine street1 and street2 together with the ampersand sign &. Then combine it with the county and state into a single column called line_address instead of multiple columns:
examples_address <- tibble(line_address= c("N BENTON WY & W TEMPLE ST, LOS ANGELES, CA", "11TH PL & BLAINE ST, LOS ANGELES, CA", "W 6TH ST & HOPE ST, LOS ANGELES, CA", "S GRAND AV & W 18TH ST, LOS ANGELES, CA", "BROADWAY & 5TH ST, LOS ANGELES, CA"))
examples_address1 <- examples_address %>%
tidygeocoder::geocode(address = line_address, method = "census", verbose = TRUE)
examples_address1
The output that I got:
line_address lat long
N BENTON WY & W TEMPLE ST, LOS ANGELES, CA 34.07289 -118.2757
11TH PL & BLAINE ST, LOS ANGELES, CA NA NA
W 6TH ST & HOPE ST, LOS ANGELES, CA 34.04944 -118.2563
S GRAND AV & W 18TH ST, LOS ANGELES, CA 34.03420 -118.2673
BROADWAY & 5TH ST, LOS ANGELES, CA 34.04808 -118.2507
Unfortunately, as you can see above, not all of the rows gave us a lat and long back from the batch query.
We can use method = "argis" inside the function to give us results for all, but for some reasons, the returned lat and long may different. See the last entry:
line_address lat long
N BENTON WY & W TEMPLE ST, LOS ANGELES, CA 34.07290 -118.2757
11TH PL & BLAINE ST, LOS ANGELES, CA 34.04517 -118.2716
W 6TH ST & HOPE ST, LOS ANGELES, CA 34.04946 -118.2564
S GRAND AV & W 18TH ST, LOS ANGELES, CA 34.03417 -118.2673
BROADWAY & 5TH ST, LOS ANGELES, CA 34.01587 -118.4927
arcgis does not support batch query in tidygeocoder.