OpenLayers 4 R is easy to install

require("devtools")

install_github("crazycapivara/openlayers")

And fun to use

require("geojsonio")

ol() %>%
  add_stamen_tiles() %>%
  add_features(us_cities) %>%
  add_drag_and_drop()