This is a companion discussion topic for the original entry at https://www.rstudio.com/blog/sparklyr-1-0
With much excitement built over the past three years, we are thrilled to share that sparklyr 1.0 is now available on CRAN!
The sparklyr package provides an R interface to Apache Spark. It supports dplyr, MLlib, streaming, extensions and many other features; however, this particular release enables the following new features:
Arrow enables faster and larger data transfers between Spark and R. XGBoost enables training gradient boosting models over distributed datasets.