Today we are excited to share that a new release of sparklyr is available on CRAN! This 0.9 release enables you to:
- Create Spark structured streams to process real time data from many data sources using dplyr, SQL, pipelines, and arbitrary R code.
- Monitor connection progress with upcoming RStudio Preview 1.2 features and support for properly interrupting Spark jobs from R.
- Use Kubernetes clusters with sparklyr to simplify deployment and maintenance.
The full blog post is available in the RStudio Blog site: https://blog.rstudio.com/2018/10/01/sparklyr-0-9/