Fast cbind for Spark DataFrames
R/sdf_utils.R
sdf_fast_bind_cols
Description
This is a version of sdf_bind_cols
that works by zipping RDDs. From the API docs: “Assumes that the two RDDs have the same number of partitions and the same number of elements in each partition (e.g. one was made through a map on the other).”
Usage
sdf_fast_bind_cols(...)
Arguments
Arguments | Description |
---|---|
… | Spark DataFrames to cbind |