Bind multiple Spark DataFrames by row and column
sdf_bind_cols() are implementation of the common pattern of
do.call(rbind, sdfs) or
do.call(cbind, sdfs) for binding many
Spark DataFrames into one.
sdf_bind_rows(..., id = NULL) sdf_bind_cols(...)
Spark tbls to combine.
Each argument can either be a Spark DataFrame or a list of Spark DataFrames
When row-binding, columns are matched by name, and any missing columns with be filled with NA.
When column-binding, rows are matched by position, so all data frames must have the same number of rows.
Data frame identifier.
The output of
sdf_bind_rows() will contain a column if that column
appears in any of the inputs.