transform a subset of column(s) in a Spark Dataframe

R/sdf_interface.R

transform_sdf

Description

transform a subset of column(s) in a Spark Dataframe

Usage

transform_sdf(x, cols, fn) 

Arguments

Arguments Description
x An object coercible to a Spark DataFrame
cols Subset of columns to apply transformation to
fn Transformation function taking column name as the 1st parameter, the corresponding org.apache.spark.sql.Column object as the 2nd parameter, and returning a transformed org.apache.spark.sql.Column object