Remove duplicates from a Spark DataFrame

Remove duplicates from a Spark DataFrame

sdf_drop_duplicates(x, cols = NULL)

Arguments

x

An object coercible to a Spark DataFrame

cols

Subset of Columns to consider, given as a character vector