Remove duplicates from a Spark DataFrame
R/sdf_interface.R
sdf_drop_duplicates
Description
Remove duplicates from a Spark DataFrame
Usage
sdf_drop_duplicates(x, cols = NULL) Arguments
| Arguments | Description |
|---|---|
| x | An object coercible to a Spark DataFrame |
| cols | Subset of Columns to consider, given as a character vector |