ml_corr
Compute correlation matrix
Description
Compute correlation matrix
Usage
ml_corr(x, columns = NULL, method = c("pearson", "spearman"))Arguments
| Argument | Description |
|---|---|
| x | A tbl_spark. |
| columns | The names of the columns to calculate correlations of. If only one column is specified, it must be a vector column (for example, assembled using ft_vector_assember()). |
| method | The method to use, either "pearson" or "spearman". |
Value
A correlation matrix organized as a data frame.
Examples
sc <- spark_connect(master = "local")
iris_tbl <- sdf_copy_to(sc, iris, name = "iris_tbl", overwrite = TRUE)
features <- c("Petal_Width", "Petal_Length", "Sepal_Length", "Sepal_Width")
ml_corr(iris_tbl, columns = features, method = "pearson")