Runtime configuration interface for the Spark Session

Retrieves or sets runtime configuration entries for the Spark Session

spark_session_config(sc, config = TRUE, value = NULL)

Arguments

sc

A spark_connection.

config

The configuration entry name(s) (e.g., "spark.sql.shuffle.partitions"). Defaults to NULL to retrieve all configuration entries.

value

The configuration value to be set. Defaults to NULL to retrieve configuration entries.