Set/Get Spark checkpoint directory

R/spark_utils.R

checkpoint_directory

Description

Set/Get Spark checkpoint directory

Usage

spark_set_checkpoint_dir(sc, dir) 

spark_get_checkpoint_dir(sc) 

Arguments

Arguments Description
sc A spark_connection.
dir checkpoint directory, must be HDFS path of running on cluster