checkpoint_directory

Set/Get Spark checkpoint directory

Description

Set/Get Spark checkpoint directory

Usage

spark_set_checkpoint_dir(sc, dir)

spark_get_checkpoint_dir(sc)

Arguments

Argument Description
sc A spark_connection.
dir checkpoint directory, must be HDFS path of running on cluster