foundry_dev_tools.utils.spark module

foundry_dev_tools.utils.spark module#

Helper functions for unified access to Apache Spark.

foundry_dev_tools.utils.spark.get_spark_session()[source]#

Get or create the pyspark session.

Returns:

the pyspark session

Return type:

SparkSession