Open-Source Spark

Prerequisites

FuseCore is compatible with the Apache Spark open-source versions listed in the following table:

Spark Version

Support

4.2.x

4.1.x

4.0.0 - 4.0.4

3.5.0 - 3.5.9

3.4.0 - 3.4.4

3.3.0 - 3.3.4

3.2.0 - 3.2.4

3.1.1 - 3.1.3

Activation via spark-submit

FuseCore can be activated on a per-application basis via Spark configuration by adding the following properties:

--jars <scheme>://<path>/xonai-fusecore_<scala>-<release>-oss-<runtime>-linux.jar
--conf spark.plugins=com.xonai.spark.SQLPlugin

As an example, running FuseCore with SparkPI program would be:

spark-submit \
  --class org.apache.spark.examples.SparkPi \
  --jars <scheme>://<path>/xonai-fusecore_<scala>-<release>-oss-<runtime>-linux.jar \
  --conf spark.plugins=com.xonai.spark.SQLPlugin \
  $SPARK_HOME/examples/jars/spark-examples.jar 1000

Info

If you are defining explicit offheap or overhead memory, you may need to reconfigure property values depending on which FuseCore Memory Modes is active.


Last update: Aug 17, 2026