Offload Modes¶

Operations not supported by the Xonai engine are executed by the default Spark Catalyst engine which can lead to data conversion between the two. In order to avoid potential performance regressions, the Xonai plugin can use one of three offload modes:

• stage - entire stages are offloaded if completely supported

• partial - contiguous supported operators at the start and end of stages are offloaded

• all - all supported operators are offloaded

The offload mode can be configured using spark.xonai.sql.offload.mode and it defaults to stage which is the most conservative strategy.