Activate on All-Purpose Compute

You can activate the Xonai Accelerator on all-purpose compute clusters after you have installed Xonai in a Unity Catalog volume.

The first step is to define the Xonai init script you created:

  1. Navigate to Compute > All-purpose compute from the left navigation panel.

  2. Edit an existing compute or create a new compute in Create compute top right corner.

  3. Uncheck Use Photon Acceleration in Performance panel.

  4. Click Advanced options to expand the section and then click Init Scripts tab.

  5. Select Volume as Source and then select the Xonai init script you created.

On completion it should look like this:

../_images/dbx-xonai-init-script.png

Note

If you installed Xonai on DBFS, select the xonai-init.sh from the Workspace path instead.

The second step is to define the required configuration for your Spark jobs. In the same Advanced options section, click Spark tab and copy the following code to Spark config.

Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin

On completion it should look like this:

../_images/dbx-xonai-spark-conf.png

Your cluster is now configured to run the Xonai Accelerator in your Spark jobs.