Configurations for Azure

The Xonai Accelerator requires configuring heap and off-heap memory appropriately in order to run as the Xonai engine allocates memory off-heap.

This page contains recommended plugin memory configurations for all recommended Azure Virtual Machines. The configurations are derived from the following table below, which shows the default executor memory configuration based on Worker RAM size.

Important

Xonai plans to remove the need to configure memory in a future release. See upcoming features for more information.

Instance Memory (GiB)

spark.executor.memory

spark.memory.offheap.size (bytes)

16

8874m

0

32

21588m

0

64

11754m

36974886912

128

24468m

76969672704

192

37182m

116964458496

256

49896m

156959244288

384

65536m

247212277760

512

65536m

353865039872

768

65536m

567170564096

Compute optimized

Fsv2 series

F8s v2

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

16.00 GiB

4088m

4786m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4088m
spark.executor.memoryOverhead 4786m

F16s v2

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

32.00 GiB

8176m

13412m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 8176m
spark.executor.memoryOverhead 13412m

F series

F8

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

16.00 GiB

4088m

4786m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4088m
spark.executor.memoryOverhead 4786m

F16

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

32.00 GiB

8176m

13412m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 8176m
spark.executor.memoryOverhead 13412m

Fs series

F8s

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

16.00 GiB

4088m

4786m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4088m
spark.executor.memoryOverhead 4786m

F16s

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

32.00 GiB

8176m

13412m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 8176m
spark.executor.memoryOverhead 13412m

General purpose

Dsv3 series

D4s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

16.00 GiB

2580m

6024m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 2580m
spark.executor.memoryOverhead 6024m

D8s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Dv3 series

D4 v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

16.00 GiB

2580m

6024m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 2580m
spark.executor.memoryOverhead 6024m

D8 v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Dasv4 series

D8as v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Dav4 series

D8a v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Ddsv4 series

D8ds v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Dadsv5 series

D8ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Dasv5 series

D8as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Ddsv5 series

D8ds v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Ddv4 series

D8d v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Dsv5 series

D8s v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

DCasv5 series

DC4as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

16.00 GiB

2580m

6024m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 2580m
spark.executor.memoryOverhead 6024m

DC8as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

Memory optimized

Easv4 series

E4as v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8as v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16as v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32as v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48as v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Easv5 series

E4as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Eadsv5 series

E4ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Esv3 series

E8s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

Ev3 series

E8 v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16 v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32 v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

Eav4 series

E4a v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8a v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16a v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32a v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48a v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Edsv4 series

E4ds v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8ds v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16ds v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32ds v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48ds v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Edsv5 series

E4ds v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8ds v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16ds v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32ds v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48ds v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Edv4 series

E4d v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8d v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16d v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32d v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48d v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Esv4 series

E4s v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8s v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16s v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32s v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48s v4

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Esv5 series

E4s v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

E8s v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

E16s v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

E32s v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

E48s v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

ECasv5 series

EC8as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

EC16as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

EC32as v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

ECadsv5 series

EC8ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

EC16ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

EC32ads v5

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

Storage optimized

Ls series

L4s

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

L8s

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

L16s

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

L32s

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

Lsv2 series

L4s v2

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

4

32.00 GiB

6280m

14657m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 6280m
spark.executor.memoryOverhead 14657m

L8s v2

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

L16s v2

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

L32s v2

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

Lasv3 series

L8as v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

L16as v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

L32as v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

L48as v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m

Lsv3 series

L8s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

8

64.00 GiB

4952m

6802m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 4952m
spark.executor.memoryOverhead 6802m

L16s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

16

128.00 GiB

9904m

14564m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 9904m
spark.executor.memoryOverhead 14564m

L32s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

32

256.00 GiB

19808m

30088m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 19808m
spark.executor.memoryOverhead 30088m

L48s v3

Instance Size

Recommended Configuration

vCPUs

RAM

spark.executor.memory

spark.executor.memoryOverhead

48

384.00 GiB

29712m

35824m
Copy me to Spark config
spark.plugins com.xonai.spark.SQLPlugin
spark.executor.memory 29712m
spark.executor.memoryOverhead 35824m