Supported SQL Expressions¶

This section documents all Xonai SQL expression support status. Expressions not yet supported will fall back to the original Spark execution engine.

Aggregate Expressions¶

Expression	Parameters	Support
AggregateExpression	aggFunc	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
	filter	Supported boolean
	Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
Average	Input	Supported byte short integer long float double decimal
Average	Output	Supported double decimal
BitAndAgg	Input/Output	Supported byte short integer long
BitOrAgg	Input/Output	Supported byte short integer long
BitXorAgg	Input/Output	Supported byte short integer long
BloomFilterMightContain	Input 1	Supported binary null
	Input 2	Supported long null
	Output	Supported boolean
Corr	Input/Output	Supported double
Count	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
Count	Output	Supported long
CovPopulation	Input/Output	Supported double
CovSample	Input/Output	Supported double
First	Input/Output	Partially Supported supported types boolean byte short integer long float double decimal string date timestamp year month day time unsupported types binary calendar array struct map null
Kurtosis	Input/Output	Supported double
Max	Input/Output	Partially Supported supported types boolean byte short integer long float double decimal date timestamp year month day time unsupported types string binary array struct null
Min	Input/Output	Partially Supported supported types boolean byte short integer long float double decimal date timestamp year month day time unsupported types string binary array struct null
RegrIntercept	Input/Output	Supported double
RegrR2	Input/Output	Supported double
RegrReplacement	Input/Output	Supported double
RegrSXY	Input/Output	Supported double
RegrSlope	Input/Output	Supported double
Skewness	Input/Output	Supported double
StddevPop	Input/Output	Supported double
StddevSamp	Input/Output	Supported double
Sum	Input	Supported byte short integer long float double decimal
Sum	Output	Supported long double decimal
VariancePop	Input/Output	Supported double
VarianceSamp	Input/Output	Supported double
AnyValue	–	available soon
ApproxCountDistinctForIntervals	–	available soon
ApproximatePercentile	–	available soon
BloomFilterAggregate	–	available soon
CollectList	–	available soon
CollectSet	–	available soon
CollectTopK	–	available soon
CountMinSketchAgg	–	available soon
HistogramNumeric	–	available soon
HyperLogLogPlusPlus	–	available soon
Last	–	available soon
MaxBy	–	available soon
MinBy	–	available soon
Mode	–	available soon
PandasCovar	–	available soon
PandasKurtosis	–	available soon
PandasMode	–	available soon
PandasProduct	–	available soon
PandasSkewness	–	available soon
PandasStddev	–	available soon
PandasVariance	–	available soon
Percentile	–	available soon
PercentileDisc	–	available soon
PivotFirst	–	available soon
Product	–	available soon

Alchemy Expressions¶

Expression	Parameters	Support
HyperLogLogCardinality	Input	Supported binary
HyperLogLogCardinality	Output	Supported long
HyperLogLogInitSimpleAgg	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp unsupported types calendar array struct map null
HyperLogLogInitSimpleAgg	Output	Supported binary

Arithmetic Expressions¶

Expression	Parameters	Support
Abs	Input/Output	Supported byte short integer long float double decimal year month day time
Add	Input/Output	Partially Supported supported types byte short integer long float double decimal year month day time unsupported types calendar
Divide	Input/Output	Supported double decimal
IntegralDivide	Input	Supported long decimal
IntegralDivide	Output	Supported long
Multiply	Input/Output	Supported byte short integer long float double decimal
Pmod	Input/Output	Supported byte short integer long float double decimal
Remainder	Input/Output	Supported byte short integer long float double decimal
Subtract	Input/Output	Partially Supported supported types byte short integer long float double decimal year month day time unsupported types calendar
UnaryMinus	Input/Output	Partially Supported supported types byte short integer long float double decimal year month day time unsupported types calendar
UnaryPositive	Input/Output	Partially Supported supported types byte short integer long float double decimal year month day time unsupported types calendar

Array Type Expressions¶

Available soon

Bitmap Expressions¶

Expression	Parameters	Support
BitmapBitPosition	Input/Output	Supported long
BitmapBucketNumber	Input/Output	Supported long
BitmapCount	Input	Supported binary
BitmapCount	Output	Supported long
BitmapConstructAgg	–	available soon
BitmapOrAgg	–	available soon

Bitwise Expressions¶

Expression	Parameters	Support
BitwiseAnd	Input/Output	Supported byte short integer long
BitwiseCount	Input	Supported boolean byte short integer long
BitwiseCount	Output	Supported integer
BitwiseGet	Input 1	Supported byte short integer long
	Input 2	Supported integer
	Output	Supported byte
BitwiseNot	Input/Output	Supported byte short integer long
BitwiseOr	Input/Output	Supported byte short integer long
BitwiseReverse	Input/Output	Supported byte short integer long
BitwiseXor	Input/Output	Supported byte short integer long

Core Expressions¶

Expression	Parameters	Support
Alias	Input/Output	Supported boolean byte short integer long float double decimal string binary date timestamp calendar year month day time array struct map null
AttributeReference	Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp calendar year month day time array of atomic types struct unsupported types array of non atomic types map null
Cast	Input/Output	Partially Supported supported types boolean byte short integer long float double decimal unsupported types string binary date timestamp calendar array struct map null
Literal	Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp calendar year month day time array of atomic types struct unsupported types array of non atomic types map null
ScalarSubquery	Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp array of atomic types struct unsupported types calendar array of non atomic types map null

Collection Expressions¶

Expression	Parameters	Support
Size	Input	Supported array map
Size	Output	Supported integer
ElementAt	–	available soon

Conditional Expressions¶

Expression	Parameters	Support
CaseWhen	when	Supported boolean
	then	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time array of primitive types unsupported types calendar array of non primitive types struct map null
	else	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time array of primitive types unsupported types calendar array of non primitive types struct map null
	Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time array of primitive types unsupported types calendar array of non primitive types struct map null
If	predicate	Supported boolean
	trueValue	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
	falseValue	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
	Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null

Constraint Expressions¶

Expression	Parameters	Support
KnownFloatingPointNormalized	Input/Output	Supported boolean byte short integer long float double decimal string binary date timestamp calendar array struct map null
KnownNotNull	Input/Output	Supported boolean byte short integer long float double decimal string binary date timestamp calendar array struct map null

CSV Expressions¶

Available soon

Datetime Expressions¶

Expression	Parameters	Support
AddMonths	Input 1	Supported date
	Input 2	Supported integer
	Output	Supported date
DateAdd	Input 1	Supported date
	Input 2	Supported byte short integer
	Output	Supported date
DateAddYMInterval	Input 1	Supported date
	Input 2	Supported year month
	Output	Supported date
DateDiff	Input	Supported date
DateDiff	Output	Supported integer
DateFromUnixDate	Input	Supported integer
DateFromUnixDate	Output	Supported date
DateSub	Input 1	Supported date
	Input 2	Supported byte short integer
	Output	Supported date
DayOfMonth	Input	Supported date
DayOfMonth	Output	Supported integer
DayOfWeek	Input	Supported date
DayOfWeek	Output	Supported integer
DayOfYear	Input	Supported date
DayOfYear	Output	Supported integer
LastDay	Input/Output	Supported date
MakeDate	Input	Supported integer
MakeDate	Output	Supported date
MicrosToTimestamp	Input	Supported byte short integer long
MicrosToTimestamp	Output	Supported timestamp
MillisToTimestamp	Input	Supported byte short integer long
MillisToTimestamp	Output	Supported timestamp
Month	Input	Supported date
Month	Output	Supported integer
NextDay	Input 1	Supported date
	Input 2	Supported string
	Output	Supported date
Quarter	Input	Supported date
Quarter	Output	Supported integer
SecondsToTimestamp	Input	Supported byte short integer long float double decimal
SecondsToTimestamp	Output	Supported timestamp
TruncDate	Input 1	Supported date
	Input 2	Supported string
	Output	Supported date
UnixDate	Input	Supported date
UnixDate	Output	Supported integer
UnixMicros	Input	Supported timestamp
UnixMicros	Output	Supported long
UnixMillis	Input	Supported timestamp
UnixMillis	Output	Supported long
UnixSeconds	Input	Supported timestamp
UnixSeconds	Output	Supported long
WeekDay	Input	Supported date
WeekDay	Output	Supported integer
WeekOfYear	Input	Supported date
WeekOfYear	Output	Supported integer
Year	Input	Supported date
Year	Output	Supported integer
YearOfWeek	Input	Supported date
YearOfWeek	Output	Supported integer
CurrentBatchTimestamp	–	available soon
CurrentDate	–	available soon
CurrentTimeZone	–	available soon
CurrentTimestamp	–	available soon
DateAddInterval	–	available soon
DateFormatClass	–	available soon
FromUTCTimestamp	–	available soon
FromUnixTime	–	available soon
Hour	–	available soon
MakeTimestamp	–	available soon
Minute	–	available soon
MonthsBetween	–	available soon
Now	–	available soon
Second	–	available soon
SecondWithFraction	–	available soon
SubtractDates	–	available soon
SubtractTimestamps	–	available soon
TimeAdd	–	available soon
ToUTCTimestamp	–	available soon
ToUnixTimestamp	–	available soon
TruncTimestamp	–	available soon
UnixTimestamp	–	available soon

Decimal Expressions¶

Expression	Parameters	Support
CheckOverflow	Input/Output	Supported decimal
MakeDecimal	Input	Supported long
MakeDecimal	Output	Supported decimal
UnscaledValue	Input	Supported decimal
UnscaledValue	Output	Supported long

Generator Expressions¶

Expression	Parameters	Support
Explode	Input	Partially Supported supported types array unsupported types map
Explode	Output	Supported array
GeneratorOuter	–	available soon
Inline	–	available soon
PosExplode	–	available soon
ReplicateRows	–	available soon
Stack	–	available soon
UserDefinedGenerator	–	available soon

Hash Expressions¶

Expression	Parameters	Support
Crc32	Input	Supported binary
Crc32	Output	Supported long
Md5	Input	Supported binary
Md5	Output	Supported string
Murmur3Hash	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
Murmur3Hash	Output	Supported integer
Sha1	Input	Supported binary
Sha1	Output	Supported string
Sha2	Input 1	Supported binary
	Input 2	Supported integer
	Output	Supported string
XxHash64	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
XxHash64	Output	Supported long
HiveHash	–	available soon

Hll Expressions¶

Available soon

Input File Expressions¶

Available soon

Interval Expressions¶

Expression	Parameters	Support
ExtractIntervalDays	Input	Supported calendar
ExtractIntervalDays	Output	Supported integer
ExtractIntervalHours	Input	Supported calendar
ExtractIntervalHours	Output	Supported byte
ExtractIntervalMinutes	Input	Supported calendar
ExtractIntervalMinutes	Output	Supported byte
ExtractIntervalMonths	Input	Supported calendar
ExtractIntervalMonths	Output	Supported byte
ExtractIntervalSeconds	Input	Supported calendar
ExtractIntervalSeconds	Output	Supported decimal
ExtractIntervalYears	Input	Supported calendar
ExtractIntervalYears	Output	Supported integer
MakeDTInterval	days	Supported integer
	hours	Supported integer
	mins	Supported integer
	secs	Supported decimal
	Output	Supported day time
MakeInterval	years	Supported integer
	months	Supported integer
	weeks	Supported integer
	days	Supported integer
	hours	Supported integer
	mins	Supported integer
	secs	Supported decimal
	Output	Supported calendar
MakeYMInterval	Input	Supported integer
MakeYMInterval	Output	Supported year month
DivideInterval	–	available soon
MultiplyInterval	–	available soon

JSON Expressions¶

Available soon

Lambda Expressions¶

Available soon

Map Type Expressions¶

Available soon

Math Expressions¶

Expression	Parameters	Support
Acos	Input/Output	Supported double
Acosh	Input/Output	Supported double
Asin	Input/Output	Supported double
Asinh	Input/Output	Supported double
Atan	Input/Output	Supported double
Atan2	Input/Output	Supported double
Atanh	Input/Output	Supported double
BRound	Input/Output	Supported byte short integer long float double decimal
Bin	Input	Supported long
Bin	Output	Supported string
Cbrt	Input/Output	Supported double
Ceil	Input	Supported long double decimal
Ceil	Output	Supported long decimal
Cos	Input/Output	Supported double
Cosh	Input/Output	Supported double
Cot	Input/Output	Supported double
Csc	Input/Output	Supported double
EulerNumber	Output	Supported double
Exp	Input/Output	Supported double
Expm1	Input/Output	Supported double
Factorial	Input	Supported integer
Factorial	Output	Supported long
Floor	Input	Supported long double decimal
Floor	Output	Supported long decimal
Hex	Input	Supported long string binary
Hex	Output	Supported string
Hypot	Input/Output	Supported double
Log	Input/Output	Supported double
Log10	Input/Output	Supported double
Log1p	Input/Output	Supported double
Log2	Input/Output	Supported double
Logarithm	Input/Output	Supported double
NormalizeNaNAndZero	Input/Output	Supported float double
Pi	Output	Supported double
Pow	Input/Output	Supported double
Rint	Input/Output	Supported double
Round	Input/Output	Supported byte short integer long float double decimal
RoundCeil	Input 1	Supported decimal
	Input 2	Supported integer
	Output	Supported decimal
RoundFloor	Input 1	Supported decimal
	Input 2	Supported integer
	Output	Supported decimal
Sec	Input/Output	Supported double
ShiftLeft	Input 1	Supported integer long
	Input 2	Supported integer
	Output	Supported integer long
ShiftRight	Input 1	Supported integer long
	Input 2	Supported integer
	Output	Supported integer long
ShiftRightUnsigned	Input 1	Supported integer long
	Input 2	Supported integer
	Output	Supported integer long
Signum	Input/Output	Supported double
Sin	Input/Output	Supported double
Sinh	Input/Output	Supported double
Sqrt	Input/Output	Supported double
Tan	Input/Output	Supported double
Tanh	Input/Output	Supported double
ToDegrees	Input/Output	Supported double
ToRadians	Input/Output	Supported double
Unhex	Input	Supported string
Unhex	Output	Supported binary
WidthBucket	value	Partially Supported supported types double unsupported types year month day time
	minValue	Partially Supported supported types double unsupported types year month day time
	maxValue	Partially Supported supported types double unsupported types year month day time
	numBucket	Supported long
	Output	Supported long
Conv	–	available soon

Miscellaneous Expressions¶

Expression	Parameters	Support
MonotonicallyIncreasingID	Output	Supported long
Rand	Output	Supported double
Randn	Output	Supported double
SparkPartitionID	Output	Supported integer
SparkVersion	Output	Supported string
Uuid	Output	Supported string
PrintToStderr	–	available soon
PythonUDF	–	available soon
RaiseError	–	available soon
ScalaUDF	–	available soon
TypeOf	–	available soon

Null Expressions¶

Expression	Parameters	Support
AtLeastNNonNulls	Input	Supported boolean byte short integer long float double decimal string binary date timestamp calendar array struct map null
AtLeastNNonNulls	Output	Supported boolean
Coalesce	Input/Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
IsNaN	Input	Supported float double
IsNaN	Output	Supported boolean
IsNotNull	Input	Supported boolean byte short integer long float double decimal string binary date timestamp calendar year month day time array struct map null
IsNotNull	Output	Supported boolean
IsNull	Input	Supported boolean byte short integer long float double decimal string binary date timestamp calendar year month day time array struct map null
IsNull	Output	Supported boolean
NaNvl	Input/Output	Supported float double

Ordering Expressions¶

Expression	Parameters	Support
Greatest	Input/Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
Least	Input/Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
SortOrder	Input/Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null

Predicate Expressions¶

Expression	Parameters	Support
And	Input/Output	Supported boolean
EqualNullSafe	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time null unsupported types calendar array struct map
EqualNullSafe	Output	Supported boolean
EqualTo	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
EqualTo	Output	Supported boolean
GreaterThan	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
GreaterThan	Output	Supported boolean
GreaterThanOrEqual	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
GreaterThanOrEqual	Output	Supported boolean
In	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp unsupported types calendar array struct map null
In	Output	Supported boolean
InSet	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp unsupported types calendar array struct map null
InSet	Output	Supported boolean
LessThan	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
LessThan	Output	Supported boolean
LessThanOrEqual	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp year month day time unsupported types calendar array struct map null
LessThanOrEqual	Output	Supported boolean
Not	Input/Output	Supported boolean
Or	Input/Output	Supported boolean

Regex Expressions¶

Expression	Parameters	Support
Like	Input	Supported string
Like	Output	Supported boolean
LikeAll	–	available soon
LikeAny	–	available soon
NotLikeAll	–	available soon
NotLikeAny	–	available soon
RLike	–	available soon
RegExpExtract	–	available soon
RegExpExtractAll	–	available soon
RegExpReplace	–	available soon
StringSplit	–	available soon

String Expressions¶

Expression	Parameters	Support
Ascii	Input	Supported string
Ascii	Output	Supported integer
BinaryPad	str	Supported binary
	len	Supported integer
	pad	Supported binary
	Output	Supported binary
BitLength	Input	Supported string binary
BitLength	Output	Supported integer
Chr	Input	Supported long
Chr	Output	Supported string
Concat	Input/Output	Partially Supported supported types string unsupported types binary array
ConcatWs	sep	Supported string
	strings	Partially Supported supported types string unsupported types array
	Output	Supported string
Contains	Input	Supported string binary
Contains	Output	Supported boolean
EndsWith	Input	Supported string binary
EndsWith	Output	Supported boolean
EphemeralSubstring	str	Supported string
	pos	Supported integer
	len	Supported integer
	Output	Supported string
InitCap	Input/Output	Supported string
Length	Input	Supported string binary
Length	Output	Supported integer
Lower	Input/Output	Supported string
OctetLength	Input	Supported string binary
OctetLength	Output	Supported integer
Reverse	Input/Output	Partially Supported supported types string unsupported types array
SoundEx	Input/Output	Supported string
StartsWith	Input	Supported string binary
StartsWith	Output	Supported boolean
StringInstr	Input	Supported string
StringInstr	Output	Supported integer
StringLPad	str	Supported string
	len	Supported integer
	pad	Supported string
	Output	Supported string
StringLocate	substr	Supported string
	str	Supported string
	pos	Supported integer
	Output	Supported integer
StringRPad	str	Supported string
	len	Supported integer
	pad	Supported string
	Output	Supported string
StringRepeat	str	Supported string
	times	Supported integer
	Output	Supported string
StringSpace	Input	Supported integer
StringSpace	Output	Supported string
StringTranslate	Input/Output	Supported string
StringTrim	Input/Output	Supported string
StringTrimLeft	Input/Output	Supported string
StringTrimRight	Input/Output	Supported string
Substring	str	Partially Supported supported types string unsupported types binary
	pos	Supported integer
	len	Supported integer
	Output	Partially Supported supported types string unsupported types binary
SubstringIndex	str	Supported string
	delim	Supported string
	count	Supported integer
	Output	Supported string
Upper	Input/Output	Supported string
Base64	–	available soon
Decode	–	available soon
Elt	–	available soon
Encode	–	available soon
FindInSet	–	available soon
FormatNumber	–	available soon
FormatString	–	available soon
Levenshtein	–	available soon
Overlay	–	available soon
ParseUrl	–	available soon
Sentences	–	available soon
StringReplace	–	available soon
UnBase64	–	available soon

Struct Type Expressions¶

Expression	Parameters	Support
CreateNamedStruct	Input	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp calendar array of atomic types struct map null unsupported types array of non atomic types
CreateNamedStruct	Output	Supported struct
GetStructField	Input	Supported struct
GetStructField	Output	Partially Supported supported types boolean byte short integer long float double decimal string binary date timestamp array of atomic types struct unsupported types calendar array of non atomic types map null

Window Expressions¶

Available soon

XML Expressions¶

Available soon

Last update: Jun 17, 2025