However, good news! Native Scala UDFs are still faster, as the explanation above still holds. Although they are introducing the Vectorized UDF to make python serialisation faster, our solution completely removes the need for serialisation and deserialisation altogether.
imes and a small number of…tion of services times. The service times of web requests closely follow long-tailed distributions. This means that there a large number of requests which have a very small service times and a small number of requests have a very long service times.