From now on, Fastly will be using Microsoft Azure Data Explorer for the purposes of analysing high-volume data.
Reportedly, Fastly, a cloud platform provider, processes 10% of requests from the entire internet. With the help of Microsoft Azure Data Explorer (ADX – formerly known as project “Kusto”), they’ll be able to tap into a valuable source of real-time data. So, what does that mean in practice?
Despite the fact that ADX is not a streaming platform, it’s quite capable of working with fast data. With ADX, you can easily visualise and query its data by using KQL statements, which stands for Kusto Query Language. If you’re unfamiliar with them, the simplest way to describe this is trying to visualise an ordinary SQL statement – both work in a similar fashion.
According to Microsoft, ADX can query billions of records in a matter of seconds. Due to these capabilities, Fastly has all the needed processing power to allow customers like Taboola to analyse their data, practically in real-time. As of right now, the historical range is limited to seven days, but soon, this will be extended to 30.
You can read more about the new partnership both in Microsoft’s and Fastly’s respective blog posts, but to sum it all up, ADX can be scaled automatically, it can be provisioned on-demand, and since its query language is easy to comprehend, it has a rather low learning curve. Since the data lives in the cloud and you can query it with open-source technologies like Spark and Hadoop, what’s not to like?