It’s all about PERFORMANCE …. and Cost
We are very excited to announce that the AnyLog Network has been up and running for over 2 months now! This is an opportunity to share some information on the network and discuss performance and cost when data and queries are distributed.
Using the network, companies are able to keep their IoT data in place - at the edge of the network, near the devices that generate the data. AnyLog’s technology replaces the traditional approach where massive amounts of data are transferred to a centralized, cloud-based database. To analyze the performance, we monitored queries that partner companies are issuing against their distributed data and focused on queries that evaluate data generated from devices. An example of such query is, to determine, for a given time interval, the min, max and average of the readings of sensors of a particular type.
In theory, the network should be efficient as the queries are distributed to multiple servers and each server maintains a smaller dataset (than a single dataset in a centralized database). Another advantage of the AnyLog Network is the high degree of parallelism as data owners can increase data distribution and leverage additional CPUs in the query process.
The unknowns were related to networking which depends on the Internet infrastructure. However, these concerns were quickly removed when we started to see and analyze the results. We can now show that with the AnyLog architecture, networking impact is negligent and users can achieve the performance that they need by configuring the degree of distribution.
Below are statistics measuring performance of queries issued by a monitoring application that is using the network for storage and query of data. The application provides real-time graphical view and alerts of different sensors. Queries are issued while new data is being streamed to the servers that host the data.
About 1 million queries have been issued during the last 80 hours. 93% of the queries were satisfied in less than 1 second and 99.8% of the queries were satisfied in less than 2 seconds.
The AnyLog team is very excited with the progress and growth of the network. We are more confident than ever to the scalability of our Network, and we are eager to improve the way companies’ interact with IoT data!
“Queries Statistics”: {
“Up to 1 sec.”: “1,004,658”,
“Up to 2 sec.”: “64,356”,
“Up to 3 sec.”: “1,557”,
“Up to 4 sec.”: “250”,
“Up to 5 sec.”: “46”,
“Up to 6 sec.”: “20”,
“Up to 7 sec.”: “13”,
“Up to 8 sec.”: “25”,
“Up to 9 sec.”: “18”,
“Over 9 sec.”: “6”,
“Total queries”: “1,070,949”,
“Time interval”: “286,281 (sec.): 79:31:21 (H:M:S)”
}
About the cost — the network machines supporting the monitoring application are hosted by a provider of Virtual Machines (VMs) that offers VMs for a fixed price. The overall cost for the storage, the streaming of the data to the machines and computation for the data owners is less than $100 per month.
Compare a fixed $100 monthly cost to a cloud service that maintains a centralized database that is constantly being updated with new data and supports 13,000 queries per hour!
If you are interested with more detailed information or if your company is interested to use the network to manage IoT data, or if your company is interested to leverage the AnyLog Network in their offering:
Please contact us at info[at]anylog.co
