Aug 08, 2019

Our focus on Speed

There is no good way to uncover new insights underlying terabytes of data unless you make the process of working with it tremendously rewarding and fast.
Javier Álvarez Medina
Co-founder

Speed lets you do stuff faster, but also creates a marvelous feeling of progress. The faster you are able to iterate, the less friction in testing or doing new things. It lowers the cost of experimentation and softens the learning curve, which – very often – leads to better results and a more motivated team.

The opposite applies as well: if getting results at something is going to take lots of time, you will be less motivated to do it, so you will probably never do it.

The same happens with data. With more and better data, the possibilities of getting new and better insights grow dramatically, but as the data grows, so does the complexity of working with it. So, isn’t working faster a great way of understanding – and removing – complexity?

Google – famously – defined speed as a feature. They realized that if search was fast, we were more likely to search. The reason is that it encourages you to try stuff, get feedback, and try again. When a thought occurs to you, you know Google is already there. There is no delay between thought and action. The projected cost of googling something is zero. It comes to feel like an extension of your own mind.

...whenever a new idea pop-ups in your mind, you should be able to give it a try in seconds, at a zero projected cost.

Going back to your data, whenever a new idea pop-ups in your mind, you should be able to give it a try in seconds, at a zero projected cost. There is no good way to uncover all those new insights underlying terabytes of data unless you make the process of working with it tremendously rewarding and fast.

And that’s why for us at Tinybird, speed is the feature. Below, you will find some examples of basic analytical operations using our Query API, which take less than 200ms for over 130M records in our basic setup, using the NYC taxi data, so you can see for yourself that speed is paramount at Tinybird.

Quick data aggregations

Calculating the average value of a numeric value with no optimizations over 134MM.

or calculating a histogram of that same numeric value:

Filtering data

Filtering the same 100MM rows data source by a string* column.

*The store_and_fwd_flag indicates whether the trip record was held in vehicle memory before sending to the vendor.

Joining data

Joining two different data sources is also pretty fast.

As you can see, we take very seriously accelerating analytics over millions and billions of rows. If you have any big dataset around, let us know!

Do you like this post?

Related posts

Real-time Data Visualization: How to build faster dashboards
A new way to create intermediate Data Sources in Tinybird
Tinybird
Team
Jun 15, 2023
Export data from Tinybird to Amazon S3 with the S3 Sink
Tinybird
Team
Mar 21, 2024
Tinybird: A ksqlDB alternative when stateful stream processing isn't enough
To the limits of SQL... and beyond
Automating data workflows with plaintext files and Git
Chatting GraphQL with Jamie Barton of Grafbase
Tinybird
Team
Apr 24, 2023
What it takes to build a real-time recommendation system
We launched an open source ClickHouse Knowledge Base
Tinybird
Team
Oct 11, 2022
The definition of real-time data

Build fast data products, faster.

Try Tinybird and bring your data sources together and enable engineers to build with data in minutes. No credit card required, free to get started.
Need more? Contact sales for Enterprise support.