Sep 03, 2019

Improved Support for Replacing or Appending Data

One of the foundational ideas of Tinybird Analytics is resiliency and consistency under high frequency or big data updates.
Javier Álvarez Medina
Co-founder

One of the foundational ideas of Tinybird Analytics is resiliency and consistency under high frequency or big data updates. We understand data as something that evolves and changes over time, therefore our product must treat data like that: as something that is alive.

Whenever you build a data pipe in Tinybird Analytics, your transformation nodes will always remain connected to the Data Sources they use. As soon as those Data Sources change, all their related transformation nodes will be recalculated in real-time. No delays.

Also, we’ve taken care of implementing everything needed to ensure your APIs keep performing in real-time as new data gets ingested. You will not need to worry about how and when you should be updating your data.

Although our API already supported appending data to an existing Data Source or replacing it entirely, during the last week we’ve added support for both replacing and appending data in our User Interface.

Append or replace data to an existing Data Source
Append or replace data to an existing Data Source

As you can see in the gif above, whenever Tinybird Analytics detects you are trying to import a Data Source with a name that already exists in your account, the advanced data import options are shown.

In case you need to append data to an existing Data Source directly, we’ve enabled a shortcut to do exactly that; you can find it in the Data Source modal window, as you can see in the image below.

Append data to a Data Source
Append data to a Data Source

Take a look at our documentation and let us know what you think, or sign up for early access to Tinybird (we’re gradually opening up early access to companies and developers).

Do you like this post?

Related posts

A new way to create intermediate Data Sources in Tinybird

Tinybird

Team

Jun 15, 2023
Iterate your real-time data pipelines with Git
A new dashboard for Tinybird Analytics
Simplifying event sourcing with scheduled data snapshots in Tinybird
Iterating terabyte-sized ClickHouse tables in production
Selective data deletion: a new feature for data quality management
More Data, More Apps: Improving data ingestion in Tinybird
A practical guide to real-time CDC with MongoDB
Tinybird connects with Confluent for real-time streaming analytics at scale

Tinybird

Team

Jul 18, 2023
Tinybird is out of beta and open to everyone

Build fast data products, faster.

Try Tinybird and bring your data sources together and enable engineers to build with data in minutes. No credit card required, free to get started.
Need more? Contact sales for Enterprise support.