Reliable scheduling with Trigger.dev

Trigger.dev is an open source background job platform. With Trigger.dev you can easily create, schedule, and manage background jobs using code.

Read on to learn how to create complex, reliable scheduling with Trigger.dev.

Before you start

Before you start, ensure:

Create your first trigger task

The tinybird-trigger-tasks package implements tasks for Tinybird copy pipes and the Query API. You can find the source code in the @sdairs/tinybird-trigger repo.

  1. Create a working directory, and run npx trigger.dev@latest init to connect the project to Trigger.dev.

  2. Inside the trigger directory, install the npm package with npm install @sdairs/tinybird-trigger-tasks.

  3. Create a new file called myTask.ts and add the following code:

import { task } from "@trigger.dev/sdk/v3";
import { tinybirdCopyTask } from "@sdairs/tinybird-trigger-tasks";

export const exampleExecutor = task({
    id: "example-executor",
    run: async (payload, { ctx }) => {
        console.log("Example executor task is running");

        // Run a copy job
        const copyResult = await tinybirdCopyTask.triggerAndWait({ pipeId: <COPY_PIPE_ID> });
        console.log(copyResult);

    },
});
  1. Create a new pipe using the following SQL:
SELECT number + 1 AS value
FROM numbers(100)

  1. Name the pipe my_copy and deploy the changes.

  2. Update myTask.ts, replacing <COPY_PIPE_ID> with the name of your pipe, my_copy in this case.

  3. Create a .env file in your directory root.

  4. Go to your Tinybird workspace and copy the Admin Token, then add it to the .env file as follows:

TINYBIRD_TOKEN=p.eyJ...

  1. Run npx trigger.dev@latest dev to push the task to Trigger.dev.

  2. Go to your Trigger.dev dashboard, and perform a test run to trigger the task and the copy pipe.

  3. Go to your Tinybird workspace and check the copy pipe results.

See also

Updated