Upload dbt Cloud Logs to Amazon S3

After running dbt Cloud for testing or production purposes, connect with Amazon S3 to upload your log files.

Upload dbt Cloud Logs to Amazon S3

Solution Overview

Every time you use dbt Cloud, log files are being generated to better track each step of the process that dbt went through, but these files aren't accessible to external platforms. To ensure that you have a long-running history of every time dbt was run, you'll need to store your log files somewhere else in the cloud. If you want to store these logs securely on a service like Amazon S3, you can easily upload the generated log files into S3 with naming conventions that contain Shipyard runtime IDs.

Connects:

dbt Cloud

To

Amazon S3

Used for:

Data Logging

Used by:

Data Engineering

Analytics Engineer

See it in Action

Watch the video below to see how quickly you can get this solution up and running in Shipyard!

Build it Yourself in Under 5 Minutes

It's easy to
Upload dbt Cloud Logs to Amazon S3
using Shipyard. Select the Blueprints you need, fill out a form, and connect everything together.

There's no code for you to touch or infrastructure for you to manage, but you can always incorporate your own code if you would like.

We do all of the heavy lifting so you can focus on building more data solutions for your business.

1

Create a New Fleet
Click on "New Fleet" anywhere in the application and select a Project.

2

Select a Blueprint
Search for
dbt Cloud - Download Logs and Artifacts to Shipyard
and
Amazon S3 - Upload Files from Shipyard
Blueprints and fill out the required fields.

3

Drag and Drop Vessels
Drag and Drop to connect your Vessels together.

4

Set Triggers
Create schedule or webhook Triggers to automate your work.

Explore Similar

Amazon S3

Use Cases

Check out the other ways you can connect
Amazon S3
to your data stack with Shipyard.

Experience how quickly you can build solutions with

dbt Cloud

and

Amazon S3

Talk to Sales

Why Shipyard?

Shipyard gives Data Engineers the tools to quickly launch, monitor, and share resilient data workflows like a 10x engineer. Drive value from your data at record speeds without the headaches.

Deploy Ridiculously Fast

You can get any solution up and running in 5 minutes.

Build Without Limits

With 60+ Low-Code Templates and the ability to run your own scripts, any solution is possible.

Gain Peace of Mind

Always-on monitoring, retries, and alerts help you oversee your data operations performance at a glance.

No DevOps Required

Our cloud-native, serverless platform scales your workflows automatically.

Experience how quickly you can build solutions with Shipyard.

Talk to Sales

Connect with the Modern Data Stack

Ready to get started?

See how quickly you can build workflows with our platform.