Skip to main content
Version: 2.0
🕑Estimated time for completion

This section takes about 30 minutes to complete.

Exercise: Bronze

When creating long-term storage for analytical use cases, the first step is to ingest data for the source, with a shape as close as possible to the original shape. As the first step in our data processing journey, this allows us to

  1. create a "checkpoint" or "save zone" so that we can more easily debug issues and determine if there were issues at this step or downstream
  2. replay data to downstream steps in the case that there is an error or interruption (data is idempotent)

Follow the instructions here to get started!