🕑Estimated time for completion
This section takes about 30 minutes to complete.
Exercise: Bronze
When creating long-term storage for analytical use cases, the first step is to ingest data for the source, with a shape as close as possible to the original shape. As the first step in our data processing journey, this allows us to
- create a "checkpoint" or "save zone" so that we can more easily debug issues and determine if there were issues at this step or downstream
- replay data to downstream steps in the case that there is an error or interruption (data is idempotent)
Follow the instructions here to get started!