Recovering from a failed sync due to broken or stale streams

When a sync fails because of a broken or stale stream, follow these steps based on your table engine:

For ReplacingMergeTree tables:

  1. In the Propel console, click the “Re-sync” button.
  2. This action will:
    • Recreate the stream
    • Re-ingest the data
    • Deduplicate the data

For MergeTree tables:

  1. Ensure change tracking is enabled on the Snowflake table.
  2. Create a new Data Pool with identical configuration settings.
  3. Allow the initial sync to complete.
  4. Transfer metrics from the old Data Pool to the new one.
  5. Remove the old Data Pool.

By following these steps, you’ll ensure your data remains synchronized and accessible in Propel.