You can schedule the sync cycle for your destination synapses in the entity pipeline. Sync scheduling allows you to control how frequently Syncari fetches data modified from the previous sync cycle. By default, the sync cycle runs every minute. When you schedule different sync schedules, Syncari disconnects them from the default sync cycle and runs them as scheduled.
Sync scheduling allows you to avoid exceeding API rate limits. Having a less frequent schedule reduces the number of requests made to retrieve data from your Synapse.
For more information, see Sync Cycle.
To schedule a sync cycle:
- Open an entity pipeline and create a draft.
Configure the node using either of these options:
Double-click the destination mode.
Select the node and then click Configure Node in the right panel.
- Switch Schedule (Cron format with seconds) to Enabled.
- Set the frequency of minutes, hours, days, or months.
If you want to enter a Cron string instead, click Switch to Cron Scheduler and enter the Cron string.
- Select the Record Processing option.
- Process all changed records—This is the processing option on the default sync cycle. Syncari runs multiple cycles consecutively until it processes all changed records within the delta time range. The delta time range is the difference between when the cycle runs and the timestamp of the last record modified in the previous cycle. This approach can consume multiple API calls. This is mostly useful for cases where you have nightly enabled for your data warehouses and when the schedule is once a day.
Process single batch per cycle—Syncari runs one batch per cycle and processes the next batch at the next scheduled time. This option ensures Syncari makes only one API call every cycle.
- Click Save.