- Manually notify Confidence. Each table has a timestamp that indicates until when the system has delivered data. You can update this timestamp manually through the Confidence API. Use this option if you already have a system for keeping track of data delivery.
- Data is delivered continuously. If you continuously write new data to your tables, such as new events whenever they happen, Confidence divides the data into smaller time windows. The commit delay parameter determines how long the system must not write new data to a window before Confidence commits the window. Upon committing the window, Confidence updates the timestamp that indicates until when the system has delivered data.
- Data is partitioned hourly or daily. If you already partition your data, Confidence automatically detects when a new partition exists. Confidence considers a partition ready as soon as it detects that there is data in the partition.
Confidence assumes that you write hourly partitions to even hours in UTC time zone, and that you
write daily partitions at midnight in UTC.