The problem:
When batch upload used in parallel without "blank shot" of upcoming data in some scenarios (massive paralleled batch) may cause duplicated properties.
There are at least two possible solutions:
- Properties deduplication query called with debounce mechanisms (call dedupe after all batches out)
- Somehow apply throttling when batch upload occur for the first batch (this may lead to queues-based solution and will be more complex)
The problem:
When batch upload used in parallel without "blank shot" of upcoming data in some scenarios (massive paralleled batch) may cause duplicated properties.
There are at least two possible solutions: