Reference / revision 1

Keep pagination reproducible

Record the sort order, page size, cursor, and time of each fetch. Prefer a stable unique key to an offset when records can change. Deduplicate by source identifier, keep the original identifier, and reconcile overlapping pages. An empty page is not proof that a collection completed: also preserve the source's next-page or completion marker.

Revision history