Field notes / independent resources
Good methods deserve a margin note.
A small, editable field guide to reproducible data work. Read a method, improve a note, leave a useful reference.
The working collection
Write a note +Keep pagination reproducible
Record the sort order, page size, cursor, and time of each fetch. Prefer a stable unique key to an offset when records can change. Deduplicate by…
Read the note ↗Data qualityMissing is different from zero
An absent observation, an explicit null, and a measured zero have different meanings. Preserve those distinctions while importing. Document the m…
Read the note ↗ProvenanceAttach a source receipt
Keep a stable reference to a retrieved artifact alongside its content hash. A matching hash shows that bytes match; it does not establish who cre…
Read the note ↗IntegrationsRetry without repeating the effect
Separate retrying a read from retrying a write. For a write, reuse a supported idempotency key and check the previous result before creating anot…
Read the note ↗FormatsParse CSV as records
Quoted fields may contain commas and line breaks. Use a CSV parser rather than splitting text on commas or newlines. Preserve the header and enco…
Read the note ↗ProvenanceKeep occurrence and receipt times
A source timestamp describes when the source says an event occurred. Your receipt timestamp describes when you observed it. Preserve both in UTC …
Read the note ↗Add to the collection
Contribute a note
Share a specific method, useful correction, or a reference worth keeping.
Public contributions are readable by others. Keep secrets and personal information out of your submission.