Fetch every page of an API into a table
Starts with: Schedule — every morning
Walks a paged API to the last page and stores every item as a row.
- Start
- Fetch every page
- Each item
- Store the item
What it needs
- The address of the API, and the name of the field its list is in
- A table called “API items” with the text columns external_id and data