potential place for data re-upload for faster access from the package?

[e-kotov]

0$ Data Distribution
In this article, Julien explores the "0$ Data Distribution" using Apache Iceberg and DuckDB, leveraging Cloudflare R2 buckets as they don’t charge for egress (data going out, meaning access by users). He demonstrates how, once uploaded to R2, you can freely read the data with ATTACH 'https://catalog.boringdata.io/catalog' as boringdata; Julien discusses the potential applications of this approach, such as direct data integration from services like Stripe, LinkedIn, and Notion, using a single command. With the key innovation where data providers pay for storage, and consumers pay only for compute.

from DuckDB Monthly Issue 25

[e-kotov]

Exposing data stored on R2 only costs the storage price: $0.015 per GB/month.

So for all 3 years of v2 OD district level data that would be about ~ 2.25 USD per month.

Just something to consider in future or to suggest upstream.

[Robinlovelace]

👍