Skip to main content
Ryan Orban

Ryan Orban

Subject
2 entries

Batch Processing

Bookmarks

  1. Gazette Core: Unified SQL, Batch, and Stream Processing

    Gazette is an open-source platform for building data pipelines that mix SQL, batch, and stream processing in a unified model backed by journals (append-only logs). Designed for organizations that want Kafka-like durability with flexible processing paradigms without committing to a full streaming architecture.

  2. How Affirm Uses AWS Fargate and Apache Airflow for Batch Jobs

    Affirm's engineering blog post on running Apache Airflow DAGs on AWS Fargate for batch job management — serverless task execution without persistent workers. A practical architecture case study for ML and data pipeline orchestration at a fintech scale.

All bookmarks