General skillSoftware development

ingestion-pipeline-architect

Design resilient data ingestion and ETL with quality and lineage gates

Stars
0
Forks
0
License
MIT
Updated
Updated Jun 23, 2026

Checking live repository facts…

Project overview

This skill designs source-to-warehouse data ingestion with contracts, idempotency, duplicate protection, schema-drift checks, data-quality gates, lineage, backfills, freshness monitoring, and runbooks. It covers ETL, ELT, and CDC through ordered phases and blocks unsafe progression when a dependency or validation fails. The result is a recoverable workflow with clearer failure handling rather than a brittle one-off load.

Repository facts

Primary language
Python
License
MIT
Repository updated
Jun 23, 2026
Default branch
main

Resource types

General skill

Use cases

Software development

Platforms

Claude Code, Codex, and more

Capabilities

ObservabilityVerification and evals

Related projects

Browse more similar projects