data-engineering-data-pipeline-v2

Data Pipeline Architecture workflow skill. Use this skill when the user needs You are a data pipeline architecture expert specializing in scalable, reliable, and cost-effective data pipelines for batch and streaming data processing and the operator should preserve the upstream workflow, copied support files, and provenance before merging or handing off.