A collection of AI skills for working with Dagster
-
Updated
Sep 29, 2026 - Python
#
data-orchestration
Here are 49 public repositories matching this topic...
A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for cloud data warehouse and Metabase to serve the needs of data visualizations such as analytical dashboards.
python docker airflow sql database s3 s3-bucket data-visualization python3 data-warehouse metabase data-engineering data-analytics data-analysis redshift data-processing data-cleaning data-warehousing data-orchestration
-
Updated
Apr 18, 2020 - Python
Stop trusting your pipeline. Verify it; visually on a canvas or in Python. Self-hosted platform + library. Now, you can be able use it in Databricks and MLFlow with bundle option.
react platform machine-learning deep-learning docker-compose databricks model-deployment mlops mlflow ml-pipeline model-registry experiment-tracking data-orchestration feature-engineering-python
-
Updated
Sep 30, 2026 - Python
Data-aware orchestration with dagster, dbt, and airbyte
-
Updated
Jan 20, 2023 - Python
A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran
-
Updated
Sep 23, 2026 - Python
Get started with Dagster ASAP
-
Updated
Apr 1, 2025 - Python
Goldener - Make your data even more valuable
optimization embeddings artificial-intelligence data-orchestration data-centric-ai foundation-models
-
Updated
Sep 23, 2026 - Python
A simple pipeline infrastructure with ETL pipeline contained in a Docker environment on Apache Airflow for orchestration and Postgres for data warehousing
python docker postgres airflow sql database etl data-engineering data-warehousing etl-pipeline data-orchestration
-
Updated
Sep 15, 2021 - Python
Introduction to using and scaling dagster
-
Updated
Oct 14, 2025 - Python
Develop a real-time data ingestion pipeline using Kafka and Spark. Collect minute-level stock data from Yahoo Finance, ingest it into Kafka, and process it with Spark Streaming, storing the results in Cassandra. Orchestrated the workflow using Airflow deployed on Docker.
dockerfile airflow kafka cassandra etl docker-compose jupyter-notebook stream-processing spark-streaming financial-data data-ingestion etl-pipeline data-orchestration
-
Updated
Nov 29, 2024 - Python
Build an ELT pipeline with dagster and dbt to schedule loading HDB resale transactions in Singapore into Google BigQuery data warehouse, then create Power BI dashboard to enhance insight exploration.
-
Updated
Mar 27, 2025 - Python
EHR pipeline that simulates MIMIC-IV patient data streams
sql kafka snowflake data-engineering data-analytics data-modeling observability real-time-data data-pipeline workflow-automation metadata-management data-streaming etl-pipeline prefect data-orchestration healthcare-data log-processing events-driven cloud-datawarehouse
-
Updated
Sep 8, 2026 - Python
Code, scripts, and resources for the Data Engineering Fundamentals Course Webinar, covering Python, data pipelines, Apache Airflow, and more.
python sql data-engineering data-pipelines apache-airflow data-orchestration dimensional-modeling data-orchestrator
-
Updated
Dec 4, 2025 - Python
Data orchestration repo with Docker deployment
-
Updated
Jan 20, 2023 - Python
Prefect - Data orchestration tool practice & learning
-
Updated
Mar 12, 2023 - Python
Official ledger for the Digital Governance Framework V1.0.1. A multi-layer cross-platform orchestration standard utilizing W3C DIDs, BBS+ ZK-signatures, Shamir's Secret Sharing escrow, and Systemic Risk Vectors to eliminate platform risk.
open-source decentralization system-architecture threshold-cryptography risk-mitigation trust-and-safety privacy-by-design verifiable-credentials content-moderation zero-knowledge-proofs policy-as-code data-orchestration w3c-did bbs-signatures platform-governance regulatory-compliance aml-kyc cyber-safety technical-standards digital-governance
-
Updated
Aug 17, 2026 - Python
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
python workflow data-science machine-learning airflow automation etl workflow-engine scheduler apache orchestration data-engineering data-integration elt data-pipelines dag apache-airflow mlops workflow-orchestration data-orchestration
-
Updated
Sep 24, 2026 - Python
A poor-man's data lake fill with ducks
python docker docker-compose data-visualization data-analytics data-processing datalake geospatial-processing geospatial-analysis dagster data-orchestration traefik-v2 traefik-docker duckdb
-
Updated
Jun 22, 2023 - Python
Add this topic to your repo
To associate your repository with the data-orchestration topic, visit your repo's landing page and select "manage topics."