dataform

A _simple_ starter template for Snowflake Cloud Data Platform

Debussy is an opinionated Data Architecture and Engineering framework, enabling data analysts and engineers to build better platforms and pipelines.

example BQ data model using Dataform

Practical MCP server for large BigQuery datasets. Supports vector search. Keep LLM context small while staying fast and allowing only safe read-only actions.

An open-source tool that partially automates the migration of dbt packages to Dataform

GitHub Composite Action that applies Dataform release configurations and workflow configurations from a single JSON file

Agent Skills for Claude Code: BigQuery Dataform engineering discipline, CadQuery jig generation

Daily dashboard of new Hugging Face models and arXiv AI papers, on a free-tier BigQuery medallion pipeline (Cloud Run, Dataform, Workflows) with Gemini enrichment.

Streamlined Google Cloud Dataform Development: Fully equipped with a local environment, CI integration, schema tests, and environment switching for efficient development workflows.

Convention linter for Dataform .sqlx files — checks the config-block and project conventions (columns docs, ref() usage, schema suffixes, naming policies) that SQL linters cannot see. Stdlib-only, pre-commit ready.

Pipeline de propensão para leads outbound — XGBoost, T50/T90/T95, BigQuery e Dataform

Padrões de feature engineering em SQL e Python — dedup, features temporais, encoders e validação

Scam detection pipeline with synthetic data generation and Dataform transformations on BigQuery

Pipeline de dados end-to-end na GCP com Python, BigQuery e Dataform, seguindo a arquitetura Medallion (Bronze, Silver e Gold) com cargas incrementais.

End-to-end GCP data pipeline: CDC replication (Datastream), batch loading, scheduled API ingestion (Cloud Run), SQL transformations (Dataform), and Iceberg lakehouse tables — built on a retail analytics use case.

End-to-end data engineering platform for Chilean banking risk analytics with Airflow, GCP, BigQuery, Dataform and Terraform.

End-to-end data science portfolio — e-commerce segmentation (GA4/BigQuery ML), telecom churn (logistic regression), and retail site selection (XGBoost).

End-to-end JobTech data pipeline on GCP with immutable raw snapshots, BigQuery, Dataform, Cloud Run Jobs, Workflows, and Terraform.

Sample Serverless ELT pipeline for J-Quants API on GCP (Cloud Run + Workflows + BigQuery)