Blog

Blog

Blog

Think forward, read now – check how we leverage cutting-edge tools and practices.

Think forward, read now – check how we leverage cutting-edge tools and practices.

Think forward, read now – check how we leverage cutting-edge tools and practices.

Banner featuring orbits, against a dark, starry background.
Banner featuring orbits, against a dark, starry background.
Banner featuring orbits, against a dark, starry background.
Banner featuring orbits, against a dark, starry background.

All

Data Engineering

Analytics Engineering

Google Cloud

FinOps

Security

Infra & DataOps

Artificial Intelligence

Business Intelligence

The image is a three-level diagram categorizing types of logs. Level 1 has "Platform," "Component," "Security," "Multi-Cloud," and "User-Written Logs." Level 2 shows "Access transparency" and "Cloud Audit logs" beneath Level 1, excluding "User-Written Logs." Level 3 details "Cloud Audit logs" into "Admin activity," "Data access," "Policy Denied," and "System events logs." The diagram is titled "Types of logs.
Google Cloud

Apr 15, 2024

Google Cloud logging: Complete guide on usage and pricing optimization

Illustration showing a combination of cloud security components with emojis and icons. On the left, a card labeled 'VPC Service Controls' with a hexagon and a security lock icon. In the center, a card labeled 'IAM Bindings' featuring the Google Cloud IAM logo. On the right, a smiling emoji wearing a police cap, labeled 'bulletproof security.' The two cards on the left have a plus sign between them, suggesting that together they equal 'bulletproof security' as represented by the emoji on the right.
Security

Apr 5, 2024

Protect your data on Google Cloud with VPC service controls

The image is a digital illustration of a high-tech data warehouse, depicted as running incrementally with glowing connections between server racks and surrounding infrastructure.
Data Engineering

Mar 25, 2024

How to change partition column in dbt incrementally without losing any data in BigQuery

The diagram illustrates a data pipeline starting with code in a Git repository, automated builds in Cloud Build, storage in Artifact Registry, workflow orchestration with Apache Airflow, data modeling with dbt, and querying in BigQuery.
Data Engineering

Mar 18, 2024

Running dbt in production: Strategy comparison

FinOps Foundation Phases
FinOps

Mar 14, 2024

Practical FinOps on Google Cloud

A businessman in a modern office analyzing financial growth on a large digital screen showing complex graphs and data. The office has a sleek design with a large window, a desk with a laptop, documents, and a calculator, highlighting a professional and analytical atmosphere
Analytics Engineering

Feb 22, 2024

Fastest Integration of Period-Over-Period Comparison in Looker

Futuristic control room with rows of desks featuring multiple computer monitors, all displaying various types of analytical data. The room is illuminated by neon lights with a large, glowing digital cloud icon bearing the Google logo at the center. The room has a modern, high-tech vibe with a dark color scheme and blue neon accents.
Infra & DataOps

Feb 19, 2024

Google Cloud Workstations: Crafting the Perfect Development Ecosystem

Stylized 3D illustration of a male developer working at a desk with dual monitors displaying code, with a Google Chrome logo, a desk lamp, and stationery items, emphasizing a modern web development workspace
Business Intelligence

Feb 9, 2024

A simple GA4 BigQuery model

Laptop on a desk displaying colorful data analytics dashboard with various charts and graphs, including bar graphs and line charts indicating performance metrics, next to a holder with pencils, all in an office environment with a blurred background
Business Intelligence

Jan 26, 2024

Adding Tooltips to Your Looker Dashboard

Diagram showing a single sign-on (SSO) workflow for user authentication with two output paths: one leading to 'dbt docs' symbolized by a dbt logo and document icon, and another to 'Elementary dashboards' represented by a dashboard preview with various charts.
Data Engineering

Jan 22, 2024

Secure dbt docs and elementary UI with Cloud run and IAP

Artistic architectural design of a tunnel-like structure with wooden blocks protruding asymmetrically from the walls and floor, leading to an open exit with a view of a misty forest
Analytics Engineering

Jan 22, 2024

Bigquery partitioned & clustered table with dbt — Overwrite only what you need

Futuristic control panel interface with three sections labeled 'Node Selector', 'Affinity', and 'Taint/Tolerance', each displaying holographic structures and connectivity diagrams, symbolizing advanced computing concepts or data processing modules.
Infra & DataOps

Jan 19, 2024

Mastering Kubernetes Cluster Management: Node Selector, Affinity, and Taint/Toleration

Digital 3D illustration of interconnected shipping containers with glowing edges, representing a concept of logistics, networked supply chain, or containerized data center architecture on a dark background.
Analytics Engineering

Nov 20, 2023

dbt-loom: Bringing Multi-Project Integration to dbt-core

An open laptop on a desk displaying a colorful Slack application interface, with a vibrant, abstract backdrop of interconnected clouds symbolizing networked communication and cloud computing
Infra & DataOps

Nov 10, 2023

Interactive Slack commands with Cloud Function

Illustration of a man analyzing a large, interactive analytics dashboard screen displaying various colorful charts and graphs, including bar graphs, line graphs, and pie charts, indicating different data metrics and trends in a business or marketing context, set against a background with abstract shapes and leaves.
Business Intelligence

Oct 31, 2023

Adding Images to Your Looker Dashboard

A dynamic 3D infographic featuring a colorful circular element with a keyhole at the center, surrounded by rising bar graphs in various colors, suggesting data security and analytics concepts. The background is adorned with scattered geometric shapes, adding to the sense of innovation and digital technology.
Business Intelligence

Oct 13, 2023

Understanding GA4 vs UA gap in E-commerce Analytics

Isometric digital art of a vibrant cloud computing network. It features 3D icons of databases, servers, and security shields interconnected with lines and set against a dark background with floating clouds, symbolizing a complex and secure data network infrastructure
Google Cloud

Oct 10, 2023

Leveraging Google Cloud Workload Identity for Seamless Gitlab CI/CD Authentication

Isometric illustration of colorful 3D bar graphs and abstract data blocks arranged in a cloud environment, representing cloud computing, data management, and digital transformation concepts
Data Engineering

Oct 3, 2023

Deploy Airflow on Google Cloud Platform using Terraform

Uncle Scrooge keeping an eye on its organisation's cloud billing activity.
Analytics Engineering

Sep 29, 2023

FinOps: Unveiling Clarity in Cloud Cost Management

Close-up of a female humanoid robot with a partially transparent face showing intricate cybernetic components and circuitry. The backdrop features abstract digital graphics, symbolizing advanced artificial intelligence technology and futuristic concepts.
Artificial Intelligence

Sep 7, 2023

Towards Autonomous Versatile Universal AI Agents

A man in a suit is seated at a desk, working on a computer with multiple screens, in a dark room illuminated by complex engineering schematics and digital blueprints that are projected onto the wall in front of him, suggesting a high-tech research or design environment
Analytics Engineering

Sep 7, 2023

Data Vault 2.0 — a hands-on approach with dbt and BigQuery (Part 2)

Digital illustration of a complex network with interconnected lines and glowing nodes, featuring 3D cubes with various bright colors like orange and blue, representing a blockchain network or advanced data structure concept.
Analytics Engineering

Sep 7, 2023

Data Vault 2.0 — a hands-on approach with dbt and BigQuery (Part 1)

A man in a business suit and a humanoid robot with glowing blue eyes are sitting opposite each other at a desk, both using laptops in a high-rise office with a cityscape in the background, symbolizing human-robot collaboration in the workplace.
Artificial Intelligence

Sep 6, 2023

Building a Custom Robust Retrieval Augmented Generation Chatbot

Logos of HashiCorp Terraform and Google Cloud side by side, representing the integration of infrastructure as code with cloud services
Infra & DataOps

Aug 30, 2023

Authenticate to Google Cloud from Terraform Cloud using workload identity

Networking architecture
Infra & DataOps

Aug 28, 2023

Automatize app deployment behind an HTTPs load balancer in GKE using Istio and Terraform on Google Cloud

Data Analysts in a command centre room analysing BigQuery logs displayed on various Business Intelligence dashboards.
Analytics Engineering

Aug 14, 2023

How to get full visibility on your BigQuery workloads

Midjourney: In a gleaming, high-tech factory of tomorrow, envision AI quality assurance at its finest. Show us a hyper-advanced robotic arm meticulously inspecting and sorting products on a conveyer belt with unparalleled precision and speed. The vibrant neon lights accentuate the futuristic aura of the scene. Futuristic style
Artificial Intelligence

Jul 26, 2023

AI Code Reviewer: Enhancing Code Review Efficiency with ChatGPT

Flowchart depicting a data validation process, starting with executing a PodOperator in Airflow, fetching contracts from a bucket, mapping tables in BigQuery, validating schemas with Great Expectations, and ending with sending alerts via a communication channel.
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 3

Illustrative flowchart showing the data contract update process. Data Producers edit contracts and submit a pull request. Data Consumers review and approve it. Changes in the 'Data Contracts Repo' trigger a CI/CD pipeline, which updates and stores the contracts in a versioned 'Data Contracts Bucket'.
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 2

Layers' Boundaries
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 1

Midjourney: duck carrying tons of paper running super quickly, visible sweat, incredible speed, in a disney animation 3d rendered style, happy upbeat color palette
Analytics Engineering

Jun 23, 2023

Leveraging DuckDB for enhanced performance in dbt projects

Illustration of a data processing workflow showing stages from 'Ingestion with Airbyte', through 'data contracts with Great Expectations', to 'Transformation with dbt', and leading to various operations like triggering DAG runs, publishing/subscribing, and updating a data catalog
Analytics Engineering

May 9, 2023

Data Quality with Great Expectations

Image with two emoji-style icons side by side: on the left, a blue downward-pointing triangle made of vertical lines representing a shower, and on the right, a yellow smiling face with hands showing gratitude or excitement.
Artificial Intelligence

Apr 26, 2023

Batch/Online Predictions with Pytorch Hugging Face Models on Google Cloud

Screenshot of a cloud services expense summary notification. It lists yesterday's total expense as 7.74 CHF, a 23.43% decrease, with a breakdown of costs by product and project. Compute Engine tops the list at 5.81 CHF, followed by costs for Cloud SQL, KMS, and others. The project 'astrafy-gke' incurs the highest cost at 5.91 CHF. Total expenses for the month to date are 35 CHF, a decrease of 56.96%
Google Cloud

Apr 6, 2023

Google Cloud Expenses Summary Report

Logo of dbt, depicted as an orange asterisk with a geometric hollow center.
Analytics Engineering

Nov 11, 2022

Our top dbt packages pick

Comparison of On-Premise versus Cloud costs depicting On-Premise with high Capex and low Opex, including hidden costs like software licensing, hardware, utilities, cooling, and real estate; versus Cloud with low Capex and high Opex, including transparent costs such as subscriptions, physical security, disaster recovery, IT support headcount, and training
FinOps

Sep 19, 2022

FinOps with Infracost

Diagram of a network setup for an ops project with multiple Terraform-managed services including Airbyte, Lightdash, and Airflow. Features include an Identity-Aware Proxy, load balancer, GKE cluster, and a separate DBT node pool, indicating a cloud-based infrastructure with various data processing tools
Data Engineering

Aug 25, 2022

Modern Data Stack: One K8S cluster to rule them all

An image of a dbt Labs certification stating that Charles Verleyen has been awarded the title of dbt Certified Developer. The certificate was issued on August 10, 2022, by Erin Vaughan, VP of Customer Success at dbt Labs, and is set to expire on August 10, 2024. There's also a link to verify the credential online.
Analytics Engineering

Aug 11, 2022

dbt certification feedback

Photograph of a power plant's multiple tall, cylindrical smokestacks against a clear blue sky, with red warning lights on the stacks' rims
Data Engineering

Jul 18, 2022

Airflow DAG Python Factory

Diagram depicting a Terraform configuration for Google Cloud Platform (GCP). It shows a multi-provider setup with one main 'Google Provider (ops)' connecting to three separate service account providers labeled 'SA p1', 'SA p2', and 'SA p3', each linked to their own GCP resources within an 'ops' project environment
Infra & DataOps

Jul 11, 2022

Terraform provider using multiple credentials

Flowchart depicting an Airflow Directed Acyclic Graph (DAG) for data processing with stages for ingestion, data quality checks using 'Great Expectations,' followed by dbt run stages for staging layer, data warehouse, and datamart layer. The DAG concludes with optional PubSub, Python, and other unspecified operators for further data operations.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 3

Diagram depicting a multi-layered Google Cloud data architecture for a company, highlighting different project environments such as sandbox, user acceptance testing, and production, with data flowing through landing zones, staging, warehouses, and datamarts, managed via Virtual Private Clouds.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 2

An infographic outlining a data engineering pipeline on Google Cloud, where data moves from sources like PostgreSQL and MongoDB through tools like Airbyte and dbt for transformation in BigQuery, to be finally distributed by applications like Looker and Vertex AI, orchestrated by Apache Airflow.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 1

All

Data Engineering

Analytics Engineering

Google Cloud

FinOps

Security

Infra & DataOps

Artificial Intelligence

Business Intelligence

The image is a three-level diagram categorizing types of logs. Level 1 has "Platform," "Component," "Security," "Multi-Cloud," and "User-Written Logs." Level 2 shows "Access transparency" and "Cloud Audit logs" beneath Level 1, excluding "User-Written Logs." Level 3 details "Cloud Audit logs" into "Admin activity," "Data access," "Policy Denied," and "System events logs." The diagram is titled "Types of logs.
Google Cloud

Apr 15, 2024

Google Cloud logging: Complete guide on usage and pricing optimization

Illustration showing a combination of cloud security components with emojis and icons. On the left, a card labeled 'VPC Service Controls' with a hexagon and a security lock icon. In the center, a card labeled 'IAM Bindings' featuring the Google Cloud IAM logo. On the right, a smiling emoji wearing a police cap, labeled 'bulletproof security.' The two cards on the left have a plus sign between them, suggesting that together they equal 'bulletproof security' as represented by the emoji on the right.
Security

Apr 5, 2024

Protect your data on Google Cloud with VPC service controls

The image is a digital illustration of a high-tech data warehouse, depicted as running incrementally with glowing connections between server racks and surrounding infrastructure.
Data Engineering

Mar 25, 2024

How to change partition column in dbt incrementally without losing any data in BigQuery

The diagram illustrates a data pipeline starting with code in a Git repository, automated builds in Cloud Build, storage in Artifact Registry, workflow orchestration with Apache Airflow, data modeling with dbt, and querying in BigQuery.
Data Engineering

Mar 18, 2024

Running dbt in production: Strategy comparison

FinOps Foundation Phases
FinOps

Mar 14, 2024

Practical FinOps on Google Cloud

A businessman in a modern office analyzing financial growth on a large digital screen showing complex graphs and data. The office has a sleek design with a large window, a desk with a laptop, documents, and a calculator, highlighting a professional and analytical atmosphere
Analytics Engineering

Feb 22, 2024

Fastest Integration of Period-Over-Period Comparison in Looker

Futuristic control room with rows of desks featuring multiple computer monitors, all displaying various types of analytical data. The room is illuminated by neon lights with a large, glowing digital cloud icon bearing the Google logo at the center. The room has a modern, high-tech vibe with a dark color scheme and blue neon accents.
Infra & DataOps

Feb 19, 2024

Google Cloud Workstations: Crafting the Perfect Development Ecosystem

Stylized 3D illustration of a male developer working at a desk with dual monitors displaying code, with a Google Chrome logo, a desk lamp, and stationery items, emphasizing a modern web development workspace
Business Intelligence

Feb 9, 2024

A simple GA4 BigQuery model

Laptop on a desk displaying colorful data analytics dashboard with various charts and graphs, including bar graphs and line charts indicating performance metrics, next to a holder with pencils, all in an office environment with a blurred background
Business Intelligence

Jan 26, 2024

Adding Tooltips to Your Looker Dashboard

Diagram showing a single sign-on (SSO) workflow for user authentication with two output paths: one leading to 'dbt docs' symbolized by a dbt logo and document icon, and another to 'Elementary dashboards' represented by a dashboard preview with various charts.
Data Engineering

Jan 22, 2024

Secure dbt docs and elementary UI with Cloud run and IAP

Artistic architectural design of a tunnel-like structure with wooden blocks protruding asymmetrically from the walls and floor, leading to an open exit with a view of a misty forest
Analytics Engineering

Jan 22, 2024

Bigquery partitioned & clustered table with dbt — Overwrite only what you need

Futuristic control panel interface with three sections labeled 'Node Selector', 'Affinity', and 'Taint/Tolerance', each displaying holographic structures and connectivity diagrams, symbolizing advanced computing concepts or data processing modules.
Infra & DataOps

Jan 19, 2024

Mastering Kubernetes Cluster Management: Node Selector, Affinity, and Taint/Toleration

Digital 3D illustration of interconnected shipping containers with glowing edges, representing a concept of logistics, networked supply chain, or containerized data center architecture on a dark background.
Analytics Engineering

Nov 20, 2023

dbt-loom: Bringing Multi-Project Integration to dbt-core

An open laptop on a desk displaying a colorful Slack application interface, with a vibrant, abstract backdrop of interconnected clouds symbolizing networked communication and cloud computing
Infra & DataOps

Nov 10, 2023

Interactive Slack commands with Cloud Function

Illustration of a man analyzing a large, interactive analytics dashboard screen displaying various colorful charts and graphs, including bar graphs, line graphs, and pie charts, indicating different data metrics and trends in a business or marketing context, set against a background with abstract shapes and leaves.
Business Intelligence

Oct 31, 2023

Adding Images to Your Looker Dashboard

A dynamic 3D infographic featuring a colorful circular element with a keyhole at the center, surrounded by rising bar graphs in various colors, suggesting data security and analytics concepts. The background is adorned with scattered geometric shapes, adding to the sense of innovation and digital technology.
Business Intelligence

Oct 13, 2023

Understanding GA4 vs UA gap in E-commerce Analytics

Isometric digital art of a vibrant cloud computing network. It features 3D icons of databases, servers, and security shields interconnected with lines and set against a dark background with floating clouds, symbolizing a complex and secure data network infrastructure
Google Cloud

Oct 10, 2023

Leveraging Google Cloud Workload Identity for Seamless Gitlab CI/CD Authentication

Isometric illustration of colorful 3D bar graphs and abstract data blocks arranged in a cloud environment, representing cloud computing, data management, and digital transformation concepts
Data Engineering

Oct 3, 2023

Deploy Airflow on Google Cloud Platform using Terraform

Uncle Scrooge keeping an eye on its organisation's cloud billing activity.
Analytics Engineering

Sep 29, 2023

FinOps: Unveiling Clarity in Cloud Cost Management

Close-up of a female humanoid robot with a partially transparent face showing intricate cybernetic components and circuitry. The backdrop features abstract digital graphics, symbolizing advanced artificial intelligence technology and futuristic concepts.
Artificial Intelligence

Sep 7, 2023

Towards Autonomous Versatile Universal AI Agents

A man in a suit is seated at a desk, working on a computer with multiple screens, in a dark room illuminated by complex engineering schematics and digital blueprints that are projected onto the wall in front of him, suggesting a high-tech research or design environment
Analytics Engineering

Sep 7, 2023

Data Vault 2.0 — a hands-on approach with dbt and BigQuery (Part 2)

Digital illustration of a complex network with interconnected lines and glowing nodes, featuring 3D cubes with various bright colors like orange and blue, representing a blockchain network or advanced data structure concept.
Analytics Engineering

Sep 7, 2023

Data Vault 2.0 — a hands-on approach with dbt and BigQuery (Part 1)

A man in a business suit and a humanoid robot with glowing blue eyes are sitting opposite each other at a desk, both using laptops in a high-rise office with a cityscape in the background, symbolizing human-robot collaboration in the workplace.
Artificial Intelligence

Sep 6, 2023

Building a Custom Robust Retrieval Augmented Generation Chatbot

Logos of HashiCorp Terraform and Google Cloud side by side, representing the integration of infrastructure as code with cloud services
Infra & DataOps

Aug 30, 2023

Authenticate to Google Cloud from Terraform Cloud using workload identity

Networking architecture
Infra & DataOps

Aug 28, 2023

Automatize app deployment behind an HTTPs load balancer in GKE using Istio and Terraform on Google Cloud

Data Analysts in a command centre room analysing BigQuery logs displayed on various Business Intelligence dashboards.
Analytics Engineering

Aug 14, 2023

How to get full visibility on your BigQuery workloads

Midjourney: In a gleaming, high-tech factory of tomorrow, envision AI quality assurance at its finest. Show us a hyper-advanced robotic arm meticulously inspecting and sorting products on a conveyer belt with unparalleled precision and speed. The vibrant neon lights accentuate the futuristic aura of the scene. Futuristic style
Artificial Intelligence

Jul 26, 2023

AI Code Reviewer: Enhancing Code Review Efficiency with ChatGPT

Flowchart depicting a data validation process, starting with executing a PodOperator in Airflow, fetching contracts from a bucket, mapping tables in BigQuery, validating schemas with Great Expectations, and ending with sending alerts via a communication channel.
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 3

Illustrative flowchart showing the data contract update process. Data Producers edit contracts and submit a pull request. Data Consumers review and approve it. Changes in the 'Data Contracts Repo' trigger a CI/CD pipeline, which updates and stores the contracts in a versioned 'Data Contracts Bucket'.
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 2

Layers' Boundaries
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 1

Midjourney: duck carrying tons of paper running super quickly, visible sweat, incredible speed, in a disney animation 3d rendered style, happy upbeat color palette
Analytics Engineering

Jun 23, 2023

Leveraging DuckDB for enhanced performance in dbt projects

Illustration of a data processing workflow showing stages from 'Ingestion with Airbyte', through 'data contracts with Great Expectations', to 'Transformation with dbt', and leading to various operations like triggering DAG runs, publishing/subscribing, and updating a data catalog
Analytics Engineering

May 9, 2023

Data Quality with Great Expectations

Image with two emoji-style icons side by side: on the left, a blue downward-pointing triangle made of vertical lines representing a shower, and on the right, a yellow smiling face with hands showing gratitude or excitement.
Artificial Intelligence

Apr 26, 2023

Batch/Online Predictions with Pytorch Hugging Face Models on Google Cloud

Screenshot of a cloud services expense summary notification. It lists yesterday's total expense as 7.74 CHF, a 23.43% decrease, with a breakdown of costs by product and project. Compute Engine tops the list at 5.81 CHF, followed by costs for Cloud SQL, KMS, and others. The project 'astrafy-gke' incurs the highest cost at 5.91 CHF. Total expenses for the month to date are 35 CHF, a decrease of 56.96%
Google Cloud

Apr 6, 2023

Google Cloud Expenses Summary Report

Logo of dbt, depicted as an orange asterisk with a geometric hollow center.
Analytics Engineering

Nov 11, 2022

Our top dbt packages pick

Comparison of On-Premise versus Cloud costs depicting On-Premise with high Capex and low Opex, including hidden costs like software licensing, hardware, utilities, cooling, and real estate; versus Cloud with low Capex and high Opex, including transparent costs such as subscriptions, physical security, disaster recovery, IT support headcount, and training
FinOps

Sep 19, 2022

FinOps with Infracost

Diagram of a network setup for an ops project with multiple Terraform-managed services including Airbyte, Lightdash, and Airflow. Features include an Identity-Aware Proxy, load balancer, GKE cluster, and a separate DBT node pool, indicating a cloud-based infrastructure with various data processing tools
Data Engineering

Aug 25, 2022

Modern Data Stack: One K8S cluster to rule them all

An image of a dbt Labs certification stating that Charles Verleyen has been awarded the title of dbt Certified Developer. The certificate was issued on August 10, 2022, by Erin Vaughan, VP of Customer Success at dbt Labs, and is set to expire on August 10, 2024. There's also a link to verify the credential online.
Analytics Engineering

Aug 11, 2022

dbt certification feedback

Photograph of a power plant's multiple tall, cylindrical smokestacks against a clear blue sky, with red warning lights on the stacks' rims
Data Engineering

Jul 18, 2022

Airflow DAG Python Factory

Diagram depicting a Terraform configuration for Google Cloud Platform (GCP). It shows a multi-provider setup with one main 'Google Provider (ops)' connecting to three separate service account providers labeled 'SA p1', 'SA p2', and 'SA p3', each linked to their own GCP resources within an 'ops' project environment
Infra & DataOps

Jul 11, 2022

Terraform provider using multiple credentials

Flowchart depicting an Airflow Directed Acyclic Graph (DAG) for data processing with stages for ingestion, data quality checks using 'Great Expectations,' followed by dbt run stages for staging layer, data warehouse, and datamart layer. The DAG concludes with optional PubSub, Python, and other unspecified operators for further data operations.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 3

Diagram depicting a multi-layered Google Cloud data architecture for a company, highlighting different project environments such as sandbox, user acceptance testing, and production, with data flowing through landing zones, staging, warehouses, and datamarts, managed via Virtual Private Clouds.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 2

An infographic outlining a data engineering pipeline on Google Cloud, where data moves from sources like PostgreSQL and MongoDB through tools like Airbyte and dbt for transformation in BigQuery, to be finally distributed by applications like Looker and Vertex AI, orchestrated by Apache Airflow.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 1

All

Data Engineering

Analytics Engineering

Google Cloud

FinOps

Security

Infra & DataOps

Artificial Intelligence

Business Intelligence

The image is a three-level diagram categorizing types of logs. Level 1 has "Platform," "Component," "Security," "Multi-Cloud," and "User-Written Logs." Level 2 shows "Access transparency" and "Cloud Audit logs" beneath Level 1, excluding "User-Written Logs." Level 3 details "Cloud Audit logs" into "Admin activity," "Data access," "Policy Denied," and "System events logs." The diagram is titled "Types of logs.
Google Cloud

Apr 15, 2024

Google Cloud logging: Complete guide on usage and pricing optimization

Illustration showing a combination of cloud security components with emojis and icons. On the left, a card labeled 'VPC Service Controls' with a hexagon and a security lock icon. In the center, a card labeled 'IAM Bindings' featuring the Google Cloud IAM logo. On the right, a smiling emoji wearing a police cap, labeled 'bulletproof security.' The two cards on the left have a plus sign between them, suggesting that together they equal 'bulletproof security' as represented by the emoji on the right.
Security

Apr 5, 2024

Protect your data on Google Cloud with VPC service controls

The image is a digital illustration of a high-tech data warehouse, depicted as running incrementally with glowing connections between server racks and surrounding infrastructure.
Data Engineering

Mar 25, 2024

How to change partition column in dbt incrementally without losing any data in BigQuery

The diagram illustrates a data pipeline starting with code in a Git repository, automated builds in Cloud Build, storage in Artifact Registry, workflow orchestration with Apache Airflow, data modeling with dbt, and querying in BigQuery.
Data Engineering

Mar 18, 2024

Running dbt in production: Strategy comparison

FinOps Foundation Phases
FinOps

Mar 14, 2024

Practical FinOps on Google Cloud

A businessman in a modern office analyzing financial growth on a large digital screen showing complex graphs and data. The office has a sleek design with a large window, a desk with a laptop, documents, and a calculator, highlighting a professional and analytical atmosphere
Analytics Engineering

Feb 22, 2024

Fastest Integration of Period-Over-Period Comparison in Looker

Futuristic control room with rows of desks featuring multiple computer monitors, all displaying various types of analytical data. The room is illuminated by neon lights with a large, glowing digital cloud icon bearing the Google logo at the center. The room has a modern, high-tech vibe with a dark color scheme and blue neon accents.
Infra & DataOps

Feb 19, 2024

Google Cloud Workstations: Crafting the Perfect Development Ecosystem

Stylized 3D illustration of a male developer working at a desk with dual monitors displaying code, with a Google Chrome logo, a desk lamp, and stationery items, emphasizing a modern web development workspace
Business Intelligence

Feb 9, 2024

A simple GA4 BigQuery model

Laptop on a desk displaying colorful data analytics dashboard with various charts and graphs, including bar graphs and line charts indicating performance metrics, next to a holder with pencils, all in an office environment with a blurred background
Business Intelligence

Jan 26, 2024

Adding Tooltips to Your Looker Dashboard

Diagram showing a single sign-on (SSO) workflow for user authentication with two output paths: one leading to 'dbt docs' symbolized by a dbt logo and document icon, and another to 'Elementary dashboards' represented by a dashboard preview with various charts.
Data Engineering

Jan 22, 2024

Secure dbt docs and elementary UI with Cloud run and IAP

Artistic architectural design of a tunnel-like structure with wooden blocks protruding asymmetrically from the walls and floor, leading to an open exit with a view of a misty forest
Analytics Engineering

Jan 22, 2024

Bigquery partitioned & clustered table with dbt — Overwrite only what you need

Futuristic control panel interface with three sections labeled 'Node Selector', 'Affinity', and 'Taint/Tolerance', each displaying holographic structures and connectivity diagrams, symbolizing advanced computing concepts or data processing modules.
Infra & DataOps

Jan 19, 2024

Mastering Kubernetes Cluster Management: Node Selector, Affinity, and Taint/Toleration

Digital 3D illustration of interconnected shipping containers with glowing edges, representing a concept of logistics, networked supply chain, or containerized data center architecture on a dark background.
Analytics Engineering

Nov 20, 2023

dbt-loom: Bringing Multi-Project Integration to dbt-core

An open laptop on a desk displaying a colorful Slack application interface, with a vibrant, abstract backdrop of interconnected clouds symbolizing networked communication and cloud computing
Infra & DataOps

Nov 10, 2023

Interactive Slack commands with Cloud Function

Illustration of a man analyzing a large, interactive analytics dashboard screen displaying various colorful charts and graphs, including bar graphs, line graphs, and pie charts, indicating different data metrics and trends in a business or marketing context, set against a background with abstract shapes and leaves.
Business Intelligence

Oct 31, 2023

Adding Images to Your Looker Dashboard

A dynamic 3D infographic featuring a colorful circular element with a keyhole at the center, surrounded by rising bar graphs in various colors, suggesting data security and analytics concepts. The background is adorned with scattered geometric shapes, adding to the sense of innovation and digital technology.
Business Intelligence

Oct 13, 2023

Understanding GA4 vs UA gap in E-commerce Analytics

Isometric digital art of a vibrant cloud computing network. It features 3D icons of databases, servers, and security shields interconnected with lines and set against a dark background with floating clouds, symbolizing a complex and secure data network infrastructure
Google Cloud

Oct 10, 2023

Leveraging Google Cloud Workload Identity for Seamless Gitlab CI/CD Authentication

Isometric illustration of colorful 3D bar graphs and abstract data blocks arranged in a cloud environment, representing cloud computing, data management, and digital transformation concepts
Data Engineering

Oct 3, 2023

Deploy Airflow on Google Cloud Platform using Terraform

Uncle Scrooge keeping an eye on its organisation's cloud billing activity.
Analytics Engineering

Sep 29, 2023

FinOps: Unveiling Clarity in Cloud Cost Management

Close-up of a female humanoid robot with a partially transparent face showing intricate cybernetic components and circuitry. The backdrop features abstract digital graphics, symbolizing advanced artificial intelligence technology and futuristic concepts.
Artificial Intelligence

Sep 7, 2023

Towards Autonomous Versatile Universal AI Agents

A man in a suit is seated at a desk, working on a computer with multiple screens, in a dark room illuminated by complex engineering schematics and digital blueprints that are projected onto the wall in front of him, suggesting a high-tech research or design environment
Analytics Engineering

Sep 7, 2023

Data Vault 2.0 — a hands-on approach with dbt and BigQuery (Part 2)

Digital illustration of a complex network with interconnected lines and glowing nodes, featuring 3D cubes with various bright colors like orange and blue, representing a blockchain network or advanced data structure concept.
Analytics Engineering

Sep 7, 2023

Data Vault 2.0 — a hands-on approach with dbt and BigQuery (Part 1)

A man in a business suit and a humanoid robot with glowing blue eyes are sitting opposite each other at a desk, both using laptops in a high-rise office with a cityscape in the background, symbolizing human-robot collaboration in the workplace.
Artificial Intelligence

Sep 6, 2023

Building a Custom Robust Retrieval Augmented Generation Chatbot

Logos of HashiCorp Terraform and Google Cloud side by side, representing the integration of infrastructure as code with cloud services
Infra & DataOps

Aug 30, 2023

Authenticate to Google Cloud from Terraform Cloud using workload identity

Networking architecture
Infra & DataOps

Aug 28, 2023

Automatize app deployment behind an HTTPs load balancer in GKE using Istio and Terraform on Google Cloud

Data Analysts in a command centre room analysing BigQuery logs displayed on various Business Intelligence dashboards.
Analytics Engineering

Aug 14, 2023

How to get full visibility on your BigQuery workloads

Midjourney: In a gleaming, high-tech factory of tomorrow, envision AI quality assurance at its finest. Show us a hyper-advanced robotic arm meticulously inspecting and sorting products on a conveyer belt with unparalleled precision and speed. The vibrant neon lights accentuate the futuristic aura of the scene. Futuristic style
Artificial Intelligence

Jul 26, 2023

AI Code Reviewer: Enhancing Code Review Efficiency with ChatGPT

Flowchart depicting a data validation process, starting with executing a PodOperator in Airflow, fetching contracts from a bucket, mapping tables in BigQuery, validating schemas with Great Expectations, and ending with sending alerts via a communication channel.
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 3

Illustrative flowchart showing the data contract update process. Data Producers edit contracts and submit a pull request. Data Consumers review and approve it. Changes in the 'Data Contracts Repo' trigger a CI/CD pipeline, which updates and stores the contracts in a versioned 'Data Contracts Bucket'.
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 2

Layers' Boundaries
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 1

Midjourney: duck carrying tons of paper running super quickly, visible sweat, incredible speed, in a disney animation 3d rendered style, happy upbeat color palette
Analytics Engineering

Jun 23, 2023

Leveraging DuckDB for enhanced performance in dbt projects

Illustration of a data processing workflow showing stages from 'Ingestion with Airbyte', through 'data contracts with Great Expectations', to 'Transformation with dbt', and leading to various operations like triggering DAG runs, publishing/subscribing, and updating a data catalog
Analytics Engineering

May 9, 2023

Data Quality with Great Expectations

Image with two emoji-style icons side by side: on the left, a blue downward-pointing triangle made of vertical lines representing a shower, and on the right, a yellow smiling face with hands showing gratitude or excitement.
Artificial Intelligence

Apr 26, 2023

Batch/Online Predictions with Pytorch Hugging Face Models on Google Cloud

Screenshot of a cloud services expense summary notification. It lists yesterday's total expense as 7.74 CHF, a 23.43% decrease, with a breakdown of costs by product and project. Compute Engine tops the list at 5.81 CHF, followed by costs for Cloud SQL, KMS, and others. The project 'astrafy-gke' incurs the highest cost at 5.91 CHF. Total expenses for the month to date are 35 CHF, a decrease of 56.96%
Google Cloud

Apr 6, 2023

Google Cloud Expenses Summary Report

Logo of dbt, depicted as an orange asterisk with a geometric hollow center.
Analytics Engineering

Nov 11, 2022

Our top dbt packages pick

Comparison of On-Premise versus Cloud costs depicting On-Premise with high Capex and low Opex, including hidden costs like software licensing, hardware, utilities, cooling, and real estate; versus Cloud with low Capex and high Opex, including transparent costs such as subscriptions, physical security, disaster recovery, IT support headcount, and training
FinOps

Sep 19, 2022

FinOps with Infracost

Diagram of a network setup for an ops project with multiple Terraform-managed services including Airbyte, Lightdash, and Airflow. Features include an Identity-Aware Proxy, load balancer, GKE cluster, and a separate DBT node pool, indicating a cloud-based infrastructure with various data processing tools
Data Engineering

Aug 25, 2022

Modern Data Stack: One K8S cluster to rule them all

An image of a dbt Labs certification stating that Charles Verleyen has been awarded the title of dbt Certified Developer. The certificate was issued on August 10, 2022, by Erin Vaughan, VP of Customer Success at dbt Labs, and is set to expire on August 10, 2024. There's also a link to verify the credential online.
Analytics Engineering

Aug 11, 2022

dbt certification feedback

Photograph of a power plant's multiple tall, cylindrical smokestacks against a clear blue sky, with red warning lights on the stacks' rims
Data Engineering

Jul 18, 2022

Airflow DAG Python Factory

Diagram depicting a Terraform configuration for Google Cloud Platform (GCP). It shows a multi-provider setup with one main 'Google Provider (ops)' connecting to three separate service account providers labeled 'SA p1', 'SA p2', and 'SA p3', each linked to their own GCP resources within an 'ops' project environment
Infra & DataOps

Jul 11, 2022

Terraform provider using multiple credentials

Flowchart depicting an Airflow Directed Acyclic Graph (DAG) for data processing with stages for ingestion, data quality checks using 'Great Expectations,' followed by dbt run stages for staging layer, data warehouse, and datamart layer. The DAG concludes with optional PubSub, Python, and other unspecified operators for further data operations.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 3

Diagram depicting a multi-layered Google Cloud data architecture for a company, highlighting different project environments such as sandbox, user acceptance testing, and production, with data flowing through landing zones, staging, warehouses, and datamarts, managed via Virtual Private Clouds.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 2

An infographic outlining a data engineering pipeline on Google Cloud, where data moves from sources like PostgreSQL and MongoDB through tools like Airbyte and dbt for transformation in BigQuery, to be finally distributed by applications like Looker and Vertex AI, orchestrated by Apache Airflow.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 1

All

Data Engineering

Analytics Engineering

Google Cloud

FinOps

Security

Infra & DataOps

Artificial Intelligence

Business Intelligence

The image is a three-level diagram categorizing types of logs. Level 1 has "Platform," "Component," "Security," "Multi-Cloud," and "User-Written Logs." Level 2 shows "Access transparency" and "Cloud Audit logs" beneath Level 1, excluding "User-Written Logs." Level 3 details "Cloud Audit logs" into "Admin activity," "Data access," "Policy Denied," and "System events logs." The diagram is titled "Types of logs.
Google Cloud

Apr 15, 2024

Google Cloud logging: Complete guide on usage and pricing optimization

Illustration showing a combination of cloud security components with emojis and icons. On the left, a card labeled 'VPC Service Controls' with a hexagon and a security lock icon. In the center, a card labeled 'IAM Bindings' featuring the Google Cloud IAM logo. On the right, a smiling emoji wearing a police cap, labeled 'bulletproof security.' The two cards on the left have a plus sign between them, suggesting that together they equal 'bulletproof security' as represented by the emoji on the right.
Security

Apr 5, 2024

Protect your data on Google Cloud with VPC service controls

The image is a digital illustration of a high-tech data warehouse, depicted as running incrementally with glowing connections between server racks and surrounding infrastructure.
Data Engineering

Mar 25, 2024

How to change partition column in dbt incrementally without losing any data in BigQuery

The diagram illustrates a data pipeline starting with code in a Git repository, automated builds in Cloud Build, storage in Artifact Registry, workflow orchestration with Apache Airflow, data modeling with dbt, and querying in BigQuery.
Data Engineering

Mar 18, 2024

Running dbt in production: Strategy comparison

FinOps Foundation Phases
FinOps

Mar 14, 2024

Practical FinOps on Google Cloud

A businessman in a modern office analyzing financial growth on a large digital screen showing complex graphs and data. The office has a sleek design with a large window, a desk with a laptop, documents, and a calculator, highlighting a professional and analytical atmosphere
Analytics Engineering

Feb 22, 2024

Fastest Integration of Period-Over-Period Comparison in Looker

Futuristic control room with rows of desks featuring multiple computer monitors, all displaying various types of analytical data. The room is illuminated by neon lights with a large, glowing digital cloud icon bearing the Google logo at the center. The room has a modern, high-tech vibe with a dark color scheme and blue neon accents.
Infra & DataOps

Feb 19, 2024

Google Cloud Workstations: Crafting the Perfect Development Ecosystem

Stylized 3D illustration of a male developer working at a desk with dual monitors displaying code, with a Google Chrome logo, a desk lamp, and stationery items, emphasizing a modern web development workspace
Business Intelligence

Feb 9, 2024

A simple GA4 BigQuery model

Laptop on a desk displaying colorful data analytics dashboard with various charts and graphs, including bar graphs and line charts indicating performance metrics, next to a holder with pencils, all in an office environment with a blurred background
Business Intelligence

Jan 26, 2024

Adding Tooltips to Your Looker Dashboard

Diagram showing a single sign-on (SSO) workflow for user authentication with two output paths: one leading to 'dbt docs' symbolized by a dbt logo and document icon, and another to 'Elementary dashboards' represented by a dashboard preview with various charts.
Data Engineering

Jan 22, 2024

Secure dbt docs and elementary UI with Cloud run and IAP

Artistic architectural design of a tunnel-like structure with wooden blocks protruding asymmetrically from the walls and floor, leading to an open exit with a view of a misty forest
Analytics Engineering

Jan 22, 2024

Bigquery partitioned & clustered table with dbt — Overwrite only what you need

Futuristic control panel interface with three sections labeled 'Node Selector', 'Affinity', and 'Taint/Tolerance', each displaying holographic structures and connectivity diagrams, symbolizing advanced computing concepts or data processing modules.
Infra & DataOps

Jan 19, 2024

Mastering Kubernetes Cluster Management: Node Selector, Affinity, and Taint/Toleration

Digital 3D illustration of interconnected shipping containers with glowing edges, representing a concept of logistics, networked supply chain, or containerized data center architecture on a dark background.
Analytics Engineering

Nov 20, 2023

dbt-loom: Bringing Multi-Project Integration to dbt-core

An open laptop on a desk displaying a colorful Slack application interface, with a vibrant, abstract backdrop of interconnected clouds symbolizing networked communication and cloud computing
Infra & DataOps

Nov 10, 2023

Interactive Slack commands with Cloud Function

Illustration of a man analyzing a large, interactive analytics dashboard screen displaying various colorful charts and graphs, including bar graphs, line graphs, and pie charts, indicating different data metrics and trends in a business or marketing context, set against a background with abstract shapes and leaves.
Business Intelligence

Oct 31, 2023

Adding Images to Your Looker Dashboard

A dynamic 3D infographic featuring a colorful circular element with a keyhole at the center, surrounded by rising bar graphs in various colors, suggesting data security and analytics concepts. The background is adorned with scattered geometric shapes, adding to the sense of innovation and digital technology.
Business Intelligence

Oct 13, 2023

Understanding GA4 vs UA gap in E-commerce Analytics

Isometric digital art of a vibrant cloud computing network. It features 3D icons of databases, servers, and security shields interconnected with lines and set against a dark background with floating clouds, symbolizing a complex and secure data network infrastructure
Google Cloud

Oct 10, 2023

Leveraging Google Cloud Workload Identity for Seamless Gitlab CI/CD Authentication

Isometric illustration of colorful 3D bar graphs and abstract data blocks arranged in a cloud environment, representing cloud computing, data management, and digital transformation concepts
Data Engineering

Oct 3, 2023

Deploy Airflow on Google Cloud Platform using Terraform

Uncle Scrooge keeping an eye on its organisation's cloud billing activity.
Analytics Engineering

Sep 29, 2023

FinOps: Unveiling Clarity in Cloud Cost Management

Close-up of a female humanoid robot with a partially transparent face showing intricate cybernetic components and circuitry. The backdrop features abstract digital graphics, symbolizing advanced artificial intelligence technology and futuristic concepts.
Artificial Intelligence

Sep 7, 2023

Towards Autonomous Versatile Universal AI Agents

A man in a suit is seated at a desk, working on a computer with multiple screens, in a dark room illuminated by complex engineering schematics and digital blueprints that are projected onto the wall in front of him, suggesting a high-tech research or design environment
Analytics Engineering

Sep 7, 2023

Data Vault 2.0 — a hands-on approach with dbt and BigQuery (Part 2)

Digital illustration of a complex network with interconnected lines and glowing nodes, featuring 3D cubes with various bright colors like orange and blue, representing a blockchain network or advanced data structure concept.
Analytics Engineering

Sep 7, 2023

Data Vault 2.0 — a hands-on approach with dbt and BigQuery (Part 1)

A man in a business suit and a humanoid robot with glowing blue eyes are sitting opposite each other at a desk, both using laptops in a high-rise office with a cityscape in the background, symbolizing human-robot collaboration in the workplace.
Artificial Intelligence

Sep 6, 2023

Building a Custom Robust Retrieval Augmented Generation Chatbot

Logos of HashiCorp Terraform and Google Cloud side by side, representing the integration of infrastructure as code with cloud services
Infra & DataOps

Aug 30, 2023

Authenticate to Google Cloud from Terraform Cloud using workload identity

Networking architecture
Infra & DataOps

Aug 28, 2023

Automatize app deployment behind an HTTPs load balancer in GKE using Istio and Terraform on Google Cloud

Data Analysts in a command centre room analysing BigQuery logs displayed on various Business Intelligence dashboards.
Analytics Engineering

Aug 14, 2023

How to get full visibility on your BigQuery workloads

Midjourney: In a gleaming, high-tech factory of tomorrow, envision AI quality assurance at its finest. Show us a hyper-advanced robotic arm meticulously inspecting and sorting products on a conveyer belt with unparalleled precision and speed. The vibrant neon lights accentuate the futuristic aura of the scene. Futuristic style
Artificial Intelligence

Jul 26, 2023

AI Code Reviewer: Enhancing Code Review Efficiency with ChatGPT

Flowchart depicting a data validation process, starting with executing a PodOperator in Airflow, fetching contracts from a bucket, mapping tables in BigQuery, validating schemas with Great Expectations, and ending with sending alerts via a communication channel.
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 3

Illustrative flowchart showing the data contract update process. Data Producers edit contracts and submit a pull request. Data Consumers review and approve it. Changes in the 'Data Contracts Repo' trigger a CI/CD pipeline, which updates and stores the contracts in a versioned 'Data Contracts Bucket'.
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 2

Layers' Boundaries
Analytics Engineering

Jul 18, 2023

Implementation of the Data Contracts with dbt, Google Cloud & Great Expectations: Part 1

Midjourney: duck carrying tons of paper running super quickly, visible sweat, incredible speed, in a disney animation 3d rendered style, happy upbeat color palette
Analytics Engineering

Jun 23, 2023

Leveraging DuckDB for enhanced performance in dbt projects

Illustration of a data processing workflow showing stages from 'Ingestion with Airbyte', through 'data contracts with Great Expectations', to 'Transformation with dbt', and leading to various operations like triggering DAG runs, publishing/subscribing, and updating a data catalog
Analytics Engineering

May 9, 2023

Data Quality with Great Expectations

Image with two emoji-style icons side by side: on the left, a blue downward-pointing triangle made of vertical lines representing a shower, and on the right, a yellow smiling face with hands showing gratitude or excitement.
Artificial Intelligence

Apr 26, 2023

Batch/Online Predictions with Pytorch Hugging Face Models on Google Cloud

Screenshot of a cloud services expense summary notification. It lists yesterday's total expense as 7.74 CHF, a 23.43% decrease, with a breakdown of costs by product and project. Compute Engine tops the list at 5.81 CHF, followed by costs for Cloud SQL, KMS, and others. The project 'astrafy-gke' incurs the highest cost at 5.91 CHF. Total expenses for the month to date are 35 CHF, a decrease of 56.96%
Google Cloud

Apr 6, 2023

Google Cloud Expenses Summary Report

Logo of dbt, depicted as an orange asterisk with a geometric hollow center.
Analytics Engineering

Nov 11, 2022

Our top dbt packages pick

Comparison of On-Premise versus Cloud costs depicting On-Premise with high Capex and low Opex, including hidden costs like software licensing, hardware, utilities, cooling, and real estate; versus Cloud with low Capex and high Opex, including transparent costs such as subscriptions, physical security, disaster recovery, IT support headcount, and training
FinOps

Sep 19, 2022

FinOps with Infracost

Diagram of a network setup for an ops project with multiple Terraform-managed services including Airbyte, Lightdash, and Airflow. Features include an Identity-Aware Proxy, load balancer, GKE cluster, and a separate DBT node pool, indicating a cloud-based infrastructure with various data processing tools
Data Engineering

Aug 25, 2022

Modern Data Stack: One K8S cluster to rule them all

An image of a dbt Labs certification stating that Charles Verleyen has been awarded the title of dbt Certified Developer. The certificate was issued on August 10, 2022, by Erin Vaughan, VP of Customer Success at dbt Labs, and is set to expire on August 10, 2024. There's also a link to verify the credential online.
Analytics Engineering

Aug 11, 2022

dbt certification feedback

Photograph of a power plant's multiple tall, cylindrical smokestacks against a clear blue sky, with red warning lights on the stacks' rims
Data Engineering

Jul 18, 2022

Airflow DAG Python Factory

Diagram depicting a Terraform configuration for Google Cloud Platform (GCP). It shows a multi-provider setup with one main 'Google Provider (ops)' connecting to three separate service account providers labeled 'SA p1', 'SA p2', and 'SA p3', each linked to their own GCP resources within an 'ops' project environment
Infra & DataOps

Jul 11, 2022

Terraform provider using multiple credentials

Flowchart depicting an Airflow Directed Acyclic Graph (DAG) for data processing with stages for ingestion, data quality checks using 'Great Expectations,' followed by dbt run stages for staging layer, data warehouse, and datamart layer. The DAG concludes with optional PubSub, Python, and other unspecified operators for further data operations.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 3

Diagram depicting a multi-layered Google Cloud data architecture for a company, highlighting different project environments such as sandbox, user acceptance testing, and production, with data flowing through landing zones, staging, warehouses, and datamarts, managed via Virtual Private Clouds.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 2

An infographic outlining a data engineering pipeline on Google Cloud, where data moves from sources like PostgreSQL and MongoDB through tools like Airbyte and dbt for transformation in BigQuery, to be finally distributed by applications like Looker and Vertex AI, orchestrated by Apache Airflow.
Google Cloud

Jul 4, 2022

dbt at scale on Google Cloud — Part 1

Subscribe and stay updated with the latest articles

Subscribe and stay updated with the latest articles

Subscribe and stay updated with 

the latest articles

Graphic illustration on a blue background depicting a black radar dish with signal lines connecting to white envelope icons, representing the concept of sending or receiving communications.