Data Engineering Tech Radar

An opinionated snapshot of the data engineering ecosystem. Based on hands-on experience building production pipelines, lakehouses, and AI infrastructure.

Last updated: April 2026

Quadrant

Ring

24 technologies

Legend

Adopt- Use in production

Trial- Try in projects

Assess- Research and evaluate

Hold- Avoid for new projects

↑ Moved up since last update↓ Moved down since last update

Data Engineering Tech Radar

Apache Spark / PySpark

dbt Core

Databricks (Unity Catalog)

Snowflake

PostgreSQL

Apache Airflow

Terraform

GitHub Actions

Docker / Containers

Claude API / Anthropic↑

RAG (Retrieval-Augmented Generation)

MLflow

Polars↑

DuckDB↑

BigQuery

Apache Iceberg↑

Supabase

Kafka / Debezium

LangChain / LangGraph

Streamlit

Apache Flink

Dagster↑

Agentic AI↑

pandas↓

Legend

Get notified when the stack shifts and the radar changes.