Senior Data Platform Engineer · Lakehouse, Data Products & Multi-Cloud Platforms
Essid Solutions Unipersonal LDA · Lisbon, Portugal · essidsolutions.com
12+ years designing and operating cloud-native lakehouse and analytics platforms across AWS, Azure, and GCP — banking, insurance, telecom, and enterprise consulting.
- Databricks Certified Data Engineer Professional
- AWS Certified Data Engineer – Associate
- Certified Airflow DAG Authoring (Astronomer)
- Elasticsearch Certified Engineer
Apache Airflow · Apache Spark · Apache Kafka · Trino · Databricks · Docker · Kubernetes · dbt · Delta Lake · Apache Iceberg · BigQuery · Terraform · Data contracts · GDPR-aligned governance
| Repository | Description |
|---|---|
| data-fabric-patterns | Self-service ingestion, DDL generation, and governed data-product patterns |
| trino-sql-platform-patterns | Trino/Starburst SQL workloads, materialized views, and cost guardrails |
| databricks-lakehouse-patterns | Databricks jobs, Delta Lake maintenance, medallion notebooks, cluster policies |
| iceberg-lakehouse-patterns | Apache Iceberg DDL, partitioning, and snapshot maintenance |
| kafka-streaming-patterns | Kafka streaming ingestion, DLQ, dedup, IoT telemetry examples |
| gcp-bigquery-patterns | BigQuery partitioning, incremental MERGE, Cloud Composer DAGs |
| lakehouse-terraform-kit | Multi-cloud lakehouse IaC — Azure ADF/Data Lake and AWS Glue/S3 modules |
| airflow-platform-standards | Standardised DAG factory and authoring guide for large orchestration estates |
| data-contracts-governance | Data contracts, quality checks, lineage stubs, and PII handling patterns |
| data-platform-docker-starter | Docker Compose local stack — Airflow, Postgres, MinIO S3-compatible storage |
| kubernetes-data-platform | Kubernetes Spark CronJobs, ConfigMaps, and prod overlays for batch workloads |
Building platform capabilities for governed data products and self-service ingestion on a global insurance data fabric programme — reusable Python libraries, orchestration standards, and GDPR-aligned access models across distributed engineering squads.
Senior individual contributor and technical lead roles in lakehouse / data platform engineering
Essid Solutions Unipersonal LDA · Registred in Portugal · TVA: PT516462121