Open assignment

Lead Data Platform Engineer

Posted

You will own, operate, and evolve a data platform built on Google Cloud, supporting a commercial, data-driven product. The role ensures reliable data ingestion, scalable data modeling, and high-quality data availability for analytics and BI.

You act as the technical owner of the data platform and a key link between data engineering, analytics and the business.

Key Responsibilities

  • Own and maintain the end-to-end data architecture on Google Cloud (BigQuery, Cloud Storage, Cloud Functions)
  • Design and operate scalable ETL/ELT pipelines using dbt
  • Ingest, process, and model mobility and traffic data, including large-scale and real-time data sources
  • Transform raw data into curated, analytics- and product-ready datasets using modern data modeling practices
  • Ensure data quality, testing, documentation, and governance across the platform.
  • Support downstream analytics, BI, and customer-facing insights in Qlik Sense
  • Enable internal and product-related tools using Python and Streamlit (optional)
  • Manage access control, security, and cost optimization for a production-grade data platform.
  • Drive the technical roadmap for a data platform that directly supports a commercial offering.

Required Technical Skills

  • Experience working with mobility, traffic, or transportation data
  • Familiarity with real-time feeds such as geospatial datasets (e.g. vehicle positions, traffic flows, sensor data)

Cloud Data Platform

  • Google Cloud Platform: BigQuery, Cloud Storage, Cloud Functions
  • BigQuery GIS and geospatial data handling
  • IAM, service accounts, cost optimization

Data Engineering

  • dbt (modeling, testing, documentation)
  • Advanced SQL
  • Data modeling
  • Batch and real-time data pipelines

Programming

  • Python for data pipelines, Cloud Functions, and prototyping

Analytics Visualization

  • Qlik Sense (data modeling and backend)
  • Optional) Streamlit for internal and product-related applications

Other

  • Git and CI/CD for data platforms
  • Experience operating data systems in production environments

Other desired skills

GCP (Google Cloud Platform)DBT (Data Build Tool)SQL (Structured Query Language)QlikCI/CD (CICD)GitPythonETL (Extract transform and load)Data analysis
Questions about this assignment?
Consultant hiring processes are often quick. We recommend that you apply and share your questions in the note in your application to make sure you don't miss out.

Other open assignments

Not right for you?

Create a Commended.ai profile and become visible within minutes inside all our clients' not-yet-published assignments.

Register