Your responsibilities
We are looking for an experienced Senior Data Engineer (F/M/D) who will be responsible for building and maintaining robust data pipelines, optimizing SQL queries, and ensuring seamless data flow across our CELUS design platform. You will work closely with cross-functional teams to understand data requirements, implement ETL processes, and contribute to the overall improvement of our data architecture.
Your responsibilities in the position will include:
- Design, develop, and maintain scalable and efficient ETL pipelines using Databricks, and Spark.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure the delivery of high-quality data.
- Proactively identify opportunities for process improvement and implement solutions to enhance the overall efficiency of data workflows.
- Utilize excellent SQL skills to optimize queries, enhance database performance, and troubleshoot issues.
- Work with various databases, including MongoDB and Postgres, to manage data storage, retrieval, and maintenance.