Senior Track Lead

About the role

Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization. Apply best practices during design in data modeling (logical, physical) and ETL pipelines (streaming and batch) using cloud-based services especially Python & Pyspark

What you'll do

• Design of data solutions on Databricks including delta lake, data warehouse, data marts and other data solutions to support the analytics needs of the organization
• Apply best practices during design in data modeling (logical, physical) and ETL pipelines (streaming and batch) using cloud-based services especially Python & Pyspark
• Design, develop and manage the pipelining (collection, storage, access), data engineering (data quality, ETL, Data Modelling) and understanding (documentation
• Design Analytics / Gold Layer using DBT models, macros and manage it following best practice. Implement DQ and unit test in dbt
• Interact with stakeholders regarding data landscape understanding, conducting discovery exercises, developing proof of concepts, and demonstrating it to stakeholders

What you need

• Python
• Data modelling
• ETL
• AWS
• Databricks
• dbt
• Any graduate

Good to have

• SQL
• VBA
• Data warehousing
• Spark