Data Engineering- SSEII
BengaluruFull-time5–9 yrsPosted over a month ago
Senior data science role at First American in Bengaluru. Needs 5+ years and a B.Sc, B.Tech or B.E..
About the role
Data Engineering- SSEII at First American. Operationalize our Databricks Lakehouse: Develop and maintain a unified data platform using Azure Databricks, enabling efficient data storage, processing.
What you'll do
- Operationalize our Databricks Lakehouse: Develop and maintain a unified data platform using Azure Databricks, enabling efficient data storage, processing
- Build Data Pipelines: Design, develop, and maintain scalable data pipelines; establish API integrations for efficient data transfer
- Implement ETL processes and ensure data integrity and quality
- Deploy Data Technology: Utilize technologies such as Spark, Kafka, and Airflow to manage large-scale data processing. Test
- Collaborate: Work closely with data engineers, analysts, and scientists to understand their needs and optimize the performance of data workflows
What you need
- ETL
- Databricks
- Spark
- Airflow
- Docker
- Kubernetes
Good to have
- Python
- Snowflake
- BigQuery
- Hadoop
- Redshift
- C#