Databricks Data Engineer - Bengaluru
BengaluruFull-time2–5 yrsPosted over a month ago
Mid-level data science role at Omnissa in Bengaluru. Needs 2+ years.
About the role
The world is evolving fast, and organizations everywhere—from corporations to schools—are under immense pressure to provide flexible, work-from-anywhere solutions. They need IT infrastructure that empowers employees and customers to access applications from any device, on any cloud, all while maintaining top-tier security.
What you'll do
- Build and operate end-to-end data pipelines on the Lakehouse — ingestion, transformation, and serving — across AWS and Databricks
- Design and develop interactive, insightful dashboards and reports in Tableau/Superset for a mixed technical and business audience
- Write efficient, scalable, secure SQL and Python, processing large datasets with Databricks (Spark) and federated engines like Starburst/Trino/AWS Athena
- Model and manage data in open table formats (Apache Iceberg, Delta Lake), optimizing for cost and performance
- Orchestrate workflows with Apache Airflow and Databricks Workflows; ship changes through GitHub Actions CI/CD
What you need
- Databricks
- SQL
- Python
- AWS
- Spark
- Airflow
Good to have
- CI/CD
- LLMs
- Dashboarding
- Tableau
- Power BI
- Unity