Product-Based Company
Data Engineer
BengaluruFull-timePosted yesterday
- Eligibility
- Not stated
- Batch
- 2021 and earlier
- Experience
- 5–12 years
- Salary
- ₹50 LPA to ₹1+ crore per annum
How well do you fit this role?
Your resume against this posting — what you have, what’s missing, and a short plan to close the gap.
PDF or text, up to 4 MB. It stays in this browser — nothing is saved to your account.
About this role
About the role
- You'll architect and construct data systems that move, transform, and store information at scale across cloud infrastructure
- Your focus spans the full lifecycle of data pipeline development, from initial design through performance tuning and ongoing maintenance
- You'll partner with stakeholders to translate business needs into robust, efficient data workflows
What you'll work on
- Building and refining ETL workflows that ingest, process, and load data into enterprise systems
- Optimising pipeline performance using Apache Spark and Delta Lake for reliable, fast data operations
- Designing solutions within Azure's ecosystem, leveraging Data Factory for orchestration and Data Lake Storage for distributed data management
- Writing SQL queries and PySpark code to transform raw data into analysis-ready datasets
- Collaborating on architectural decisions to ensure data platforms meet reliability and scalability requirements
What we're looking for
- Hands-on experience building and maintaining production data pipelines
- Proficiency with Databricks as a unified analytics platform
- Strong command of SQL and Python with PySpark
- Proven track record optimising Apache Spark jobs and data workflows
- Working knowledge of Azure Data Factory and Azure Data Lake Storage
- Understanding of ETL methodologies and Delta Lake for ACID transactions
- Comfort working within cloud-native data platforms and their design patterns