Data Engineer

About this role

Batch: 2018/2019/2020/2021/2022/2023/2024. Requirements: - Strong knowledge of SQL and relational databases such as PostgreSQL/MySQL - Programming experience with Python, Java, or Scala - Understanding of ETL/ELT, data pipelines, and data warehousing - Knowledge of databases and data modeling concepts - Familiarity with Apache Spark or other distributed data-processing frameworks - Understanding of batch and real-time data processing - Knowledge of APIs, JSON, CSV, and other data formats - Familiarity with Git and Linux/Unix - Strong problem-solving and analytical skills Preferred Skills: - Experience with cloud platforms such as AWS, Azure, or GCP - Knowledge of services such as S3, Redshift, BigQuery, Snowflake, or Databricks - Experience with workflow orchestration tools such as Apache Airflow - Knowledge of Kafka and real-time streaming - Familiarity with Docker and CI/CD - Understanding of data lake, data warehouse, and lakehouse architecture - Experience implementing data quality, monitoring, and pipeline observability