Role Overview
We are seeking a highly skilled and motivated Data Engineer with 5–7 years of experience
to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will
have strong expertise in SQL, Databricks, Confluent (Kafka), Azure Data Factory (ADF), and
Azure Data Lake Storage (ADLS), with a solid understanding of banking domain processes
and regulatory considerations. This role involves working closely with cross-functional
teams to enable data-driven decision-making across critical banking functions.
Key Responsibilities
Design, develop, and maintain robust, scalable data pipelines using Azure Data Factory
(ADF) and Databricks
Implement batch and real-time data ingestion frameworks leveraging Confluent Kafka
Build and optimize data models, transformations, and ETL/ELT pipelines using SQL and
Spark
Develop and manage data storage solutions in Azure Data Lake Storage (ADLS)
Ensure high data quality, integrity, and governance standards
Support data integration across systems including core banking and CRM
Optimize performance of large-scale datasets
Collaborate with stakeholders to translate requirements into solutions
Ensure compliance with banking regulations and data privacy
Troubleshoot production issues
Required Skills & Experience
Strong expertise in SQL (complex queries, tuning, modeling)
Hands-on experience with Databricks, Spark, PySpark
Experience with Confluent Kafka and event-driven architecture
Experience with Azure Data Factory (ADF)
Experience with Azure Data Lake Storage (ADLS)
Understanding of data warehousing concepts
Familiarity with CI/CD and DevOps for data platforms
Domain Knowledge (Preferred)
Experience in banking or financial services
Understanding of core banking systems
Knowledge of payments, lending, wealth management
Awareness of regulatory frameworks (KYC, AML)
Soft Skills
Strong analytical and problem-solving skills
Excellent communication and stakeholder engagement
Ability to work in fast-paced environments
Strong ownership and collaboration mindset
Qualifications
Bachelor’s or Master’s degree in relevant field
Azure/Data engineering certifications preferred
Good to Have
Experience with Python or Scala
Exposure to data governance tools
Knowledge of APIs and microservices
Experience with BI tools like Power BI
Key Success Indicators
Delivery of scalable pipelines
Improved data reliability
Reduced data latency
Alignment with business requirements
