Job Summary
The Big Data Engineer is responsible for developing, maintaining, and optimizing data pipelines and data infrastructure to support reporting, analytics, and business intelligence across the organization. The role works with multiple data sources to ensure reliable, accurate, and accessible data for operational and management decision-making.
Key Responsibilities
- Develop and maintain scalable data pipelines using Python and Apache Spark for batch and streaming data processing
- Build and maintain data transformation workflows using dbt, ensuring data accuracy, consistency, and quality
- Extract, integrate, and validate data from multiple operational systems and databases across the organization
Qualifications
- Bachelor's degree in Computer Science, Data Engineering, Information Systems, Software Engineering, or a related field
- 2+ years of experience in Data Engineering, Data Integration, Business Intelligence, or a related technical role
- Strong knowledge of Python, SQL, Apache Spark/PySpark, and dbt
