Key Responsibilities:

Design, Develop, and Optimize Data Pipelines: Lead the design, development, and management of robust cloud and on-premises data pipelines, ensuring efficiency and accuracy in support of our data strategy.
Ensure Data Quality and Consistency: Implement data validation processes, enforce data guidelines, and monitor for inconsistencies to maintain high-quality data.
Azure DevOps Repos and CI/CD Integration: Utilize Azure DevOps Repos for version control and Azure Pipelines for CI/CD practices, ensuring seamless integration and automation.
Technical Leadership: Mentor junior and intermediate engineers, lead technical solutions, and resolve complex issues to build a strong, skilled team.
Stakeholder Engagement: Foster relationships across the business to align stakeholders with data engineering objectives.
Project Management: Plan, coordinate, and execute tasks to ensure successful project completion and manage timelines effectively.

Required Skills:

Cloud Technology: Expertise in Azure services (Data Factory, Databricks, Data Lake, SQL Databases, Azure DevOps). Experience with Apache Spark is essential; knowledge of GCP and AWS is a plus.
Programming Languages: Proficiency in Python and SQL, with exposure to PySpark.
Commercial Acumen: Ability to develop solutions independently and provide technical assistance with an understanding of business objectives.

Education and Experience:

Education: Grade 12/SAQA Accredited Equivalent (Essential); 3-year Degree in IT, Sciences, Informatics, or Computer Sciences (Essential); Masters degree (Advantageous).
Experience: 5+ years in data engineering, data science, or computer science (Essential); experience in the Financial Services Industry, especially Short-Term Insurance (Advantageous).

Why Join Us?:

Innovative Environment: Work on exciting projects in a forward-thinking company.
Leadership Role: Take charge and lead a dynamic team of talented engineers.
Professional Growth: Access to extensive development opportunities and career advancement.

Ready to lead and innovate? Apply now and become a key player in our data engineering success story! Apply Now

Share this job with someone you think should apply!