What You'll Do:Design, Develop, and Optimize Data Pipelines

Lead the design, development, and management of both cloud and on-premises data pipelines.
Ensure the creation of accurate, efficient, and cost-effective data systems that support data scientists, analysts, actuaries, and other key initiatives.

Ensure Data Quality and Consistency

Implement robust data validation processes to maintain high-quality data.
Establish and enforce data collection, integration, and retention guidelines.
Regularly monitor data sources and processing environments, resolving inconsistencies or anomalies.

Leverage Azure DevOps Repos and CI/CD Integration

Utilize Azure DevOps Repos for effective version control and collaborative development.
Implement CI/CD practices using Azure Pipelines to automate build and deployment processes.
Ensure seamless integration between code repositories and deployment pipelines.

Engage with Stakeholders

Build and nurture relationships across the business to foster a collaborative environment.
Align stakeholders with data engineering objectives and strategies.
Drive the success of our data initiatives through effective engagement and communication.

Personal Capability Building

Participate in professional development activities and gain or maintain relevant external accreditations.
Stay updated on relevant technology, regulations, and industry best practices.
Upskill in all facets of data engineering to enhance performance and fulfill personal potential.

Skills You Bring:Cloud Technology

Expert knowledge in Azure services such as Azure Data Factory, Databricks, Data Lake, SQL Databases, and Azure DevOps.
Experience with large-scale data processing using Apache Spark.
Knowledge of GCP and AWS is a plus but not essential.

Programming Languages

Education and Experience:Education

Grade 12/SAQA Accredited Equivalent (Essential).
3-year degree in Information Technology, Sciences, Informatics, or Computer Sciences (Essential).
Masters Degree in related fields (Advantageous).

Experience

2 to 5 years of experience in data engineering, data science, or computer science (Essential).
Experience in the Financial Services Industry, especially Short-Term Insurance (Advantageous).

Apply Now

Share this job with someone you think should apply!