Reference: ITE006125-KN-1 Elevate Your Career as a Data Engineer Are you ready to take on an exciting new challenge and make a significant impact in the world of data engineering? We're looking for a talented and driven individual to join our dynamic team What You'll Do: Design, Develop, and Optimize Data Pipelines Lead the design, development, and management of both cloud and on-premises data pipelines. Ensure the creation of accurate, efficient, and cost-effective data systems that support data scientists, analysts, actuaries, and other key initiatives. Ensure Data Quality and Consistency Implement robust data validation processes to maintain high-quality data. Establish and enforce data collection, integration, and retention guidelines. Regularly monitor data sources and processing environments, resolving inconsistencies or anomalies. Leverage Azure DevOps Repos and CI/CD Integration Utilize Azure DevOps Repos for effective version control and collaborative development. Implement CI/CD practices using Azure Pipelines to automate build and deployment processes. Ensure seamless integration between code repositories and deployment pipelines. Engage with Stakeholders Build and nurture relationships across the business to foster a collaborative environment. Align stakeholders with data engineering objectives and strategies. Drive the success of our data initiatives through effective engagement and communication. Personal Capability Building Participate in professional development activities and gain or maintain relevant external accreditations. Stay updated on relevant technology, regulations, and industry best practices. Upskill in all facets of data engineering to enhance performance and fulfill personal potential. Skills You Bring: Cloud Technology Expert knowledge in Azure services such as Azure Data Factory, Databricks, Data Lake, SQL Databases, and Azure DevOps. Experience with large-scale data processing using Apache Spark. Knowledge of GCP and AWS is a plus but not essential. Programming Languages Proficiency in Python and SQL. Exposure to PySpark is advantageous. Education and Experience: Education Grade 12/SAQA Accredited Equivalent (Essential). 3-year degree in Information Technology, Sciences, Informatics, or Computer Sciences (Essential). Master's Degree in related fields (Advantageous). Experience 2 to 5 years of experience in data engineering, data science, or computer science (Essential). Experience in the Financial Services Industry, especially Short-Term Insurance (Advantageous). Ready to transform your career and make a difference? APPLY now or send your CV directly to kndlelanetworkrecrutiement.co.za R 45 000 - R 52 000 - Monthly Apply Now

Share this job with someone you think should apply!

Facebook

Data Engineer Johannesburg North - North Johannesburg

Related Jobs

Senior Data Engineer Johannesburg North - North Johannesburg

Cloud Engineer Johannesburg North - North Johannesburg

Azure Cloud Engineer 1502 - Midrand

Azure Cloud Engineer Midrand - Midrand

Senior Data Engineer Fourways - Fourways

Want to do another search?