Azure Data Engineer - Stellenbosch
Be Different Recruitment
Reference: JHB006151-MM1-4Our client leading software development house in the online gaming world is urgently looking for Data Engineer to plan and build the infrastructure and data pipelines for medium complexity data solutions that collects, process store and transform raw, unstructured data into formats that can be consumed by downstream data analysis teams. This role will also contribute to the continuous improvement of data engineering practices through planning, alignment with key stakeholders, research and analysis of performance measures.This role is based in Cape Town - Century City. Hybrid working model of 3 days in the office and 2 days at home. This is a client that is very employee centric. They have a global presence and growing their business. There are great opportunities for grow within their business. They have offices in Umlanga and Pretoria too. In order to be considered the following is required: BSc in Computer Science or Information Systems 2 – 4 years of experience In-depth skills in n the design, implementation and maintenance of complex data engineering solutions to acquire and prepare data Demonstrates a high level of domain knowledge to guide others on the required data engineering techniques to create and maintain data pipelines and extract, transform and load data Able to guide on the best application of data standards including security, and data governance Ability to apply a detailed understanding of a specific domain, the data applicable to the domain and the meaning of the data for the organisation to enhance success, improve decision making and deliver insights In-depth understanding of relevant data engineering best practices and tools In-depth knowledge of optimal extraction, transformation, and data loading Knowledge of data-pipeline architectures Skills required: Apache Spark Microsoft Azure Kafka Elk Stack No SQL Python Databricks Scala SQL Data Modeling Microsoft SQL Server SQL programming languages Data warehousing solutions Data pipelines Splunk Data Cleansing Terraform Responsibilities:Data Engineering: Gather, document and analyse business and system requirements for medium complexity projects to understand and verify their feasibility, validity and alignment to product or service roadmaps Design and build data solutions of medium complexity with minimal supervision that adheres to data compliance requirements (involving multiple technologies, data sources and consumers) consisting of the following: Infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and Azure ‘big data’ technologies under supervision from seniors Data pipelines to extract, transform and load into data warehouses or lakes for consumption by downstream business analysis solutions BI and AI solutions using existing cloud provided services to serve data effectively to consumers Resolve or escalate data issues logged by users to ensure the availability of accurate data sets Maintain, tune and adapt pipelines and data stores to keep them performing to specifications Work with stakeholders to assist with data-related requirements and support data infrastructure needs Monitor costs and refine solutions to optimise data processing costs Planning & Direction: Creates and drives technical delivery plans for multiple data solutions to support the data services strategy execution plan Plan and manage data engineering projects from inception to closure to ensure these are delivered on time, within scope and meeting the solution requirements Knowledge, Practices and Continuous Improvement: Align and implement the organisation's data engineering practices to ensure adherence to the company's processes, tools, methods, standards Analyse performance measures to track and improve the of effectiveness and efficiency of data engineering services and recommend improvements Conduct research and analyse data to identify trends, new methods and standards and recommend these to improve data engineering practices Deliver training to assist business stakeholders with the use of data engineering solutions Stakeholder Management: Obtain feedback from stakeholders on data engineering services provided to ensure alignment on the value provided Drive change management initiatives to ensure stakeholder adoption and benefit realisation Identify root causes, resolve issues and risks and communicates with stakeholders to ensure problems are resolved without reoccurrence If you would like to email your CV directly – please send it to millermbedifferent.co.za Information displayed above not limited to advertisement. Please consider your application as unsuccessful if you have not received a response within 14 days of submitting your application. However, please keep a lookout on our website, www.bedifferent.co.za, for available positions which you may be suited for. R 600000 - R 1200000 - Annually plus Medical Aid - company subsidy, Provident Fund, Performance Bonus, Training, Lunch allowance
Apply Now
Facebook
WhatsappRelated Jobs
Sql Administrator Stellenbosch - South Africa
Oxbridge Academy
...
Data Analyst - Stellenbosch
...
Senior Business Systems Analyst Bellville - Bellville
QE Services
...
Data Warehouse Business Analyst - Durbanville
...
Data Analyst Cape Winelands: Stellenbosch - Stellenbosch
Network IT
...