An exciting opportunity has come up for a Data Engineer with extensive experience in Databricks Azure
insights from raw data sources with a focus on collecting, managing, analysing, visualising data and developing optimising the organisations data and data pipeline architecture, whilst optimising data flow and collection to to ultimately support data initiatives.
Exciting opportunity for a Data Engineer to join our client’s team on a 6-month contract. Candidate must have advanced knowledge of T24 architecture and Data from a MOD perspective. Position is remote. You will be required to: Analyse and organize raw data Build data systems and pipelines Evaluate business needs and patterns Conduct complex data analysis and report on results Prepare data for prescriptive and predictive Explore ways to enhance data quality and reliability Identify opportunities for data acquisition Develop
/>**Responsibilities:**
- Architect data systems for strategic insights.
- Collaborate
Collaborate for process optimization.
- Ensure data quality and compliance.
**Requirements:**
/>- Post Grad Degree in IT.
- Experience in data analysis and AWS.
- Strong communication skills
preferably in a financial background as a Data Engineer.
Education: Bachelors
Technology, Computer Science, Software Development, Engineering, or a related field.
Job Description:
Data Architecture & Data Engineering:
for batch data processing and created Glue Catalog for metadata sync up
enterprise standard ETL/ ELT processes as well as data lakes and a focus on code-based techniques and collaborative infrastructure.
years' experience in data engineering
Data Engineer - Gauteng Locations: Centurion l Johannesburg l Cape Town Working model: Hybrid Specification: Specification: The Data Engineer will have a knack for data analysis, data manipulation, and data modelling. experience as a Data Engineer / Database Developer. Experience in data mining, large scale data modelling and working experience in data integration and transformation. Experience implementing data modelling methodologies Modelling and / or Data Vault. Working knowledge of data quality processes and master data management. Experience