Our client requires the services of a Data Engineer/Scientist (Senior) – Midrand/Menlyn/Rosslyn/Home as possible ROLE: Data Engineers are responsible for building and maintaining Big Data Pipelines using using GROUP Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line Oracle/PostgreSQL Py Spark Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash Experience in working with Enterprise Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV etc. Experience working with Data Quality
Our client requires the services of a Data Engineer/Scientist ( Senior ) - Midrand/Menlyn/Rosslyn/Home as possible ROLE: Data Engineers are responsible for building and maintaining Big Data Pipelines using using GROUP Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line Unix Big Data Powershell / Bash ADVANTAGEOUS TECHNICAL SKILLS Demonstrate expertise in data modelling complex data sets. Perform thorough testing and data validation to ensure the accuracy of data transformations
Ability to develop in Data Drive Programming languages such as Python and Big Data pipelines such as ETL Working Model (AWM) Charter ADVANTAGEOUS SKILLS Data and API Mining Knowledge on Security best practices setting up alerting pipelines. Be comfortable with Data Structures and Algorithms Understanding of integration Docker container creation and usage Familiar with data streaming services such as Apache Kafka Coordination Knowledge of Jira, Confluence and Agile methodologies Data Analysis ITSM knowledge User support ticket management
Identify and document the mainframe applications and data sets to be migrated. Ensure projects/ maintenance issues. Ensure compliance with GROUP regulations and data protection standards during the migration process strategy for migrating mainframe data to the cloud, considering data integrity, security, and minimal best practices for the cloud environment. Ensure data encryption, access controls, and compliance with
management and maintenance and preparation of test data. Coordination between development and support environments end (Web), back end (API) and integration. Test data management. Performance, security and load testing elicitation, documentation. Business process modelling, data modelling IT Architecture: Cloud Architecture, On-prem/hybrid
input in terms of benefits and risks. Preparing test data for testing of user stories Execute and/or support process owners Preparing cut-over strategy, e.g., data migration Go-Live preparation and post Go-Live Support
JSON, RFC, IDOCs) Workflow SAP S/4HANA skills Core Data Services & AMDP Database update programming management Solution architecture, design, and development Data Modelling Excellent debugging and troubleshooting
performance and worked with Software installation Capture tools Experience in optimisation of functional
to analyze and troubleshoot potential solutions. Data analytics and trend analysis Presentation skills
to analyze and troubleshoot potential solutions. Data analytics and trend analysis Presentation skills