AWS Data Engineer - North Johannesburg
SPECD Ltd
An urgent need exists for an AWS DATA ENGINEER position at a bank in Johannesburg. The AWS Data Engineer will join the Global Markets division of the bank. In this role, you will work closely with the traders, quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines for the global markets business. The role o ff ers an exciting opportunity to collaborate with leading financial institutions, contributing to the design and implementation of data pipelines to support global markets. JOB DESCRIPTION: Job Title: AWS Data Engineer Employment Type: 3 Months Contract (Renewable), Hybrid Work Location: Johannesburg, Sandton DUTIES AND RESPONSIBILITIES: Creating data models that can be used to extract information from various sources and store it in a usable format. Lead the design, implementation, and successful delivery of large‐scale, critical, or difficult data solutions involving a significant amount of data. Utilize expertise in SQL and have a strong understanding of ETL and data modelling. Ability to ingest data into AWS S3, perform ETL into RDS or Redshift. Use AWS Lambda (C# or Python) for event‐driven data transformations. Designing and implementing security measures to protect data from unauthorized access or misuse. Maintaining the integrity of data by designing backup and recovery procedures. Work on automating the migration process in AWS from development to production. You will deliver digestible, contemporary, and immediate data content to support and drive business decisions. You will be involved in all aspects of data engineering from delivery planning, estimating and analysis, all the way through to data architecture and pipeline design, delivery, and production implementation. From day one, you will be involved in the design and implementation of complex data solutions ranging from batch to streaming and event‐driven architectures, across cloud, on‐ premises and hybrid client technology landscapes. Optimize cloud workloads for cost, scalability, availability, governance, compliance, etc. QUALIFICATION AND EXPERIENCE REQUIRED: 5 Years Python/C# Development. 3 Years AWS Data Engineering Education. Global Markets experience is preferred. Creation of Data products. 5 Years Data Analysis experience. MANDATORY SKILLS : AWS Glue Jobs using PySpark or AWS Glue Spark Strong SQL and C# or Python programming knowledge Expert knowledge of data engineering packages and libraries and related functions in C# or Python. AWS technical certifications. Experience with development and delivery of microservices using serverless AWS services (S3, RDS, Aurora, DynamoDB, Lambda, SNS, SQS, Kinesis, IAM). SQL Server and MySQL. Apply knowledge of scripting and automation using tools like PowerShell, Python, Bash, Ruby, Perl, Effectively and efficiently troubleshoot data issues and errors. Strong experience in SDLC delivery, including waterfall, hybrid, and Agile methodologies. Delivering data solutions and pipelines on AWS Cloud Platform. Understand of data modelling, data structures, databases, and ETL processes. Delivering CI/CD and DevOps capabilities in a data environment. BENEFICIAL SKILLS : Realtime ingestion using KAFKA. Experience in the financial industry. AWS Certified Machine Learning – Specialty Certificate PACKAGE & REMUNERATION: Compensation will be determined based on qualifications, applicable experience, and previous earnings.
Apply Now
Facebook
WhatsappRelated Jobs
AWS Data Engineer EXP 0675 - Midrand
...
AWS Data Engineer Market related - Midrand
Cruze Control Technologies
...
Data Engineer Midrand - Midrand
Cruze Control Technologies
...
Data Engineer Midrand - Midrand
E-Merge IT Recruitment
...
Senior Analyst Data Sandton - Sandton
Datacentrix
...