Finance Concern in Joburg seeks a highly technical Data Engineer whose core role will be to drive, design ETL systems for a Big Data warehouse to implement robust & trustworthy data to support high performing algorithms, predictive models and support real-time data visualisation requirements across the organisation experience and understanding in designing and developing data warehouses according to the Kimball methodology processes. SQL development experience, preferably SAS data studio and AWS experience including in-depth knowledge
Linux / Unix
- Big Data
- Powershell / Bash
- Cloud Data Hub (CDH)
- CDEC Blueprint
- Expertise in data modelling with Oracle SQL.
- Exceptional analytical
complex data sets.
- Thorough testing and data validation to ensure the accuracy of data transformations
Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV, etc.
- Experience with Data Quality
APIs.
- Experience building data pipelines using AWS Glue or Data Pipeline, or similar platforms.
space and has embarked on an exciting, strategic, data modernization program that will equip them to better looking for someone who can help to ensure that the Data Services deliveries to both internal and external functional, non-functional, and business aspects of the data pipeline and analytics solutions. Identify areas to validate the functionality, performance, and data integrity of the Azure Databricks environment. Utilize reliability of the data pipeline. Data Validation and Quality Assurance: Develop automated data validation scripts
An amazing opportunity for a Senior Data Engineer to join a multinational organization that produces work with feature teams to design and implement data extraction, cleaning, analysis, visualization, and database types to target data containers for the purpose of migrating data to cloud technologies If you Assist in creating data pipelines from source to target platforms. Experience in Data validation and verification to transform data from source to target for analytical purposes (Business Objects/Data Lakes) and migration
some Python and AWS data engineering experience, as everything will be related to data ingestion, storage
Role : AWS Data Engineer Location : Johannesburg [ 3 Days in a week from office] Duration : 12 Months are seeking a highly motivated and experienced AWS Data Engineer to join our Global Markets division. In quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs contributing to the design and implementation of data pipelines to support global markets business. It
ITE005925-TMo-1 Looking for a brilliant and inspiring Data Analyst to work in a high tempo and demanding environment / Auditing / Data Science as majors) Job Experience & Skills Required: 5 years data analytics experience SQL, Power BI Experience in data auditing/process auditing through data analytics. Management/Review
to address business challenges.
institution in South Africa, is seeking a Data Solutions Architect to join Purpose
Responsibilities:
Senior Data Engineer Are you a talented senior data engineer looking for your Dream Developer Job? OfferZen working as a data engineer Hands-on, practical experience dealing with large amounts of data Experience Experience with big data tools: Hadoop, Spark, Kafka, etc. Experience working in an English speaking environment working with SQL and NoSQL databases Experience with data pipeline and workflow management tools: Azkaban detail Strong analytical skills Ability to combine data from different sources Nice to have: Experience