Linux / Unix
- Big Data
- Powershell / Bash
- Cloud Data Hub (CDH)
- CDEC Blueprint
- Expertise in data modelling with Oracle SQL.
- Exceptional analytical
complex data sets.
- Thorough testing and data validation to ensure the accuracy of data transformations
Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV, etc.
- Experience with Data Quality
APIs.
- Experience building data pipelines using AWS Glue or Data Pipeline, or similar platforms.
industry is currently looking for a Project Manager (Data Centre) to be based in Cape Town on a Fixed Term Experience in leading teams. 3 years' Experience in Data Centre Construction – Essential. FIDIC, NEC3, JBCC
We are looking for a Data Analyst to join our client in the mining/construction industry based in Elandsfontein Johannesburg. Create data models and reports in a structured data format to enable data ingestion, transformation key business metrics and trends. Identify valuable data sources and automate collection processes, design understandable data visualization techniques. Design and implement data quality and data validation within the reports to ensure accuracy and consistency of data. Operate within various departments and assist in
space and has embarked on an exciting, strategic, data modernization program that will equip them to better looking for someone who can help to ensure that the Data Services deliveries to both internal and external functional, non-functional, and business aspects of the data pipeline and analytics solutions. Identify areas to validate the functionality, performance, and data integrity of the Azure Databricks environment. Utilize reliability of the data pipeline. Data Validation and Quality Assurance: Develop automated data validation scripts
An amazing opportunity for a Senior Data Engineer to join a multinational organization that produces work with feature teams to design and implement data extraction, cleaning, analysis, visualization, and database types to target data containers for the purpose of migrating data to cloud technologies If you Assist in creating data pipelines from source to target platforms. Experience in Data validation and verification to transform data from source to target for analytical purposes (Business Objects/Data Lakes) and migration
that align with strategic objectives. Dive into data analysis to uncover insights and fine-tune digital Cultivate a comprehensive documentation culture, capturing processes, requirements, and project milestones digital transformation with a focus on innovative, data-driven solutions. Understanding of digital technologies complemented by an entrepreneurial mindset and passion for data-driven decision-making. Excellent communication website - www.parvana.co.uk . Data Analyst, Digital Transformation, PM Tools, Data-Driven
Our client requires the services of a Data Engineer/Scientist ( Expert) - Midrand/Menlyn/Rosslyn/Home as possible ROLE: Data Engineers are responsible for building and maintaining Big Data Pipelines using using GROUP Data Platforms. Data Engineers are custodians of data and must ensure that data is shared in line Boto3 ETL Docker Linux / Unix Big Data Powershell / Bash GROUP Cloud Data Hub (CDH) GROUP CDEC Blueprint Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV. Experience working with Data Quality Tools
some Python and AWS data engineering experience, as everything will be related to data ingestion, storage
the strong leadership of a highly technical Senior Data Engineer to join its team. You will be responsible infrastructure and systems that enable efficient data processing, storage, and retrieval. You will also help ensure the availability and reliability of data for analysis and decision-making. The successful similar discipline with 4-5years' work experience in Data Engineering, Database Administration, or a related or Informatica. DUTIES: Data Architecture and Modeling - Design and develop data architectures that support
Role : AWS Data Engineer Location : Johannesburg [ 3 Days in a week from office] Duration : 12 Months are seeking a highly motivated and experienced AWS Data Engineer to join our Global Markets division. In quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs contributing to the design and implementation of data pipelines to support global markets business. It