crucial role in designing and implementing robust ETL processes to streamline data integration and support trong>
and lineage documentation which will be used by ETL developers to build out the data warehouse Produce and design/technical documents Design and create ETL/ELT scripts for data warehouse and reporting tables Identify and test for defects and bottlenecks in the ETL solution to ensure high performance and no data quality quality concerns Provide support and fix ETL/ELT issues Relevant degree and certification Knowledge of relevant environment applying relevant skills 5 years ETL experience Indepth knowledge of systems architecture
responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust g>
such as Kafka, AWS
languages such as Python and Big Data pipelines such as ETL, SQL, Spark, etc. You will be developing API's to affecting the entire organisation. Expertise in API and ETL development Git development branching strategies
architect scalable BI solutions. From data modeling and ETL processes to dashboard development and performance
business requirements
Building and maintaining ETL pipelines to ensure data integrity and consistency
Proficiency in SQL, ETL tools, and BI platforms (e.g., Power BI, Tableau
responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust of the ETL and data pipeline in line with business user specifications Develop and implement ETL pipelines evaluating hardware and Enhance and maintain our existing ETL frameworks in line with agreed design Ensure data data warehouses Adept at design and development of ETL processes SQL development experience SAS data studio
Excel
Enhance existing Extract, Transform, and Load (ETL) and data validation frameworks. Requirements Bachelor's Tools, preferably Microsoft Power BI. Proficiency in ETL processes and tools. Strong knowledge of Programming
project flow