responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust g>
investigating possible improvements, and building new ETLs. Scope: Daily call management to address any issues environment and models (SLA management). Building new ETLs to support the integration of additional data sources
physical data model and extract, transform and load (ETL) processes. They will build data dictionaries, company's metadata repositories, data integration processes and ETL processes and ensure data quality. This employee
responsibility for driving, designing and building scalable ETL systems for a big data warehouse to implement robust of the ETL and data pipeline in line with business user specifications Develop and implement ETL pipelines evaluating hardware and Enhance and maintain our existing ETL frameworks in line with agreed design Ensure data data warehouses Adept at design and development of ETL processes SQL development experience SAS data studio
Ref: TJ 392498 - ETL DEVELOPER/DATA INTEGRATOR/DATA SCIENTIST – LEAD Employer Description IT consulting Integration Studio Methodologies: Agile Scrum, Kanban, ETL (Extract, Transform, Load), Real Time Integration
design, build and implementation of the mapping, ETL programming from the source systems to the Data Warehouse Industry preferred) Minimum 3 years ' experience with ETL tools and data integration; Ability to analyze data
enhancing existing Extract, Transform, and Load (ETL) and data validation frameworks. Requirements Bachelor's Tools, preferably Microsoft Power BI. Proficiency in ETL processes and tools. Strong knowledge of Programming
(required) Exposure to AWS Glue, a Spark based serverless ETL engine and service Exposure to AWS Code Commit and
Perform data extraction, transformation, and loading (ETL) operations Analyze complex data sets to identify in a similar BI Analyst role Strong knowledge of ETL data flow processes Demonstrable experience in identifying
Requirements: · Terraform; Python 3x; Py Spark · Boto3; ETL · Docker; Linux / Unix; Big Data; Powershell / Bash importance): · Trino Distributed SQL queries. · Glue (ETL Scripting) · CloudWatch; SNS · Athena; S3 · Kinesis