Jobs in

Cloud Data Engineer Johannesburg - South Africa

Intellinexus

Who are we? Intellinexus is a business-led data and business intelligence consultancy that empowers organisations with data-driven decision-making capabilities. We combine innovation and expertise with access to the best talent to help organisations become smarter, more agile, and more resilient to the changes in their operating environments. Our expert teams apply a mastery of data and technology to craft strategies that revolutionise business decision-making, and give organisations access to real-time, actionable insights into the performance of their business. For more information, please visit www.intellinexusgroup.com  What do we offer? We offer both remote and hybrid work opportunities Intellinexus is an SME, therefore you get a lot of exposure to different technologies, solutions and techniques during projects. Intellinexus supports career development and growth of its employees, therefore time and money is invested to grow their consultants in their careers. Overall purpose of the role As a Data Engineer you will utilize your knowledge of Integrations, Automations, Data Management, Data Modeling. You will collaborate with the Business Intelligence team, Product Development teams, Cloud Operations teams, and the Data Engineering team to curate a high-quality dataset to serve your research. You'll advise and assist in Data management tools, practices, and strategy. Transform raw source data from various sources into an analytics-ready data model. This model will be built on the premise of growth as the future data warehouse. Work closely with Business Intelligence, Data Engineering, cross-functional and Leadership teams to develop a warehouse using data modeling best practices. Managing Integrations with other internal systems to ensure data quality via Application calls or coding. Apply auditing, change-tracking, and error handling on large datasets to ensure a robust data monitoring process. Monitor for data quality control issues that helps identify good vs bad data to implement in decisioning logic for data usage. Leverage Python and Application knowledge to interact and extract data from other applications. Handle day-to-day operational challenges, working with additional team members to maintain operation data processing. Leveraging the above items listed to monitor, manage, improve, and review all relevant data. Contribute to improving the data engineering best practices and processes. Design agile data models. Implement meta-data driven ELT/ELT data pipelines. Automate database deployment. Optimize the cost vs performance and scalability of data solutions. Partner with business analysts to craft stories and create technical work items to satisfy those stories. Work on an agile team to quickly iterate and release solutions. Provide technical advice and assist end-users in solving problems. Serve as subject matter expert and drive evolution of Snowflake based Data Warehouse Solutions and workloads. Work across multiple workstreams. Continuously learn new skills and mentor team members. Proficient in Structured Query Language (SQL) and experience with relational databases (RDBMS) Proficient in Python coding and experience working with Python in data engineering Proficient with Application Programming Interface (API) protocols Strong understanding of data engineering concepts and principles Understanding of cloud environments (i.e., Snowflake, AWS S3, Azure, etc.). Familiarity with complex data relationships and the data mapping process Experience using data migration tools (i.e., Stitch, Workato, Kafka, API callable, etc.) Experience with Salesforce data (reporting, data flows, integration requirements) Experience in Snowflake SQL (i.e., stored procedures, tasks, Snowpipe, etc.). Understanding of data integration and ETL/ELT processes Familiarity of data architect methods (i.e., star schema, snowflake schema, type 2 dimensions, etc.) Ability to communicate and visualize complex quantitative analysis in a clear, precise, and actionable manner. Familiarity in data mapping, data modeling and data management Familiarity with Agile methodology Team Oriented, with the ability to work without heavy oversite. Write clear, concise, and accurate documentation. Ability to learn and adopt new tools and methods University degree related to Computer Science Snowflake Certified (SnowPro Core, SnowPro Data Engineer) 7 years of relevant experience in software and data engineering Design agile data models. Implement meta-data driven ELT/ELT data pipelines. Automate database deployment. Optimize the cost vs performance and scalability of data solutions. Partner with business analysts to craft stories and create technical work items to satisfy those stories. Work on an agile team to quickly iterate and release solutions. Provide technical advice and assist end-users in solving problems. Serve as subject matter expert and drive evolution of Snowflake based Data Warehouse Solutions and workloads. Work across multiple workstreams. Continuously learn new skills and mentor team members Hands-on experience with: Snowflake SQL JavaScript Python In depth knowledge of: ELT Data Pipeline Data Vault 2.0 Kimball Dimensional Modelling or Star Schema Software design patterns and anti-patterns Familiarity with: Azure and AWS cloud services ETL/ELT tools such as Matillion, dbt, Airflow Power BI, Tableau or other reporting and analytics tools GIT or GitHub ADO Boards Agile methodology CICD and DevOps Knowledge and experience in SAP environments highly advantageous. Competencies : Analysis: Identify and understand issues, problems, and opportunities; compare data from different sources to draw conclusions. Communication: Clearly convey information and ideas through a variety of media to individuals or groups in a manner that engages the audience and helps them understand and retain the message. Exercising Judgment and Decision Making: Use effective approaches for choosing a course of action or developing appropriate solutions; recommend or take action that is consistent with available facts, constraints, and probable consequences. Technical and Professional Knowledge: Demonstrate a high level of technical and professional skill or knowledge in position-related areas; remains current with developments and trends in areas of expertise. Building Effective Relationships: Develop and use collaborative relationships to facilitate the accomplishment of work goals. Apply Now
Share this job with someone you think should apply!
Facebook buttonFacebook   Whatsapp buttonWhatsapp

Related Jobs

Cloud Data Engineer Cape Town - South Africa

Intellinexus

...

Data Engineer Cape Town - South Africa

Intellinexus

...

Data Architect Cape Town - Cape Town Region

Parvana

...

Data Engineer Johannesburg North - North Johannesburg

Network IT

...

2050 - AWS Data Engineer - Pretoria

...

Want to do another search?

Jobs in