Data Engineer Level 2 - Derivco - Melkbosstrand

At Derivco, we work alongside our clients who are considered giants in the industry, to create and develop the platform that hosts some of the best online casino games in the industry. We are also Platinum partners with vendors such as Microsoft and we are proud to say we employ over 2,500 of the brightest minds across our offices in the USA, South Africa, UK, Spain, Malta, Sweden and Australia. To work for Derivco means you will work with cutting-edge technology., in our designer offices. Our people are brilliant., our ideas fresh and our technology is trailblazing. You will be inspired, challenged, and stimulated every day and you will receive an extraordinary number of high-fives - rewarded for work well done. A place where you will feel as if you have found your intellectual and creative home. Sounds pretty awesome, right? Derivco is an equal opportunities employer. We value people as individuals with diverse opinions, cultures, lifestyles and circumstances and we are committed to equality of opportunity and to providing a productive working environment free from unfair and unlawful discrimination. Derivco South Africa is seeking a highly skilled and motivated Data Engineer to be part of our dynamic team. As a Data Engineer, you will be tasked to simplify access to the services and resources, governing and maintaining a Data Lake platform as well as designing and implementing data solutions that collect, process, store and transform raw, unstructured data into formats that can be consumed by downstream teams. Key responsibilities: Work as part of an agile data engineering team Ensure that data systems meet the company’s regulatory commitments, and that data is reliable and efficient Support best business capabilities for high performance database solutioning. Actively participate in team, cross-discipline and vendor-driven collaboration sessions or forums to increase understanding of the working environment by contribution and participation in the relevant Data Governance Frameworks Partner with Technology, Business and other stakeholders to ensure that database structures, programmes and applications meet business delivery requirements. Monitor adherence to processes which support the prescribed data architectural frameworks and ensure development/delivery teams align to the required standards and methodologies Design and implement scalable end-to-end database solutions including: addressing issues of data migration i.e. validation, clean-up and mapping and consistently apply data dictionaries data cleanse using databricks component design and development identification and resolution of production and application development constraints integration of new technologies and software into the existing landscape development data set processes for data modelling, mining and production optimal utilization of big data documentation management and disaster recovery Key skills: In depth knowledge and understanding of: Azure Databricks Data governance and data management frameworks BI and Warehouse design Movement of data into the Cloud using the following tools Apache Kafka, Storm, Flume for ingesting data or Amazon Web Services (AWS) Cloud Development Kit (CDK) Operating with real-time streams, data warehouse queries, JSON, CSV, raw data Scripting Data Pipelines for scheduled movement of data Designing and developing ETL/ELT processes and data pipelines Experience working with Azure DevOps Data visualization including PowerBI / Tableau Exploratory Data Analysis - EDA Qualifications Relevant 3-year tertiary qualification BSC In Computer Science / Information Systems 4 Years Senior Data Engineering experience Additional Requirements: SQL Microsoft SQL Server NoSQL Microsoft SQL Server Python (PySpark) C# , Json- calling APIs PowerShell Apache Spark Kafka Scala Splunk Elk Stack Data Modelling Data warehousing solutions Data pipelines Data Cleansing Terraform Who you are: Passionate about solving complex problems. Commercial mindset Team player Self-starter Motivated Innovative Why Join Derivco? Hybrid working model Opportunities for personal and professional growth. Competitive salary package and benefits. Discretionary bonuses Employee Wellness – eg.Onsite Gym/Gym allowance Employee Assistance Program. School subsidies Study assistance. 3 o’ Clock Friday (Monthly) Daily meal & beverage subsidy Company social events Apply Now

Share this job with someone you think should apply!

Facebook

Data Engineer Level 2 - Melkbosstrand

Related Jobs

Qa Engineer Woodstock - Woodstock

Devops Engineer Mowbray - Mowbray

Business Analyst (JB4306) - Kloof Street

Instrument Design Engineer Mowbray - Mowbray

Electrical Design Engineer Mowbray - Mowbray

Want to do another search?