| Date | 2024-07-07 |
|---|---|
| Job Title | Data Engineer |
| Employer | Planet10 More Information |
| Salary | 0 |
| Category | It Computer |
| Location |
Gauteng / Johannesburg |
Job Summary
A leader in the Banking and Financial space is on the lookout for a Data Engineer to join their team. The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Companys Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data products, and support data initiatives. In addition, Data Engineers enhance the data infrastructure of the bank to enable advanced analytics, machine learning and artificial intelligence by providing clean, usable data to stakeholders. They also create data pipelines, Ingestion, provisioning, streaming, self service, API and solutions around big data that support the Bank`s strategy to become a data driven organisation. Software Engineers. Essential Qualifications – NQF Level Advanced Diplomas/National 1st Degrees Preferred Qualification Field of Study: BCom, BSc, BEng Preferred Certifications Cloud (Azure, AWS), DEVOPS or Data engineering certification. Any Data Science certification will be an added advantage, Coursera, Udemy, SAS Data Scientist certification, Microsoft Data Scientist. Minimum Experience Level Total number of years of experience:3 – 6 years Type of experience: Experienced at working independently within a squad and has the demonstrated knowledge and skills to deliver data outcomes without supervision. Experience designing, building, and maintaining data warehouses and data lakes. Experience with big data technologies such as Hadoop, Spark, and Hive. Experience with programming languages such as Python, Java, and SQL. Experience with relational databases and NoSQL databases. Experience with cloud computing platforms such as AWS, Azure, and GCP. Experience with data visualization tools. Result-driven, analytical creative thinker, with demonstrated ability for innovative problem solving. Technical / Professional Knowledge Cloud Data Engineering (Azure , AWS, Google) Data Warehousing Databases (PostgreSQL, MS SQL, IBM DB2, HBase, MongoDB) Programming (Python, Java, SQL) Data Analysis and Data Modelling Data Pipelines and ETL tools (Ab Initio, ADB, ADF, SAS ETL) Agile Delivery Problem solving skills Job Responsibilities Responsible for the maintenance, improvement, cleaning, and manipulation of data in the bank`s operational and analytics databases. Data Infrastructure: Build and manage scalable, optimised, supported, tested, secure, and reliable data infrastructure eg using Infrastructure and Databases (DB2, PostgreSQL, MSSQL, HBase, NoSQL, etc), Data Lakes Storage (Azure Data Lake Gen 2), Cloud-based solutions (SAS , Azure Databricks, Azure Data Factory, HDInsight), Data Platforms (SAS, Ab Initio, Denodo, Netezza, Azure Cloud). Ensure data security and privacy in collaboration with Information Security, CISO and Data Governance Data Pipeline Build (Ingestion, Provisioning, Streaming and API): Build and maintain data pipelines to: create data pipelines for data integration (Data Ingestion, Data Provisioning and Data Streaming) utilising both On Premise tool sets and Cloud Data Engineering tool sets efficiently extract data (Data Acquisition) from Golden Sources, Trusted sources and Writebacks with data integration from multiple sources, formats and structures load the Companys Data Warehouse (Data Reservoir, Atomic Data Warehouse, Enterprise Data Mart) provide data to the respective Lines of Business Marts, Regulatory Marts and Compliance Marts through self service data virtualisation provide data to applications or Companys Data consumers transform data to a common data model for reporting and data analysis, and to provide data in a consistent, useable format to Companys data stakeholders handle big data technologies (Hadoop), streaming (KAFKA) and data Replication (IBM Inphosphere Data Replication) drive utilisation of data integration tools ( Ab Initio) and Cloud data integration tools (Azure Data Factory and Azure Data Bricks) Data Modelling and Schema Build: In collaboration with Data Modellers, create data models and database schemas on the Data Reservoir, Data Lake, Atomic Data Warehouse and Enterprise Data Marts. Companys Data Warehouse Automation: Automate, monitor and improve the performance of data pipelines. Collaboration: Collaborate with Data Analysts, Software Engineers, Data Modelers, Data Scientistsm Scrum Masers and Data Warehouse teams as part of a squad to contribute to the data architecture detail designs and take ownership of Epics end-to-end and ensure that data solutions deliver business value. Data Quality and Data Governance: Ensure that reasonable data quality checks are implemented in the data pipelines to maintain a high level of data accuracy, consistency and security. Performance and Optimisation: Ensure the performance of the Companys data warehouse, integration patterns, batch and real time jobs, streaming and API`s. API Development: Build API`s that enable the Data Driven Organisation, ensuring that the data warehouse is optimised for API`s by collaborating with Software Engineers.
Data Engineer position available in Gauteng, Johannesburg. This job position was posted by Planet10. The job has been posted as a premium ad on 2024-07-07 at 13:41:49 in the It Computer category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
Johannesburg: Data Engineer
Job Purpose: The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data pr
View Job
Data Engineer
Johannesburg: Data Engineer
Who are we: An international group of companies within the hospitality industry Who are we looking for: A data Engineer with a high degree of proficiency in SSIS, SQL, SSAS Cubes, DAX, MDX and building stored procedures What will you do: The Data Engineer
View Job
Data Engineer
Johannesburg: Senior Specialist: Cloud Data Platform Engineer.
At least 2 years Azure Cloud experience and some DevOps experience. Build, administre and maintain large scale data platforms in the field of data engineering, data analytics, data governance, data products, cloud, API`s and machine learning. Implement and
View Job
Senior Specialist
Johannesburg: Data Engineer
A leader in the Banking and Financial space is on the lookout for a Data Engineer to join their team. The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company’s Data Architecture Roadmap
View Job
Data Engineer
Johannesburg: Data Engineer (Sas)
Job Title: Data Engineer (SAS) Location: Remote About Our Client: Our client is a leading player in the insurance industry, dedicated to providing innovative solutions to meet the needs of our clients. They leverage cutting-edge technology to drive their b
View Job
Data Engineer (Sas)
Johannesburg: Junior Data Engineer – Johannesburg – R380k To R480k Per Annum
An upbeat company that helps clients understand the rich data collected from the traditional retail market in South Africa and Africa broadly are in the market for a Junior Data Engineer . The ideal candidate will have a strong analytical and mathematical
View Job
Junior Data Engineer – Johannesburg – R380k To R480k Per Annum
Fourways: Data Engineer – Johannesburg – R480k To R720k Per Annum
A Software company with premier custom software and product development, delivering custom-made solutions for large enterprises as well as dynamic start-ups is looking for a Data Engineer to join an environment of like-minded engineers who are able to expr
View Job
Data Engineer – Johannesburg – R480k To R720k Per Annum
Johannesburg: Data Center Electrical Engineer
Responsibilities: Collaborate with project teams to engage clients and consultant teams effectively. Support projects during the tender process and as part of the solutions team. Develop local resources to strengthen the DC facility business. Promote and p
View Job
Data Center Electrical Engineer
Johannesburg: Data Engineer
What you will be doing / What we are looking for: Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between source system (golden/trusted) and the target database (LOB), hence provide good quality
View Job
Data Engineer
South Africa: Senior Data Engineer – Remote – R450 To R550 Per Hour
Join a team of dynamic experts within a consultancy known for leading a world class data analytics/warehouse capability and specialising in AI and applications and helping enterprise clients to extract business value by implementing AI solutions has a vaca
View Job
Senior Data Engineer – Remote – R450 To R550 Per Hour
South Africa: Data Engineer (Azure) – Cape Town – R600k To R800k Per Annum
A Fintech department, delivering financial information to the company that is timely, accurate, reliable, and relevant data originating from a multitude of external sources and is then processed into meaningful information seek a Data Engineer to design an
View Job
Data Engineer (Azure) – Cape Town – R600k To R800k Per Annum
Cape Town City Centre: Data Engineer
We`re looking for a Data Engineer to join our Cape Town based team. The successful person must be based in Cape Town as there will be a requirement to go into the office 3 times per week. This will be for an initial 12 month contract. The purpose of this p
View Job
Data Engineer
Pretoria: Aws Data Engineer
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Cape Town City Centre: Aws Data Engineer
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Johannesburg: Data Engineer
Key Responsibilities: Design, develop, and maintain robust data pipelines to collect, process, and store data from various sources. Implement and manage data warehouses and data lakes. Optimize data processing systems and ensure data quality and integrity.
View Job
Data Engineer
Johannesburg: Data/Ml Engineer
Data/ML Engineer Position: Data/ML Engineer Location: Johannesburg, Gauteng Type: Contract About Our Client: Our Client is a leading player in the insurance industry, committed to innovation and excellence. They are seeking a highly skilled Data/ML Enginee
View Job
Data/Ml Engineer
South Africa: Azure Data Engineer – Centurion – R500k To R700k Per Annum
A leading telecommunications company, with innovative solutions from designing, building, deploying, and managing high performance computing infrastructure and an innovative approach with a focus on innovation topics such as Development and Operations for
View Job
Azure Data Engineer – Centurion – R500k To R700k Per Annum
Johannesburg: Data Development Engineer
Key Responsibilities Design, development and implementation of ETL pipelines. Debug and correct programs to ensure business requirements are met, this includes new and maintenance work. Performance tuning of long running queries and recommending any perfor
View Job
Data Development Engineer
Johannesburg: Data Engineer
Requirements: Active working experience in building enterprise standard ETL/ELT processes as well as data lakes and a focus on code-based techniques and collaborative environments Experience in Agile development processes, using Jira, Git, etc. Working exp
View Job
Data Engineer
Johannesburg: Data Engineer
Job Experience & Skills Requirements: Matric Degree (BSc/ IT related) Experience building ETL/ ELT processes. Python, Bash/ Shell Scripting SQL/PostgreSQL AWS Infrastructure Big Data and Linux Mac, Jira, and Git. If you possess the skills and experience re
View Job
Data Engineer
Cape Town City Centre: Data Engineer
As an Engineer for our Data/Martech practice, you will play a key role in the development and delivery of our marketing technology and data solutions, from the implementation of tools like CDPs through to the development of custom algorithms, effectiveness
View Job
Data Engineer
Centurion: Aws Data Engineer – Centurion– Up To R700 Per Hour
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach. We are seeking a talented AWS Data Engineer to become a crucial part of their dynamic team.
View Job
Aws Data Engineer – Centurion– Up To R700 Per Hour
Johannesburg: Senior Data Engineer
Requirements: Active working experience in building enterprise standard ETL/ELT processes as well as data lakes and a focus on code-based techniques and collaborative environments Experience in Agile development processes, using Jira, Git etc. Working expe
View Job
Senior Data Engineer
Sandton: Data Engineer
Job Purpose The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data pro
View Job
Data Engineer
Midrand: Cloud Database Engineer (Advanced)
ESSENTIAL SKILLS REQUIREMENTS: - Any additional responsibilities assigned in the Agile Working Model (AWM) Charter - Experience with Oracle database architecture, automation, and performance tuning - Expert knowledge of cloud architectures with a focus on
View Job
Cloud Database Engineer (Advanced)