| Date | 2024-07-07 |
|---|---|
| Job Title | Data Engineer (Jhb) |
| Employer | Datafin More Information |
| Salary | 0 |
| Category | It Computer |
| Location |
Gauteng / Johannesburg |
Job Summary
Johannesburg – Gauteng
- Design, develop, and maintain scalable and efficient data pipelines and ETL processes to ingest, transform, and load data from various sources.
- Develop and implement data warehousing solutions.
- Collaborate with cross-functional teams to integrate various data sources.
- Ensure data quality and consistency across different data systems.
- Optimise data retrieval for dashboard/reporting solutions.
- Optimise data infrastructure, including data storage, data retrieval, and data processing for enhanced performance and scalability.
- Implement data quality and data governance processes to ensure accuracy, consistency, and integrity of data.
- Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
- Perform data profiling and analysis to identify data quality issues and propose improvements.
- Collaborate with data scientists and analysts to provide them with the necessary data sets for analysis and reporting.
- Stay up to date with emerging technologies and trends in data engineering and recommend new tools and frameworks to improve data infrastructure.
- Willingness to actively contribute to BI analytics tasks, such as creating and maintaining reports.
- This means being comfortable with hands-on work, including report development, SQL writing, and refactoring tasks.
- Preferably a bachelors degree in computer science, engineering, or a related field.
- Certifications (AWS, GCP, Azure, Microsoft) a plus.
- Proven experience as a Data Engineer or similar role, with a strong understanding of data modelling, data warehousing, and ETL processes.
- Proficient in SQL and experience working with relational databases (e.g., PostgreSQL, MySQL, SQL Server) and NoSQL databases (e.g., MongoDB, Cassandra).
- Strong programming skills in at least one scripting language (e.g., Python) and experience with data manipulation and transformation libraries (e.g., Pandas, PySpark).
- Comfortable working with cloud-based infrastructure and services provided by Amazon Web Services (AWS)/ Azure.
- Familiarity with data pipeline orchestration tools (e.g., Apache Airflow, Luigi, Lambda) and workflow management systems.
- Experience with real-time data streaming technologies (e.g., Apache Kafka, Apache Flink).
- Knowledge of containerisation technologies and orchestration tools (e.g., Docker, Kubernetes).
- Familiarity with machine learning concepts and frameworks.
Data Engineer (Jhb) position available in Gauteng, Johannesburg. This job position was posted by Datafin. The job has been posted as a premium ad on 2024-07-07 at 16:00:47 in the It Computer category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
Johannesburg: Data Engineer
Job Purpose: The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data pr
View Job
Data Engineer
Johannesburg: Data Engineer
Who are we: An international group of companies within the hospitality industry Who are we looking for: A data Engineer with a high degree of proficiency in SSIS, SQL, SSAS Cubes, DAX, MDX and building stored procedures What will you do: The Data Engineer
View Job
Data Engineer
Johannesburg: Senior Specialist: Cloud Data Platform Engineer.
At least 2 years Azure Cloud experience and some DevOps experience. Build, administre and maintain large scale data platforms in the field of data engineering, data analytics, data governance, data products, cloud, API`s and machine learning. Implement and
View Job
Senior Specialist
Johannesburg: Data Engineer
A leader in the Banking and Financial space is on the lookout for a Data Engineer to join their team. The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company’s Data Architecture Roadmap
View Job
Data Engineer
Johannesburg: Data Engineer (Sas)
Job Title: Data Engineer (SAS) Location: Remote About Our Client: Our client is a leading player in the insurance industry, dedicated to providing innovative solutions to meet the needs of our clients. They leverage cutting-edge technology to drive their b
View Job
Data Engineer (Sas)
Johannesburg: Junior Data Engineer – Johannesburg – R380k To R480k Per Annum
An upbeat company that helps clients understand the rich data collected from the traditional retail market in South Africa and Africa broadly are in the market for a Junior Data Engineer . The ideal candidate will have a strong analytical and mathematical
View Job
Junior Data Engineer – Johannesburg – R380k To R480k Per Annum
Fourways: Data Engineer – Johannesburg – R480k To R720k Per Annum
A Software company with premier custom software and product development, delivering custom-made solutions for large enterprises as well as dynamic start-ups is looking for a Data Engineer to join an environment of like-minded engineers who are able to expr
View Job
Data Engineer – Johannesburg – R480k To R720k Per Annum
Johannesburg: Data Center Electrical Engineer
Responsibilities: Collaborate with project teams to engage clients and consultant teams effectively. Support projects during the tender process and as part of the solutions team. Develop local resources to strengthen the DC facility business. Promote and p
View Job
Data Center Electrical Engineer
Johannesburg: Data Engineer
What you will be doing / What we are looking for: Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between source system (golden/trusted) and the target database (LOB), hence provide good quality
View Job
Data Engineer
South Africa: Senior Data Engineer – Remote – R450 To R550 Per Hour
Join a team of dynamic experts within a consultancy known for leading a world class data analytics/warehouse capability and specialising in AI and applications and helping enterprise clients to extract business value by implementing AI solutions has a vaca
View Job
Senior Data Engineer – Remote – R450 To R550 Per Hour
South Africa: Data Engineer (Azure) – Cape Town – R600k To R800k Per Annum
A Fintech department, delivering financial information to the company that is timely, accurate, reliable, and relevant data originating from a multitude of external sources and is then processed into meaningful information seek a Data Engineer to design an
View Job
Data Engineer (Azure) – Cape Town – R600k To R800k Per Annum
Cape Town City Centre: Data Engineer
We`re looking for a Data Engineer to join our Cape Town based team. The successful person must be based in Cape Town as there will be a requirement to go into the office 3 times per week. This will be for an initial 12 month contract. The purpose of this p
View Job
Data Engineer
Pretoria: Aws Data Engineer
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Cape Town City Centre: Aws Data Engineer
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Johannesburg: Data Engineer
Key Responsibilities: Design, develop, and maintain robust data pipelines to collect, process, and store data from various sources. Implement and manage data warehouses and data lakes. Optimize data processing systems and ensure data quality and integrity.
View Job
Data Engineer
Johannesburg: Data/Ml Engineer
Data/ML Engineer Position: Data/ML Engineer Location: Johannesburg, Gauteng Type: Contract About Our Client: Our Client is a leading player in the insurance industry, committed to innovation and excellence. They are seeking a highly skilled Data/ML Enginee
View Job
Data/Ml Engineer
South Africa: Azure Data Engineer – Centurion – R500k To R700k Per Annum
A leading telecommunications company, with innovative solutions from designing, building, deploying, and managing high performance computing infrastructure and an innovative approach with a focus on innovation topics such as Development and Operations for
View Job
Azure Data Engineer – Centurion – R500k To R700k Per Annum
Johannesburg: Data Development Engineer
Key Responsibilities Design, development and implementation of ETL pipelines. Debug and correct programs to ensure business requirements are met, this includes new and maintenance work. Performance tuning of long running queries and recommending any perfor
View Job
Data Development Engineer
Johannesburg: Data Engineer
Requirements: Active working experience in building enterprise standard ETL/ELT processes as well as data lakes and a focus on code-based techniques and collaborative environments Experience in Agile development processes, using Jira, Git, etc. Working exp
View Job
Data Engineer
Johannesburg: Data Engineer
Job Experience & Skills Requirements: Matric Degree (BSc/ IT related) Experience building ETL/ ELT processes. Python, Bash/ Shell Scripting SQL/PostgreSQL AWS Infrastructure Big Data and Linux Mac, Jira, and Git. If you possess the skills and experience re
View Job
Data Engineer
Cape Town City Centre: Data Engineer
As an Engineer for our Data/Martech practice, you will play a key role in the development and delivery of our marketing technology and data solutions, from the implementation of tools like CDPs through to the development of custom algorithms, effectiveness
View Job
Data Engineer
Centurion: Aws Data Engineer – Centurion– Up To R700 Per Hour
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach. We are seeking a talented AWS Data Engineer to become a crucial part of their dynamic team.
View Job
Aws Data Engineer – Centurion– Up To R700 Per Hour
Johannesburg: Senior Data Engineer
Requirements: Active working experience in building enterprise standard ETL/ELT processes as well as data lakes and a focus on code-based techniques and collaborative environments Experience in Agile development processes, using Jira, Git etc. Working expe
View Job
Senior Data Engineer
Sandton: Data Engineer
Job Purpose The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data pro
View Job
Data Engineer
Midrand: Cloud Database Engineer (Advanced)
ESSENTIAL SKILLS REQUIREMENTS: - Any additional responsibilities assigned in the Agile Working Model (AWM) Charter - Experience with Oracle database architecture, automation, and performance tuning - Expert knowledge of cloud architectures with a focus on
View Job
Cloud Database Engineer (Advanced)