| Date | 2024-07-07 |
|---|---|
| Job Title | Data Engineer Python (Cpt Hybrid) |
| Employer | Datafin More Information |
| Salary | 0 |
| Category | It Computer |
| Location |
Western Cape / Cape Town |
Job Summary
Cape Town – Western Cape
- Extracting data from current sources
- Data storing/transition for all data gathered for analytical purposes.
- Transformation: Cleaning, structuring, and formatting the data sets to make data consumable for processing or analysis.
- An all-round Data Engineer, understand what is required from the users and deliver an appropriate data driven technical solution
- Contribute to strategic design of the architecture of a data platform.
- Develop data systems tools, customize and manage integration tools, databases, warehouses, and analytical systems.
- Data pipeline maintenance/testing.
- Machine Learning algorithm deployment. Machine Learning models designed by Data Scientists, deployed into production environments, managing computing resources and setting up monitoring tools.
- Manage data and meta-data storage, structured for efficiency, quality and performance.
- Track pipeline stability.
- Monitor the overall performance and stability of the systems.
- Keep track of related infrastructure costs and manage these as efficiently as possible, continuously balancing performance and cost.
- Minimum of a Bachelor`s Degree in a Scientific or Engineering related field.
- Certification or experience with Agile or other development methodologies – Agile, Kanban or Scrum
- Ideally busy with or obtained AWS Certifications.
- Implementing data pipelines using cloud infrastructure and services.
- Intermediate to Advanced R, Python or SQL optimization, developing ETL strategies.
- Infrastructure: AWS (Kinesis, API Gateway, S3, DMS).
- Dev Tools: Git, Docker, Elastic Container Service (ECS), Elastic Kubernetes Service (EKS).
- Ability to conduct systems analysis and prepare requirement specifications concerning data-related business processes and systems.
- AWS analytics architecture experience will be a real advantage.
- Willingness to learn new technology and skills, figure it out attitude
- Dynamic, driven by results. Enjoy getting things done.
- A proactive, results-oriented, and can-do attitude is highly desirable
- Self-starter with the ability to successfully plan, organize, and execute assigned initiatives with minimal guidance and direction.
- Strong listening, problem-solving and analytical skills.
- Willing to take the initiative.
- Excellent written and verbal communication skills.
- Exhibits close attention to detail and is a champion for accuracy.
- High level of Integrity.
- Proven ability to meet deadlines, ability to multi-task effectively
- The ability and willingness to do a variety of different tasks.
Data Engineer Python (Cpt Hybrid) position available in Western Cape, Cape Town. This job position was posted by Datafin. The job has been posted as a premium ad on 2024-07-07 at 16:01:03 in the It Computer category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly on jobmail for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
Johannesburg: Data Engineer
Job Purpose: The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data pr
View Job
Data Engineer
Johannesburg: Data Engineer
Who are we: An international group of companies within the hospitality industry Who are we looking for: A data Engineer with a high degree of proficiency in SSIS, SQL, SSAS Cubes, DAX, MDX and building stored procedures What will you do: The Data Engineer
View Job
Data Engineer
Johannesburg: Senior Specialist: Cloud Data Platform Engineer.
At least 2 years Azure Cloud experience and some DevOps experience. Build, administre and maintain large scale data platforms in the field of data engineering, data analytics, data governance, data products, cloud, API`s and machine learning. Implement and
View Job
Senior Specialist
Johannesburg: Data Engineer
A leader in the Banking and Financial space is on the lookout for a Data Engineer to join their team. The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company’s Data Architecture Roadmap
View Job
Data Engineer
Johannesburg: Data Engineer (Sas)
Job Title: Data Engineer (SAS) Location: Remote About Our Client: Our client is a leading player in the insurance industry, dedicated to providing innovative solutions to meet the needs of our clients. They leverage cutting-edge technology to drive their b
View Job
Data Engineer (Sas)
Johannesburg: Junior Data Engineer – Johannesburg – R380k To R480k Per Annum
An upbeat company that helps clients understand the rich data collected from the traditional retail market in South Africa and Africa broadly are in the market for a Junior Data Engineer . The ideal candidate will have a strong analytical and mathematical
View Job
Junior Data Engineer – Johannesburg – R380k To R480k Per Annum
Fourways: Data Engineer – Johannesburg – R480k To R720k Per Annum
A Software company with premier custom software and product development, delivering custom-made solutions for large enterprises as well as dynamic start-ups is looking for a Data Engineer to join an environment of like-minded engineers who are able to expr
View Job
Data Engineer – Johannesburg – R480k To R720k Per Annum
Johannesburg: Data Center Electrical Engineer
Responsibilities: Collaborate with project teams to engage clients and consultant teams effectively. Support projects during the tender process and as part of the solutions team. Develop local resources to strengthen the DC facility business. Promote and p
View Job
Data Center Electrical Engineer
Johannesburg: Data Engineer
What you will be doing / What we are looking for: Data Engineer skill is required to enable the data lifecycle within EDS, namely the ability to integrate data between source system (golden/trusted) and the target database (LOB), hence provide good quality
View Job
Data Engineer
South Africa: Senior Data Engineer – Remote – R450 To R550 Per Hour
Join a team of dynamic experts within a consultancy known for leading a world class data analytics/warehouse capability and specialising in AI and applications and helping enterprise clients to extract business value by implementing AI solutions has a vaca
View Job
Senior Data Engineer – Remote – R450 To R550 Per Hour
South Africa: Data Engineer (Azure) – Cape Town – R600k To R800k Per Annum
A Fintech department, delivering financial information to the company that is timely, accurate, reliable, and relevant data originating from a multitude of external sources and is then processed into meaningful information seek a Data Engineer to design an
View Job
Data Engineer (Azure) – Cape Town – R600k To R800k Per Annum
Cape Town City Centre: Data Engineer
We`re looking for a Data Engineer to join our Cape Town based team. The successful person must be based in Cape Town as there will be a requirement to go into the office 3 times per week. This will be for an initial 12 month contract. The purpose of this p
View Job
Data Engineer
Pretoria: Aws Data Engineer
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Cape Town City Centre: Aws Data Engineer
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Johannesburg: Data Engineer
Key Responsibilities: Design, develop, and maintain robust data pipelines to collect, process, and store data from various sources. Implement and manage data warehouses and data lakes. Optimize data processing systems and ensure data quality and integrity.
View Job
Data Engineer
Johannesburg: Data/Ml Engineer
Data/ML Engineer Position: Data/ML Engineer Location: Johannesburg, Gauteng Type: Contract About Our Client: Our Client is a leading player in the insurance industry, committed to innovation and excellence. They are seeking a highly skilled Data/ML Enginee
View Job
Data/Ml Engineer
South Africa: Azure Data Engineer – Centurion – R500k To R700k Per Annum
A leading telecommunications company, with innovative solutions from designing, building, deploying, and managing high performance computing infrastructure and an innovative approach with a focus on innovation topics such as Development and Operations for
View Job
Azure Data Engineer – Centurion – R500k To R700k Per Annum
Johannesburg: Data Development Engineer
Key Responsibilities Design, development and implementation of ETL pipelines. Debug and correct programs to ensure business requirements are met, this includes new and maintenance work. Performance tuning of long running queries and recommending any perfor
View Job
Data Development Engineer
Johannesburg: Data Engineer
Requirements: Active working experience in building enterprise standard ETL/ELT processes as well as data lakes and a focus on code-based techniques and collaborative environments Experience in Agile development processes, using Jira, Git, etc. Working exp
View Job
Data Engineer
Johannesburg: Data Engineer
Job Experience & Skills Requirements: Matric Degree (BSc/ IT related) Experience building ETL/ ELT processes. Python, Bash/ Shell Scripting SQL/PostgreSQL AWS Infrastructure Big Data and Linux Mac, Jira, and Git. If you possess the skills and experience re
View Job
Data Engineer
Cape Town City Centre: Data Engineer
As an Engineer for our Data/Martech practice, you will play a key role in the development and delivery of our marketing technology and data solutions, from the implementation of tools like CDPs through to the development of custom algorithms, effectiveness
View Job
Data Engineer
Centurion: Aws Data Engineer – Centurion– Up To R700 Per Hour
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach. We are seeking a talented AWS Data Engineer to become a crucial part of their dynamic team.
View Job
Aws Data Engineer – Centurion– Up To R700 Per Hour
Johannesburg: Senior Data Engineer
Requirements: Active working experience in building enterprise standard ETL/ELT processes as well as data lakes and a focus on code-based techniques and collaborative environments Experience in Agile development processes, using Jira, Git etc. Working expe
View Job
Senior Data Engineer
Sandton: Data Engineer
Job Purpose The purpose of the Data Engineer is to leverage their data expertise and data related technologies, in line with the Company Data Architecture Roadmap, to advance technical thought leadership for the Enterprise, deliver fit for purpose data pro
View Job
Data Engineer
Midrand: Cloud Database Engineer (Advanced)
ESSENTIAL SKILLS REQUIREMENTS: - Any additional responsibilities assigned in the Agile Working Model (AWM) Charter - Experience with Oracle database architecture, automation, and performance tuning - Expert knowledge of cloud architectures with a focus on
View Job
Cloud Database Engineer (Advanced)