| Date | 2024-06-22 |
|---|---|
| Job Title | Aws Data Engineer |
| Employer | More Information |
| Salary | |
| Category | It Computing Software |
| Location |
Cape Town Region / Cape Town City Centre |
Job Summary
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and security. Data Engineers play a pivotal role in facilitating the acquisition of data from diverse sources, ensuring its conformity to data quality standards, and enabling downstream users to access data promptly. This position is an integral part of an agile team. These professionals are entrusted with the responsibility of establishing the infrastructure required to derive insights from raw data, integrating data from various sources seamlessly. They empower solutions by efficiently managing substantial volumes of data, both in batch and real-time, utilizing cutting-edge technologies from the realms of big data and cloud computing. Additional responsibilities encompass the development of proof-of-concepts and the implementation of intricate big data solutions, with a primary focus on collecting, parsing, managing, analyzing, and visualizing extensive datasets. They are adept at employing technologies to resolve challenges associated with handling vast amounts of data in diverse formats, thereby delivering innovative solutions. Data Engineering is a technically demanding role that necessitates a broad spectrum of expertise in software development and programming. These professionals possess knowledge in data analysis, understanding end-user and business requirements, and have the ability to translate these needs into technical solutions. They exhibit a strong grasp of physical database design and the systems development lifecycle. Collaboration within a team environment is essential for success in this role. Key
Responsibilities:
Architecting Data analytics framework. Translating complex functional and technical requirements into detailed architecture, design, and high-performance software. Leading the development of data and batch/real-time analytical solutions by leveraging transformative technologies. Engaging in multiple projects as a technical lead, overseeing user story analysis, design, software development, testing, and automation tool creation.
Duties:
Primary Job Objectives: Development and Operations Database Development and Operations Establishment and Adherence to Policies, Standards, and Procedures Communication Business Continuity and Disaster Recovery Planning Research and Evaluation Coaching and Mentoring Required Skills, Knowledge, and Experience: A minimum of 5 years of experience in Data Engineering or Software Engineering. Demonstrated leadership experience, managing teams of engineers for 3-5 years. A minimum of 2 years of experience in Big Data. At least 5 years of experience with Extract, Transform, and Load (ETL) processes. A minimum of 2 years of experience with AWS (Amazon Web Services). Demonstrated experience with agile or other rapid application development methodologies for at least 2 years (e.g., Agile, Kanban, Scrum). 5 years of proven expertise in object-oriented design, coding, testing patterns, and working with commercial or open-source software platforms and large-scale data infrastructures. Proficiency in creating data feeds from on-premise to AWS Cloud (2 years). Support experience for data feeds in production on a break-fix basis (2 years). A minimum of 4 years of experience in creating data marts using Talend or similar ETL development tools. Proficiency in data manipulation using Python and PySpark (2 years). Experience in processing data using the Hadoop paradigm, particularly with EMR, AWS`s distribution of Hadoop (2 years). DevOps experience in Big Data and Business Intelligence, including automated testing and deployment (2 years). Extensive knowledge of various programming or scripting languages. Expertise in data modeling and an understanding of different data structures and their suitability for specific use cases. Additional Technical Skills Required: The ability to design highly scalable distributed systems using various open-source tools. Proficiency in both batch and streaming Big Data tools. Experience with Talend for at least 1 year. Familiarity with AWS services such as EMR, EC2, and S3 for at least 1 year. Proficiency in Python for at least 1 year. Familiarity with PySpark or Spark (desirable for at least 1 year). Experience in Business Intelligence data modeling for 3 years. Proficiency in SQL for 3 years. Qualifications/Certifications: A Bachelor`s degree in computer science, computer engineering, or equivalent work experience for a minimum of 4 years. AWS Certification, at least at the associate level. In order to comply with the POPI Act, for future career opportunities, we require your permission to maintain your personal details on our database. By completing and returning this form you give PBT your consent
Aws Data Engineer position available in Cape Town Region, Cape Town City Centre. This job position was posted by . The job has been posted on 2024-06-22 in the It Computing Software category
Click Go Apply to apply online!
You might also like to look at the available jobs in the same area.
Apply directly for this position
Some posts have contact information included with other instructions. All applicants are urged to read the instructions carefully.
We will list jobs at the bottom of each job, so feel free to scroll down and continue your search.
We do not accept any job applications and merely offer the service of daily jobs being mined and displayed on our job portal.
Each job post has a link to take you directly to the original post to apply on their website or the original website where the post came from.
Here are some more related positions
Pretoria: Aws Data Engineer
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Cape Town City Centre: Aws Data Engineer
PBT Group is currently offering an opportunity for an AWS Data Engineer with 2 to 5 years of relevant experience. The role of a Data Engineer involves constructing and maintaining data pipelines and datamarts, emphasizing scalability, repeatability, and se
View Job
Aws Data Engineer
Centurion: Aws Data Engineer – Centurion– Up To R700 Per Hour
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach. We are seeking a talented AWS Data Engineer to become a crucial part of their dynamic team.
View Job
Aws Data Engineer – Centurion– Up To R700 Per Hour
Pretoria: Aws Data Engineer – Pretoria – R500 To R700 Per Hour
A leader in African capital markets with a comprehensive suite of products, a vast global reach while and an acute positioning as a local bank with the expertise ability to leverage on local presence with regional and international expertise has a vacant p
View Job
Aws Data Engineer – Pretoria – R500 To R700 Per Hour
Pretoria: Aws Data Engineer –Pretoria – R800k To R1mil Per Annum
An AWS Advanced partner that augments and accelerates organisational capabilities with agile, modern, data-driven solutions and services built according to well architected principles while providing technical thought leadership and innovation to go above
View Job
Aws Data Engineer –Pretoria – R800k To R1mil Per Annum
Johannesburg: Senior Data Engineer (Aws)- Johannesburg – R800k To R1mil Per Annum
A leading African Corporate Investment Bank and part of one of the largest financial services groups that are passionate Solutionists who offer clients innovative advisory, funding, trading, corporate banking and principal investing solutions have a vacant
View Job
Senior Data Engineer (Aws)- Johannesburg – R800k To R1mil Per Annum
Johannesburg: Aws Data Engineer With Databricks posted by PBT Group
PBT Group has an opportunity for an AWS Data Engineer, with DataBricks experience. Duties:Design, build and operationalize large scale enterprise data solutions and applications using one or more of AWS data and analytics services in combination with 3rd p
View Job
Aws Data Engineer With Databricks
Johannesburg: Aws Data Engineer/Jhb posted by Rooftop Recruitment
AWS Data Engineer/JHB Contract Type: 12 months Our client is seeking a highly motivated and experienced AWS Data Engineer to join their Global Markets division. The role is responsible for closely working the traders, quantitative analysts, and Data Scient
View Job
Aws Data Engineer/Jhb
Johannesburg: Aws Data Engineer – Johannesburg – R900k To R1.1Mil Per Annum
Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next generation actionable insights to every company, globally, by harne
View Job
Aws Data Engineer – Johannesburg – R900k To R1.1Mil Per Annum
Randburg: Aws Senior Data Engineer posted by Planet10
Purpose of the Position To collect and validate business information (which can then be used by data scientists and business stakeholders). To design and implement data models and architectures that enable business stakeholders to gain insights from large-
View Job
Aws Senior Data Engineer
Randburg: Aws Senior Data Engineer posted by Planet10
Purpose of the Position To collect and validate business information (which can then be used by data scientists and business stakeholders). To design and implement data models and architectures that enable business stakeholders to gain insights from large-
View Job
Aws Senior Data Engineer
Johannesburg: Aws Data Cloud Engineer (Big Data Engineer) posted by Planet10
A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer) Knowledge /Qualifications High knowledge in AWS security groups, permissions, VPC, roles, services. Experience developing engineering applications in Co
View Job
Aws Data Cloud Engineer (Big Data Engineer)
Johannesburg: Aws Data Cloud Engineer (Big Data Engineer) posted by Planet10
A leader in the insurance space is on the lookout for a AWS Data Cloud Engineer (big Data Engineer) Knowledge /Qualifications High knowledge in AWS security groups, permissions, VPC, roles, services. Experience developing engineering applications in Co
View Job
Aws Data Cloud Engineer (Big Data Engineer)
Johannesburg: Aws Data Engineer/Jhb posted by Rooftop Recruitment
AWS Data Engineer/JHB Contract Type: 12 months Our client is seeking a highly motivated and experienced AWS Data Engineer to join their Global Markets division. The role is responsible for closely working the traders, quantitative analysts, and Data Scient
View Job
Aws Data Engineer/Jhb
South Africa: Aws Data Engineer – Semi Remote – R740 Per Hour posted by E-Merge
A fantastic opportunity for an AWS Data Engineer to join a team of specialists developing the next generation of software systems.You will be responsible in performing thorough testing and data validation to ensure the accuracy of data transformationsCore
View Job
Aws Data Engineer – Semi Remote – R740 Per Hour
Bedfordview: Aws Redshift Data Engineer – Bedfordview – R1.1M Pa posted by E-Merge
e-Commerce environment for fast growing FCMG group which is a differentiated and diversified retailer of Furniture, Household appliances, Consumer electronic and technology goods. In addition, they are a leading consumer finance business providing innovati
View Job
Aws Redshift Data Engineer – Bedfordview – R1.1M Pa
Johannesburg: Aws Data Engineer – Johannesburg – Up To R800 Per Hour posted by E-Merge
This technology company is enthusiastic about resolving business challenges for their clients and is actively seeking an AWS Data Engineer to join their team. By employing advanced data analytics, actuarial services, software development, and automation, t
View Job
Aws Data Engineer – Johannesburg – Up To R800 Per Hour
South Africa: Data Engineer/Etl Developer (Aws) – Johannesburg North Up To R1.1M Per Annum posted by E-Merge
Are you currently responsible for data engineering solutions on a Cloud Data Platform?Can you code and develop and deploy software solutions?Are you highly Analytical thinker who can streamline processes?The successful incumbent will be responsible of the
View Job
Data Engineer/Etl Developer (Aws) – Johannesburg North Up To R1.1M Per Annum
Johannesburg: Senior Data Engineer (Aws)- Johannesburg – R800k To R1mil Per Annum posted by E-Merge
A leading African Corporate Investment Bank and part of one of the largest financial services groups that are passionate Solutionists who offer clients innovative advisory, funding, trading, corporate banking and principal investing solutions have a vacant
View Job
Senior Data Engineer (Aws)- Johannesburg – R800k To R1mil Per Annum
South Africa: Aws Data Engineer -Pretoria – R800k To R1mil Per Annum posted by E-Merge
An AWS Advanced partner that augments and accelerates organisational capabilities with agile, modern, data-driven solutions and services built according to well architected principles while providing technical thought leadership and innovation to go above
View Job
Aws Data Engineer -Pretoria – R800k To R1mil Per Annum
Centurion: Aws Data Engineer – Centurion- Up To R700 Per Hour posted by E-Merge
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach. We are seeking a talented AWS Data Engineer to become a crucial part of their dynamic team.
View Job
Aws Data Engineer – Centurion- Up To R700 Per Hour
Johannesburg: Aws Data Engineer – Johannesburg – R900k To R1.1Mil Per Annum posted by E-Merge
Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next generation actionable insights to every company, globally, by harne
View Job
Aws Data Engineer – Johannesburg – R900k To R1.1Mil Per Annum
South Africa: Data Engineer (Aws And Redshift) – Remote – R500 To R 700 Per Hour posted by E-Merge
A Group providing value conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a Data Engineer who will take responsibility for driving, designing and building scalable ETL sy
View Job
Data Engineer (Aws And Redshift) – Remote – R500 To R 700 Per Hour
Pretoria: Aws Data Engineer – Pretoria- R500 To R700 Per Hour posted by E-Merge
A leader in African capital markets with a comprehensive suite of products, a vast global reach while and an acute positioning as a local bank with the expertise ability to leverage on local presence with regional and international expertise has a vacant p
View Job
Aws Data Engineer – Pretoria- R500 To R700 Per Hour
Johannesburg: Data Engineer (Aws And Redshift) – Johannesburg – Up To R1mil posted by E-Merge
A Group providing value conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a data engineer who will take responsibility for driving, designing and building scalable ETL sy
View Job
Data Engineer (Aws And Redshift) – Johannesburg – Up To R1mil