Submitting more applications increases your chances of landing a job.

Here’s how busy the average job seeker was last month:

Opportunities viewed

Applications submitted

Keep exploring and applying to maximize your chances!

Looking for employers with a proven track record of hiring women?

Click here to explore opportunities now!
We Value Your Feedback

You are invited to participate in a survey designed to help researchers understand how best to match workers to the types of jobs they are searching for

Would You Be Likely to Participate?

If selected, we will contact you via email with further instructions and details about your participation.

You will receive a $7 payout for answering the survey.


User unblocked successfully
https://bayt.page.link/Qg5fRYkmWK5Lwi6e8
Back to the job results
Other Business Support Services
Create a job alert for similar positions
Job alert turned off. You won’t receive updates for this search anymore.

Job description

Job Title
Data Engineer

Job Scope

The Data Engineer is accountable for supporting projects and leading data related initiatives that meet customer requirements while participating in the business requirement gathering, development, usage and integration of innovative systems. S/He resolves technical issues through effective data utilization and provides training to users.https://th.joblum.com/job/data-management-analytics-consultant-manager/170927




Main Duties and Responsibilities
  • Design and build data pipelines to collect, store and process large and complex data sets from various sources including data ingestion, data cleansing, data validation and data transformation
  • Work on Big-Data ecosystem including Hadoop, HDFS, Spark, Spark SQL, Hive, Impala, Talend and CFM
  • Implement data storage and processing technologies such as data lakes, data warehouses and NoSQL databases to support data analytics and machine learning
  • Optimize data pipeline performance, troubleshoot and debug related issues while monitoring data pipeline health
  • Collaborate with Data Scientists and other stakeholders to understand data requirements and design data pipelines accordingly
  • Create and maintain documentation for data pipelines, data models and data dictionaries
  • Ensure data quality by implementing data validation and data cleansing processes
  • Implement security measures to protect data and ensure compliance with regulations such as GDPR, HIPAA and PCI-DSS
  • Research and evaluate new technologies and tools to improve data pipeline performance and scalability on a regular basis
  • Apply performance optimization techniques and technical guidance to other Application Developers
  • Provide advisory services for designing and implementing large, scalable distributed systems
  • Use programming languages and technologies like Python, SQL, Java, Scala, Informatica, Hadoop, Spark and Hive
  • Coordinate with multiple stakeholders on a regular basis.


Position Requirements

Education

Bachelor’s degree in Computer Science, Computer Engineering or any other related field




Experience

At least 1 to 3 years of relevant experience


#LI-AA4





This job post has been translated by AI and may contain minor differences or errors.

You’ve reached the maximum limit of 15 job alerts. To create a new alert, please delete an existing one first.
Job alert created for this search. You’ll receive updates when new jobs match.
Are you sure you want to unapply?

You'll no longer be considered for this role and your application will be removed from the employer's inbox.