Bayt.com

Submitting more applications increases your chances of landing a job.

Here’s how busy the average job seeker was last month:

Opportunities viewed

Applications submitted

Keep exploring and applying to maximize your chances!

Looking for employers with a proven track record of hiring women?

Click here to explore opportunities now!
We Value Your Feedback

You are invited to participate in a survey designed to help researchers understand how best to match workers to the types of jobs they are searching for

Would You Be Likely to Participate?

If selected, we will contact you via email with further instructions and details about your participation.

You will receive a $7 payout for answering the survey.


User unblocked successfully
Thank you. Your report has been submitted and will be reviewed shortly.
https://bayt.page.link/C3PGT4j7JNQJGvHK7
Back to the job results

Staff Big Data Engineer

Yesterday 2026/11/21 ·Application closes in 118 days
Other Business Support Services
Create a job alert for similar positions
Job alert turned off. You won’t receive updates for this search anymore.
Undo

Job description

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!


  • Job Summary


    Qualys is seeking a Staff Big Data Engineer to define and drive the technical vision for the data platform and pipeline architecture powering the Enterprise TruRisk Platform. This role focuses on designing, scaling, and optimizing distributed data systems that process billions of events and transactions daily. The position requires hands-on technical leadership, architecture ownership, and direct involvement in solving large-scale performance and reliability challenges.


    Responsibilities


    • Define the technical vision and long-term strategy for the data platform and pipeline architecture.
    • Design and maintain scalable, high-availability data processing systems supporting billions of daily events and transactions.
    • Lead architecture and design decisions across multiple engineering teams, ensuring alignment with business objectives including scalability, performance, reliability, cost, and time-to-market.
    • Identify, troubleshoot, and resolve data platform performance bottlenecks and scalability challenges.
    • Design and implement event-driven and streaming data architectures using distributed processing technologies.
    • Partner with Product Management, Professional Services, and Sales Engineering teams to evaluate technical solutions and trade-offs. Establish engineering standards, architectural guidelines, and platform best practices.
    • Research, evaluate, and recommend technologies for large-scale data processing and analytics platforms.
    • Mentor engineers on distributed systems design, performance optimization, and big data technologies.
    • Support technical reviews, architecture governance, and engineering excellence initiatives.

    Preferred Qualifications


    • Experience with Elasticsearch or Apache Solr.
    • Experience with Trino.
    • Experience with Apache Airflow.
    • Experience with distributed caching technologies.
    • Experience implementing Lambda, Kappa, or Kappa++ architectures.
    • Experience with Apache Flink and real-time stream processing. Experience with rule-engine platforms.
    • Experience deploying and supporting machine learning models in production.
    • Experience administering enterprise Big Data platforms and services.

    Technical Skills


    Apache Spark Apache Kafka Hadoop ecosystem technologies Data lake architectures Event-driven architectures Distributed data processing systems Oracle Database Cassandra Redis Performance tuning and benchmarking of large-scale systems Linux/Unix environments Large-scale infrastructure troubleshooting and optimization


    Professionnal Experience


    • Minimum 12 years of experience in software engineering, data engineering, or distributed systems engineering.
    • Minimum 6 years of hands-on experience designing, developing, and troubleshooting Apache Spark-based data processing solutions.
    • Minimum 6 years of experience building and supporting large-scale data pipelines processing billions of events or transactions per day.
    • Minimum 4 years of experience administering and operating Apache Kafka in production environments.
    • Minimum 4 years of experience designing event-driven or streaming data architectures.
    • Experience delivering highly available and scalable distributed systems in production environments.
    • Experience leading architecture and technical initiatives across multiple engineering teams.
    • Experience mentoring engineers and providing technical guidance on large-scale platform development.

    Education


    Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline.

    Preferred Qualifications


    • Experience with Elasticsearch or Apache Solr. Experience with Trino.
    • Experience with Apache Airflow.
    • Experience with distributed caching technologies.
    • Experience implementing Lambda, Kappa, or Kappa++ architectures.
    • Experience with Apache Flink and real-time stream processing. Experience with rule-engine platforms.
    • Experience deploying and supporting machine learning models in production.
    • Experience administering enterprise Big Data platforms and services.

This job post has been translated by AI and may contain minor differences or errors.
Apply on company site Email to Friend Complete Questionnaire
You’ve reached the maximum limit of 15 job alerts. To create a new alert, please delete an existing one first.
MANAGE
Job alert created for this search. You’ll receive updates when new jobs match.
Manage alerts
Are you sure you want to unapply?

You'll no longer be considered for this role and your application will be removed from the employer's inbox.