https://bayt.page.link/v1TUmrkCw1dqRip19
Back to the job results
Full time · Management
500 Employees or more
Create a job alert for similar positions

Job description



You will be instrumental in designing, building, and maintaining high-performance data pipelines and infrastructure specifically tailored for AI and ML applications.

Your expertise will be critical in ensuring data quality, accessibility, and scalability for training, evaluating, and deploying advanced AI models, with a particular emphasis on the unique data requirements of LLMs and other complex AI techniques.

Client Details

A pivotal and leading government entity, dedicated to leveraging advanced technology and data to serve national interests and drive strategic objectives

Description


Design, build, and optimise scalable, robust, and efficient data pipelines for ingesting, transforming, and preparing large and complex datasets specifically for AI/ML models, including structured and unstructured data sources.Develop and manage data infrastructure components in cloud environments (e.g., Azure, AWS, GCP) ensuring security, compliance, and performance for AI workloads.Implement data governance best practices, ensuring data quality, lineage, privacy, and security for sensitive government data used in AI applications.Collaborate closely with AI Scientists and Machine Learning Engineers to understand their data needs, optimising data formats, storage, and access patterns for model training and inference, particularly for LLMs.Develop and maintain data versioning, feature stores, and model-serving data layers to support the AI/ML lifecycle.Troubleshoot and resolve data-related issues, ensuring data reliability and integrity for AI projects.




Profile


Bachelor's degree or equivalent practical experience in Computer Science, Data Engineering, Software Engineering, or a related quantitative field.Minimum of 6+ years of progressive experience in data engineering, with at least 3 years specifically focused on building data pipelines and infrastructure for AI/ML projects.Demonstrable strong experience with data engineering concepts and tools for AI, including data preparation for techniques like LLMs, natural language processing, and deep learning.Expert proficiency in at least one programming language commonly used in data engineering (e.g., Python, Scala, Java).Strong experience with big data technologies (e.g., Spark, Hadoop, Flink) and distributed data processing frameworks.Proven experience with cloud data platforms and services (e.g., Azure Data Factory, Azure Databricks, AWS Glue, Google Cloud Dataflow, BigQuery).




Job Offer

An exceptional opportunity to contribute to high-impact national initiatives within a leading government entity.

Preferred candidate

Career level
Management

Michael Page is comprised of 25 disciplines – each providing a service to a specialist area of the market. We recruit permanent, temporary, contract and interim opportunities, typically from second/third job levels upward. Businesses we work with range from SMEs to global blue-chip organisations. We conduct highly customised search assignments aimed at aligning our client’s missions, cultures and strategic goals with exemplary candidates. Our experienced and well networked consultants employ a high-quality, targeted and consultative approach to each mandate, thereby enabling our clients to source the talent to take their businesses to the next level. Our clients range from multinational corporations to boutique firms across all specialisms and sectors.

You have reached your limit of 15 Job Alerts. To create a new Job Alert, delete one of your existing Job Alerts first.
Similar jobs alert created successfully. You can manage alerts in settings.
Similar jobs alert disabled successfully. You can manage alerts in settings.