Big data Developer

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
 

Overview

We are looking for an experienced Big Data Developer to design, develop, and optimize large-scale data processing systems. The ideal candidate should have strong hands-on experience with big data technologies and a solid understanding of data engineering principles. You will work closely with cross-functional teams to build efficient data pipelines, perform data analysis, and support business-critical financial solutions.

Required Qualifications

• Experience
  • Minimum of 5 years of overall IT experience, with at least 3 years of hands-on experience in Big Data technologies.
  • Proven experience working with large-scale, high-volume datasets in distributed environments.
• Technical Skills
  • Strong proficiency in Hadoop ecosystem tools, including:
    • HDFS (Hadoop Distributed File System) for data storage
    • Hive for data querying and warehousing
    • Sqoop for data ingestion from relational databases
  • Advanced knowledge of Apache Spark, including:
    • Spark Core, Spark SQL, and Spark Streaming (preferred)
    • Performance tuning and optimization techniques (e.g., partitioning, caching, memory management)
  • Solid programming skills in Python and PySpark for data processing and pipeline development
  • Strong command of SQL for complex queries, data transformations, and performance tuning
• Data Engineering & ETL
  • Hands-on experience in data sourcing, ingestion, and extraction from multiple structured and unstructured data sources
  • Strong understanding of ETL (Extract, Transform, Load) concepts, data modeling, and workflow orchestration
  • Experience building and maintaining robust data pipelines for batch and/or real-time processing
• Domain Knowledge
  • Prior exposure to financial services projects or products is mandatory
  • Understanding of financial data structures, reporting, or regulatory requirements is a plus
• Analytical & Problem-Solving Skills
  • Strong analytical thinking with the ability to troubleshoot and resolve complex data issues
  • Expertise in data analysis, root cause investigation, and data validation
• Soft Skills
  • Excellent communication skills with the ability to collaborate effectively with stakeholders, business users, and technical teams
  • Ability to coordinate with end users to understand requirements and deliver data solutions accordingly
  • Strong attention to detail and commitment to data quality and accuracy

Education:

• Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

Familiar with HIVE, HDFS, SPARK, PYTHON, PYSPARK, SQL and SQOOP.
Knowledge and experience of DataBricks is a plus
Should have strong knowledge on spark framework and its optimization techniques.
Should be having good hands-on experience on data sourcing, data extraction projects.

------------------------------------------------------

------------------------------------------------------

------------------------------------------------------

------------------------------------------------------

------------------------------------------------------

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.
View Citi’s EEO Policy Statement and the Know Your Rights poster.