India Openings

Spark Developer

Job ID: Spa-ETP-Pun-884

Location: Pune,Bangalore,Other

Bridgenext is a global digital consultancy that helps clients innovate with intention and realize their digital aspirations by creating digital products, experiences, and solutions around what real people need. Our global consulting and delivery teams facilitate highly strategic digital initiatives through digital product engineering, automation, data engineering, and infrastructure modernization services, while elevating brands through digital experience, creative content, and customer data analytics services.


Don’t just work, thrive. At Bridgenext, you have an opportunity to make a real difference – driving tangible business value for clients, while simultaneously propelling your own career growth. Our flexible and inclusive work culture provides you with the autonomy, resources, and opportunities to succeed.




We are looking for an Engineer with hands-on Big Data experience who will work on the internal and customer-based projects for Bridgenext, someone who cares about the quality of the code and who is passionate about providing the best solution to meet the client’s needs and anticipates their future needs based on an understanding of the market.


Must Have Skills: 

  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • 4+ years of experience in data engineering, with a strong focus on large-scale data processing using Apache Spark and AWS.
  • Proven experience in migrating data pipelines from on-premises systems (HDFS) to cloud platforms (AWS, Databricks).
  • Strong expertise in running and optimizing Apache Spark jobs on both on-premises (HDFS) and cloud environments (AWS S3).
  • Experience with Spark resource tuning and performance optimization, including partitioning, caching, and memory management.
  • Experience with Spark SQL query optimization, including working with Catalyst Optimizer.
  • Hands-on experience with data migration tools and frameworks, especially for moving data from HDFS to S3 (
  • Strong troubleshooting skills, especially in diagnosing and resolving performance issues in Spark applications and data pipelines.



Professional Skills:

  • Solid written, verbal, and presentation communication skills
  • Strong team and individual player
  • Maintains composure during all types of situations and is collaborative by nature
  • High standards of professionalism, consistently producing high-quality results
  • Self-sufficient, independent requiring very little supervision or intervention
  • Demonstrate flexibility and openness to bring creative solutions to address issues