Sr. Backend Kafka Engineer
Location: Pune
Senior Backend Engineer (Kafka)
As a Senior Software Engineer, the individual will be responsible for designing, developing, and implementing robust solutions utilizing Kafka, Cosmos DB, and modern JavaScript frameworks. The ideal candidate should be a hands-on technologist with deep expertise in data streaming, NoSQL databases, and creating scalable back-end services. The candidate shall have the experience in Kafka Connectors (Sink Connector & Source Connectors along with backend integration experience using Cosmos DB NoSQL and Mongo on Cosmos DB.
Key Responsibilities:
Data Integration & Messaging:
o Design and implement data pipelines using Kafka and Kafka Connect.
o Manage and optimize Kafka topics, partitions, and Schema Registry to ensure efficient data streaming and messaging.
Database Management:
o Develop applications using Cosmos DB (NoSQL and MongoDB APIs).
o Optimize database operations for performance and scalability.
Application Development:
o Build back-end services and APIs using Node.js, NestJS, and Nx Framework.
System Design & Architecture:
o Design scalable, resilient, and high-performance software systems.
o Ensure system reliability and availability through monitoring, logging, and alerting mechanisms using newrelic.
Collaboration & Mentorship:
o Work with cross-functional teams to define technical requirements and deliver high-quality solutions.
o Mentor junior engineers and contribute to continuous improvement in coding standards and processes.
Required Skills & Qualifications:
- Minimum 6+ years of experience in backend development using NodeJS.
- Proficient in JavaScript, TypeScript, and frameworks like Node.js, NestJS, and Nx.
- Strong understanding of stream processing and event-driven architectures.
- Solid understanding of database design principles and performance tuning.
- Experience in designing microservices and distributed systems.
- Hands-on experience with Kafka Connect, Kafka Messaging, and Schema Registry.
- Extensive experience with Cosmos DB, including NoSQL and MongoDB APIs.
- Familiarity with CI/CD pipelines, containerization (Docker), and Kubernetes.
- Experience with cloud platforms like Azure