Job Description

ata-end="263" />Experience: 6+ years total, with 3+ years of relevant experience in Kafka & Cosmos DB
Employment Type: Full-time

Job Summary:

We are seeking a skilled and experienced Tech Lead to join our offshore team in Chennai to lead the development and support of OB Portal systems leveraging Apache Kafka and Azure Cosmos DB. The ideal candidate will have a strong background in event-driven architecture, real-time data processing, and cloud-native application development.

Key Responsibilities:

• Lead the architecture, design, and implementation of scalable data pipelines using Kafka and Cosmos DB.

• Develop, test, and deploy Kafka producers and consumers for handling high-volume, real-time data streams.

• Design and optimize data models, partitioning strategies, and indexing in azuCosmos DB for performance and scalability.

• Implement Kafka Connectors to integrate with diverse data sources and targets, including Cosmos DB.

• Develop microservices and APIs based on Kafka-based event-driven architecture.

• Ensure data reliability, availability, and performance across distributed systems.

• Collaborate with cross-functional teams to define technical requirements and system architecture.

• Leverage Azure services like Function Apps, Event Hubs, and others for supporting application and data workflows.

• Troubleshoot production issues, perform root cause analysis, and implement effective solutions.

Required Skills & Experience:

• 3+ years of hands-on experience with Apache Kafka – including setup, configuration, and stream processing.

• Proven expertise in Azure Cosmos DB (NoSQL/SQL API) – data modeling, query tuning, and operational support.

• Solid experience with Kafka Connect, Schema Registry, and Avro/JSON serialization.

• Strong proficiency in designing real-time, distributed systems and data pipelines.

• Proficient in Azure ecosystem, especially Function Apps, Event Hubs, and monitoring tools.

• Experience in microservices development using any modern backend language (Java, .NET, Python, etc.).

• Familiarity with CI/CD tools and DevOps practices in cloud environments.

• Strong problem-solving, communication, and leadership skills.

Preferred Qualifications:

• Azure certification (e.g., Azure Developer Associate, Azure Data Engineer)

• Experience working in Agile/Scrum teams.

• Familiarity with security and compliance best practices for data systems.

Skills Required

• Agile
• Apache Kafka
• Azure
• Azure Cosmos DB
• Communication Skills
• Core Java
• Cosmos DB
• Kafka
• Kafka Security
• Leadership Skills
• NoSQL
• Problem-Solving Skills
• SQL