Software Engineer 3

MongoDB is building a world-class team in India to create tooling that helps customers verify their application and data modernizations. As companies modernize their application and data ecosystems, ensuring functional equivalence and performance is paramount. The tools developed by the Modernization Testing and Verification team are critical in this journey, helping customers with automated testing, functional equivalence, and performance validation by creating frameworks for contract testing, database state-based testing, and leveraging LLMs for unit test generation. We are looking for an experienced Software Engineer with a strong background in building software testkits/frameworks. You will lead a talented team building a complex product suite using a modern stack. The ideal candidate will be designing and building automated frameworks that validate functional equivalence, performance benchmarks, and data integrity. From leveraging LLMs for unit test generation to building contract testing frameworks, your work will be the safety net for the world’s largest enterprise migrations. We are looking to speak to candidates who are based in Gurgaon for our hybrid working model. The ideal candidate for this role will have 4+ years of commercial software development experience with at least one JVM language such as Java, preferably using the Spring ecosystem Proven experience evaluating Large Language Models (OpenAI, Anthropic, open-weights, etc.) Familiarity with evaluation frameworks (DeepEval, Ragas, Promptfoo) and LLM-as-a-judge concepts Experience integrating Large Language Models (LLMs) into the developer workflow to automate unit test generation and edge-case discovery Experience curating golden datasets, adversarial test sets, and establishing scoring rubrics to test LLM accuracy, safety, and relevance Experience building developer tools, infrastructure, or complex testing frameworks Solid experience in software architecture and development Experience in applic