02Experience
Mercor AI
San Francisco, USA — Remote
AI Evaluation Expert (Contract)
- Evaluated LLM outputs across sports, general knowledge, audio, and video tasks to improve accuracy, reasoning, and safety.
- Contributed to 6 specialized workflows: Cricket Expert (APAC), EU Football, Basketball, Audio, Short Video Captioning, Generalist.
- Performed SxS evaluation benchmarking helpfulness, correctness, and contextual understanding.
- Designed prompt writing scenarios to test edge cases and real-world reasoning.
- Identified hallucinations, logical inconsistencies, bias, and PII risks in AI-generated responses.
- Evaluated multimodal outputs (text, audio, video) under strict annotation guidelines.
AfterQuery Expert
San Francisco, CA — Remote
SWE Benchmark Engineer (Contract)
- Built and validated SWE-bench style debugging and benchmark tasks for frontier AI coding agents across multiple evaluation projects.
- Designed Dockerized environments, automated test harnesses, and reproducible bug-fix workflows for realistic AI agent evaluation.
- Developed full-stack and terminal-based engineering tasks involving React, Node.js, Express, MongoDB, Python, Flask, Linux, and CI pipelines.
- Performed regression testing, Git-based validation, patch verification, and infrastructure debugging for benchmark reliability and reproducibility.
- Contributed to large-scale AI training and evaluation workflows by creating high-quality task specifications and human-generated datasets.
Innodata India Pvt. Ltd.
Remote
AI Data Annotator & Bilingual Content Evaluator (Contract)
- Performed large-scale annotation: text classification, sentiment analysis, and NER.
- Evaluated prompt-response alignment for contextual accuracy and completeness.
- Identified bias, safety issues, and hallucinations; verified factual correctness from credible sources.
- Followed strict annotation guidelines for multilingual (English/Hindi) AI training datasets.
Venom Technologies
Anand, Gujarat
Web Developer Intern
- Developed customer and admin modules using React.js and Firebase with secure authentication.
- Integrated Razorpay payment gateway, improving checkout performance by ~40%.
- Implemented Zustand state management to optimize application performance.
Bluebell Compuserve Pvt. Ltd.
Anand
Web Development Intern
- Built a full-stack pizza ordering system using React.js and MongoDB.
- Improved UI/UX design to enhance usability and customer experience.