We are seeking a highly experienced Software Development Engineer in Test for AI Testing to join our team.
In this role, you will develop and test AI-based applications using open-source tools and frameworks. You will utilize your strong Python development skills and expertise in machine learning libraries such as scikit-learn, Pandas, and Numpy, to build and test retrieval augmentation generation (RAG) based applications.
Responsibilities
Design and develop test plans and test cases for AI-based applications
Collaborate with cross-functional teams to ensure the quality and accuracy of the AI-based applications
Develop and maintain test automation frameworks for AI-based applications
Conduct performance and scalability testing of AI-based applications
Provide technical guidance and mentorship to junior team members
Stay up-to-date with emerging trends and technologies in AI testing
Requirements
Minimum of 5 years of experience in Software, System, and Test Engineering with mandatory working project experience in testing AI-based applications
Expertise in Python development and machine learning libraries such as scikit-learn, Pandas, and Numpy
Experience in building and testing retrieval augmentation generation (RAG) based applications using open-source tools and frameworks
Strong knowledge of Langchain components and Langsmith, vector databases, and prompt engineering skills
Ability to evaluate and test LLMs using tools and open-source libraries
Excellent verbal and written communication skills in English at a B2 level
Nice to have
AI Developer certification from any of the cloud providers (AWS, Azure, GCP)
Exposure to tools and open-source libraries for the evaluation and testing of LLMs
We offer
Opportunity to work on technical challenges that may impact across geographies
Vast opportunities for self-development: online university, knowledge sharing opportunities globally, learning opportunities through external certifications
Opportunity to share your ideas on international platforms
Sponsored Tech Talks & Hackathons
Unlimited access to LinkedIn learning solutions
Possibility to relocate to any EPAM office for short and long-term projects
Focused individual development
Benefit package:
Health benefits
Retirement benefits
Paid time off
Flexible benefits
Forums to explore beyond work passion (CSR, photography, painting, sports, etc.)
