AI QE Engineer
Job Description
We are a digital-first technology services firm backed by Goldman Sachs Asset Management and Everstone Capital. We specialize in accelerating business transformation and delivering human-centric digital experiences. For over 28 years, Apexon has been meeting customers wherever they are in the digital lifecycle and helping them outperform their competition through speed and innovation.
AI QE Engineer - Job Description:
Role Summary We are looking for a AI QA Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications.
This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features
Core Experience
• 4-10 years as a Software Engineer, SDET, or Automation Engineer.
• Strong coding skills in Python, TypeScript, or Java.
• Hands-on experience developing automation scripts, tools, or frameworks.
• Practical experience using LLMs, prompt engineering, and evaluating AI generated outputs.
• Familiarity with agentic AI systems and exposure to tools like LangGraph, AutoGen, or CrewAI.
• Basic understanding of Model Context Protocol (MCP) or context-aware workflow automation (nice to have).
AI / ML Technologies
• Practical experience with AI/ML frameworks: LangChain, Hugging Face, GPT models, vector databases, RAG pipelines.
• Experience with ML/DL libraries such as: Scikit-learn, PyTorch, TensorFlow, Keras, Transformers, OpenCV.
• Ability to work with embeddings, similarity search, and content evaluation metrics. GenAI & AI Agent Development
• Ability to integrate or build GenAI components, including RAG pipelines or agent based workflows.
• Support model evaluation tasks such as: Output quality checks, Hallucination detection, Prompt validation, Regression checks for model updates
Automation & Quality Engineering
• Experience building automation using Python, PyTest, Selenium, Playwright, or API testing libraries.
• Ability to design and execute automated tests for: Functional Integration, API ,Basic performance & reliability testing
• Hands-on experience testing RESTful APIs and building automated API suites. Cloud, DevOps & CI/CD
• Exposure to deploying AI or automation solutions on AWS.
• Working knowledge of CI/CD pipelines, including: Automated testing ,Model validation steps Versioning & artifact management SDLC & Collaboration
• Strong understanding of the software development lifecycle, including requirements, development, testing, and defect analysis.
• Ability to collaborate with Developers, Data Scientist, and QE teams, clearly communicating progress, risks, and results.
• Skilled in documenting and tracking defects and participating in defect triage.
How to Apply
Ready to start your career as a AI QE Engineer at Apexon?
- Click the "Apply Now" button below.
- Review the safety warning in the modal.
- You will be redirected to the employer's official portal to complete your application.
- Ensure your resume and cover letter are tailored to the job description using our AI tools.
Frequently Asked Questions
Who is hiring?▼
This role is with Apexon in North York.
Is this a remote position?▼
This appears to be an on-site role in North York.
What is the hiring process?▼
After you click "Apply Now", you will be redirected to the employer's official site to submit your resume. You can typically expect to hear back within 1-2 weeks if shortlisted.
How can I improve my application?▼
Tailor your resume to the specific job description. You can use our free Resume Analyzer to see how well you match the requirements.
What skills are needed?▼
Refer to the "Job Description" section above for a detailed list of required and preferred qualifications.