Company logo

QA Automation

Weekday AI

Full-time

On-site

Pune, India

Description

This role is for one of Weekday’s clients
Salary range: Rs 500000 - Rs 700000 (ie INR 5-7 LPA)
Min Experience: 5 years
Location: Pune
JobType: full-time

Requirements

About the Role

We are seeking a highly skilled QA Automation Engineer with strong experience in automation testing and a deep understanding of AI/ML systems. This role is ideal for someone passionate about quality, automation frameworks, and ensuring high-performance, reliable products. You will be working closely with developers, product managers, and data scientists to ensure our AI/ML-powered products are thoroughly tested, functionally robust, and performance-optimized.

This position offers a unique opportunity to work at the intersection of QA automation, Python programming, and AI/ML testing, driving innovation in how software quality is maintained in modern intelligent systems.

Key Responsibilities

  • Automation Framework Development:
    Design, develop, and maintain robust automation frameworks using Python to validate functionality, performance, and scalability of applications, with a focus on AI/ML systems.
  • Test Strategy & Planning:
    Define test strategies for new features, focusing on both functional and non-functional aspects, especially for ML models and data pipelines.
  • AI/ML Testing:
    Collaborate with data scientists to develop test scenarios for machine learning algorithms, model validation, performance, accuracy, and bias detection.
  • Integration & End-to-End Testing:
    Ensure complete test coverage across system components — from backend services to user interfaces — especially when ML models are part of the pipeline.
  • Automation Execution & Maintenance:
    Write clean, scalable, and maintainable test scripts and manage regular test runs through CI/CD pipelines.
  • Bug Reporting & Root Cause Analysis:
    Identify bugs, document reproducible test cases, and assist development teams in root cause analysis and resolution.
  • Collaboration & Review:
    Work with cross-functional teams including engineering, product, and analytics to understand requirements, define test cases, and improve test coverage.
  • Performance & Load Testing:
    Conduct performance testing for AI-driven components to ensure they meet latency and scalability requirements.

Required Skills and Qualifications

  • Experience:
    At least 5 years of hands-on experience in QA automation, preferably in a product-based or AI-driven environment.
  • Automation Expertise:
    Strong programming skills in Python and experience building/maintaining test automation frameworks (e.g., Pytest, Selenium, Robot Framework).
  • AI/ML Testing:
    Exposure to testing AI/ML applications, including understanding of machine learning workflows, model evaluation metrics, and potential edge cases.
  • CI/CD & Tools:
    Familiarity with CI/CD tools like Jenkins, GitHub Actions, or GitLab. Experience with test management tools like JIRA, TestRail, or Zephyr.
  • Quality Mindset:
    In-depth knowledge of software QA methodologies, tools, and processes, with a strong emphasis on automation-first principles.
  • Problem Solving:
    Ability to troubleshoot complex systems and conduct deep-dive investigations when things go wrong.
  • Education:
    Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related technical field.

Nice to Have

  • Understanding of ML frameworks (e.g., TensorFlow, PyTorch)
  • Knowledge of data validation frameworks and tools (e.g., Great Expectations)
  • Exposure to testing data pipelines, APIs, and microservices