Quality Assurance Engineer (Remote)

Other Jobs To Apply

Description

Who We Are - Motivated by Purpose. Powered by Clinical Expertise.

Founded in 1983, we're a clinically-driven, tech-enabled utilization management company offering expert clinical reviews, regulatory guidance, and actionable insights to healthcare organizations.

Excellence starts with our people.

WE OFFER

  • A competitive compensation package
  • Benefits include healthcare, vision, and dental insurance
  • A generous 401(k) match
  • Paid vacation, PTO, and holidays
  • Growth and training opportunities
  • An award-winning remote work environment


POSITION OVERVIEW

Quality Assurance Engineer is a corporate function within the Engineering organization responsible for the quality, reliability, and release-readiness of software products built on modern technologies, including cloud-native applications hosted on Microsoft Azure and AI/ML-enabled features.

Roles:

  • Primary role is testing software applications created or updated by the Application Development team.
  • Conduct structured peer and code reviews of test artifacts to ensure adherence to standards and best practices.
  • Design, create, and maintain realistic and compliant test data sets, including synthetic data for healthcare (PHI-safe) scenarios.
  • Design and execute validation strategies for AI/ML and Retrieval-Augmented Generation (RAG) features, including model quality, grounding, and safety evaluation.


Major Responsibilities or Assigned Duties:

  • Participate in the test management lifecycle, including test planning, execution tracking, defect management and reporting.
  • Provide input on release readiness criteria to Engineering and Product stakeholders.
  • Maintain the regression suite after every release.
  • Develop and maintain automated test suites in Python (e.g., pytest) and JavaScript/Node.js, integrated into CI/CD pipelines.
  • Write and review complex SQL queries, joins, and aggregations to validate data accuracy, completeness, and reconciliation across systems.
  • Validate data flows across source systems, transformation layers, and reporting/consumption layers.
  • Ensure test data supports both functional automation and AI/ML / RAG evaluation needs.
  • Design and execute test strategies for AI/ML and Retrieval-Augmented Generation (RAG) pipelines and AI-assisted features, including retrieval accuracy, grounding, hallucination, output quality, bias/safety, and drift (regression) checks.
  • Build and maintain automated evaluation harnesses and datasets for AI/ML features, including prompt/response scoring and metric tracking.
  • Validate applications, APIs, and test environments deployed on on-prem data center, Microsoft Azure, including Azure-hosted services, data stores, and CI/CD pipelines.
  • Read and interpret React / Node.js / Python / ColdFusion source code, pull requests, and technical designs to identify testable conditions, edge cases, and regression risk.
  • Write detailed test cases and test plans that trace directly to code paths, business rules, and acceptance criteria.
  • Partner with developers during code review to flag insufficient test coverage, untested branches, and high-risk changes before merge.
  • Perform post-deployment validation to confirm application, API, and AI feature stability in production.
  • Investigate production defects and data issues, perform root cause analysis, and drive resolution with Engineering.


Requirements

Skills and Experience:

  • 5+ years of experience in automated software testing
  • 5+ years of experience in manual software testing
  • 5+ years of experience in component-level testing
  • 5+ years of experience in end-to-end testing
  • Proficiency in SQL
  • Proficiency in React
  • Proficiency in Node.js
  • Proficiency in Python source code in GitLab
  • Proficiency in testing Artificial Intelligence (AI)
  • Proficiency in testing Machine Learning (ML)
  • Proficiency in evaluating Artificial Intelligence (AI)
  • Proficiency in evaluating Machine Learning (ML)
  • Proficiency in testing Retrieval-Augmented Generation (RAG)
  • Proficiency in testing generative AI features
  • Proficiency in testing workloads on Microsoft Azure


Education:

  • High School Diploma required
  • Bachelor's degree (Advantage)


Work Environment:

Ability to sit at a desk, utilize a computer, telephone, and other basic office equipment is required. This role is designed to be a remote position (work-from-home).

Diversity Statement:

Diversity creates a healthier atmosphere: All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status, sexual orientation, gender identity or expression, marital status, genetic information, or any other characteristic protected by law.

Drug-Free Workplace:

This company is a drug-free workplace. All candidates are required to pass a Background Screen before beginning employment. All newly hired employees will take a Drug Screen, as well as agreeing to all necessary Compliance Regulations on their first day of employment. Employees are required to adhere to all applicable HIPAA regulations and company policies and procedures regarding the confidentiality, privacy, and security of sensitive health information.

California Consumer Privacy Act (CCPA) Information (California Residents Only):

  • Sensitive Personal Info: MRIoA may collect sensitive personal info such as real name, nickname or alias, postal address, telephone number, email address, Social Security number, signature, online identifier, Internet Protocol address, driver's license number, or state identification card number, and passport number.
  • Data Access and Correction: Applicants can access their data and request corrections. For questions and/or requests to edit, delete, or correct data, please email the Medical Review Institute at HR@mrioa.com.
Back to blog

Other Jobs To Apply

Flexible Hours, Remote Work, Customer Service Role Paying Up To 19 Per Hour

Remote Presentation Designer: High-Impact Storytelling

Remote Communications Director - Clinical Education & PR

Remote Market Merchandising Director

Remote Podcast Audio & Video Editor

Project Manager - Remote

Advocate-Art is hiring: Remote Freelance Illustrator: Global Opportunities in Ca

Remote Clinical Review Pharmacist

Instructional Designer - Fully Remote

Remote Out of Office Position / Data Entry (Hiring Immediately)

Full & Part Time Work From Home Typing / No Experience / Data Entry

Work from Home Scheduling Coordinator

Remote Copy Editor

Remote Sr GRC & Compliance Manager (CST & EST considered)

Artist Label Partnerships Manager, Taiwan

Reyes Coca-Cola Bottling is hiring: Program Manager, Government Relations & Publ

Cybersecurity Engineer (FedRAMP) (US Remote)

Remote Copywriter for Nonprofit Growth & Conversion

Senior Care Specialist (Registered Nurse) Work From Home

Backend Engineer, Podcast Job at Spotify in New York

Music Declares Emergency US is hiring: Remote Grant Writer Climate & Music Advoc

Programs Coordinator - Farming Education (Hybrid/Remote)

Senior Art Director — Remote, Equity Eligible

Remote Financial Analyst

Call Center Specialist [Work From Home - Night Shift - Full Time]

Virtual VC3 PA: Chronic Care Specialist

Virtual VC3 PA: Chronic Care Specialist

Remote Social Media Content Creator – TikTok & IG

Customer Service Rep-West Coast -Remote

Director, AI-Powered Corporate PR Job at Workday, Inc. in San Francisco

Remote Account Manager Aviation Marketing & Growth

Remote Data Validation Associate (Cannabis Sales Ops)

Entry Level Remote Benefits Advisor

Remote Senior Corporate Communications Strategist

Concept Artist, Illustrator

Director, eCommerce Sales (Digital Marketing)

Postal Clerk – USPS Careers (Join the Team Today) – Hiring Now

NDT Assistant

[Remote] Treasurer/Operations Leader of Non Profit

Associate Attorney- Can Be Remote!

Senior Creative Team: Art Director & Copywriter (Remote)

Sr. Claims Specialist, Commercial Casualty - Remote

(Remote) Consulting Manager

WFH Remote Customer Service/Data Entry

Remote Adjunct ABA Professor

Senior HV Project Manager (Remote)

Franchise Leader: Build a Winning Team & Grow a Local Brand

Healthcare Brand Graphic Designer - Part-Time & Remote

Remote Medical Billing/Coding Specialist

Remote 2D Animator for Cinematic Anime Teaser Job at Twine in Indiana

Common Interview Questions And Answers

1. HOW DO YOU PLAN YOUR DAY?

This is what this question poses: When do you focus and start working seriously? What are the hours you work optimally? Are you a night owl? A morning bird? Remote teams can be made up of people working on different shifts and around the world, so you won't necessarily be stuck in the 9-5 schedule if it's not for you...

2. HOW DO YOU USE THE DIFFERENT COMMUNICATION TOOLS IN DIFFERENT SITUATIONS?

When you're working on a remote team, there's no way to chat in the hallway between meetings or catch up on the latest project during an office carpool. Therefore, virtual communication will be absolutely essential to get your work done...

3. WHAT IS "WORKING REMOTE" REALLY FOR YOU?

Many people want to work remotely because of the flexibility it allows. You can work anywhere and at any time of the day...

4. WHAT DO YOU NEED IN YOUR PHYSICAL WORKSPACE TO SUCCEED IN YOUR WORK?

With this question, companies are looking to see what equipment they may need to provide you with and to verify how aware you are of what remote working could mean for you physically and logistically...

5. HOW DO YOU PROCESS INFORMATION?

Several years ago, I was working in a team to plan a big event. My supervisor made us all work as a team before the big day. One of our activities has been to find out how each of us processes information...

6. HOW DO YOU MANAGE THE CALENDAR AND THE PROGRAM? WHICH APPLICATIONS / SYSTEM DO YOU USE?

Or you may receive even more specific questions, such as: What's on your calendar? Do you plan blocks of time to do certain types of work? Do you have an open calendar that everyone can see?...

7. HOW DO YOU ORGANIZE FILES, LINKS, AND TABS ON YOUR COMPUTER?

Just like your schedule, how you track files and other information is very important. After all, everything is digital!...

8. HOW TO PRIORITIZE WORK?

The day I watched Marie Forleo's film separating the important from the urgent, my life changed. Not all remote jobs start fast, but most of them are...

9. HOW DO YOU PREPARE FOR A MEETING AND PREPARE A MEETING? WHAT DO YOU SEE HAPPENING DURING THE MEETING?

Just as communication is essential when working remotely, so is organization. Because you won't have those opportunities in the elevator or a casual conversation in the lunchroom, you should take advantage of the little time you have in a video or phone conference...

10. HOW DO YOU USE TECHNOLOGY ON A DAILY BASIS, IN YOUR WORK AND FOR YOUR PLEASURE?

This is a great question because it shows your comfort level with technology, which is very important for a remote worker because you will be working with technology over time...