🛂 MasterQA

MasterQA combines automation with manual verification steps.

Here's code from basic_masterqa_test_0.py:

from seleniumbase import MasterQA

class MasterQATests(MasterQA):
    def test_masterqa(self):
        self.open("https://xkcd.com/1700/")
        self.verify("Do you see a webcomic?")
        self.open("https://seleniumbase.io/demo_page")
        self.highlight('table')
        self.verify("Do you see elements in a table?")
        self.open("https://seleniumbase.io/devices/")
        self.highlight("div.mockup-wrapper")
        self.verify("Do you see 4 computer devices?")

After each automation checkpoint, a pop-up window will ask the user questions for each verification command.

When the test run completes, as seen from this longer example, you'll reach the results page that appears after answering all the verification questions. (Failed verifications generate links to screenshots and log files.)

You may have noticed the Incomplete Test Runs row on the results page. If the value for that is not zero, it means that one of the automated steps failed. This could happen if you tell your script to perform an action on an element that doesn't exist. Now that we're mixing automation with manual QA, it's good to tell apart the failures from each. The results_table CSV file contains a spreadsheet with the details of each failure (if any) for both manual and automated steps.

How to run the example tests from scratch:

git clone https://github.com/seleniumbase/SeleniumBase.git
cd SeleniumBase
pip install .
cd examples/master_qa
pytest basic_masterqa_test_0.py
pytest masterqa_test_1.py

At the end of your test run, you'll receive a report with results, screenshots, and log files. Close the Results Page window when you're done.

Check out masterqa_test_1.py to learn how to write your own MasterQA tests:

You'll notice that tests are written the same way as regular SeleniumBase tests, with the key difference being a different import: from seleniumbase import MasterQA rather than from seleniumbase import BaseCase. Now your Python test class will import MasterQA instead of BaseCase.

To add a manual verification step, use self.verify() in the code after each part of your test that needs a manual verification step. If you want to include a custom question, add text inside that call (in quotes). Example:

self.verify()

self.verify("Can you find the moon?")

---

MasterQA is powered by SeleniumBase, the most advanced open-source automation framework on the Planet.