Magento – Magento2 Application Automation Testing – For Automation Testers

automationmagento2seleniumtesting

I am doing automation testing on Magento2 application for one of my client.

I have heard from some people there are some automated testing frameworks for Magento 2. But everything seems to be helpful for developers for performing unit test only. I am automating the application using Selenium WebDriver, TestNG and JAVA, and it is working fine. I would like to know is there any other tools or technology stack for testers to do automation testing which covers all test cases and workflows.

So I would like to get more insights on this, if you have worked on Magento 2 automation testing, please help me!

Things I would like to know:

Whether it is a good practice to automate Magneto2 application with Selenium WebDriver+TestNG+Java?
Is there any specific tool for Magento 2 Application testing for testers, not for unit testing/functional testing for developers.

Best Answer

Magento provides his own tool for automation testing called MFTF(Magento Functional Testing Framework). More detailed information how to use it you can find on the official DevDocs: https://devdocs.magento.com/mftf/2.3/introduction.html

Testing Framework Support for Magento

Ecomdev PHPUnit

Magento Support: 1.4 - 1.9
Coverage: Unit Tests
Tests Written?: No
Link: https://github.com/EcomDev/EcomDev_PHPUnit

Magento Test Automation Framework

Magento Support: 1.5 - 1.7 (Official) 1.8 - 1.9 (Unofficial, no tests for new features)
Coverage: Unit and Functional Tests
Tests Written?: Yes
Link: https://github.com/magento/taf

Magento Testing Framework

Magento Support: 2.x
Coverage: Unit Test (Functional to come)
Tests Written? Yes
Link: https://github.com/magento/mtf

Can My Magento Be Tested?

This table can give a quick view of what testing support you have available to you.

Please forgive the archaic table. SO doesn't support table markdown (that I'm aware of). I had to use an image.

Magento Test Coverage Table

Magento 2 – How to Create Integration Tests for Modules

This works for us but we haven't yet looked into moving them to a separate location to address 6.)

1.) Place your integration tests under dev/tests/integration/testsuite/Vendor
2.) copy dev/tests/integration/phpunit.dist.xml
to
dev/tests/integration/phpunit.xml

and replace

        <directory suffix="Test.php">testsuite</directory>
        <directory suffix="Test.php">../../../update/dev/tests/integration/testsuite</directory>
        <exclude>testsuite/Magento/Test/Integrity</exclude>
        <exclude>testsuite/Magento/MemoryUsageTest.php</exclude>

with

        <directory suffix="Test.php">testsuite/Vendor</directory>

3.) run it ../../../vendor/bin/phpunit or with ../../../vendor/bin/phpunit path/to/tests from the dev/test/integration folder

Please note that the integration tests take longer than 15 seconds, at least on first run as it essentially installs Magento. You can save on subsequent runs if you use

<const name="TESTS_CLEANUP" value="disabled"/>

in your phpunit.xml

Best Answer

Related Solutions

Magento 1.4 – Test Automation Framework Ambiguity

Testing Framework Support for Magento

Can My Magento Be Tested?

Magento 2 – How to Create Integration Tests for Modules

Related Topic