HP ALM is my current test management tool and I'm currently planning on using TestCafe for automation. I would like to know if I can have the results from my test runs in TestCafe shown in HP ALM?
Is it possible to make an integration or automatically generate reports in TestCafe that can then be imported to HP ALM? I have read about reporters for TestCafe but I'm unsure about the extend of their functionality.
Thanks
You might want to have a look at Agiletestware Bumblebee - it can parse reports from various testing tools.
For TestCafe, you can use xunit reporter to produce xUnit reports, e.g.:
testcafe chrome test.js -r xunit:result.xml
This will generate result.xml file which can be then uploaded to ALM with Bumblebee Server and CI plugin for Jenkins/TeamCity/Bamboo.
Please refer to the documentation.
Disclaimer: I'm developing Bumblebee Server
I could not find any HP ALM plug-ins for TestCafe at this time.
You can create your own reporter for HP ALM by following the instructions from the documentation: Reporter Plugin.
Related
I am using WebdriverIO for the e2e automation testing. I would like to get the code coverage for my e2e tests. Is there any way I can get the code coverage for e2e tests?
Thanks in advance :)
Of course that's possible, see https://webdriver.io/docs/devtools-service.html#chrome-devtools-access.
Basically, instrument your code and grab the count after ech test or use browser build in feature
I created a npm module for this: https://www.npmjs.com/package/wdio-coverage-service
It is possible. Most automation tools now days have a plugin which can talk external code coverage services and get the stats after a test run is complete.
The steps are
Instrument your dev src code using a popular instrumentation tool called istanbul (https://istanbul.js.org/)
Serve the instrumented src code on your local machine
Run E2E Tests against the instrumented src code app
After run, the code coverage report is generated
more details: https://webdriver.io/docs/devtools-service/#capture-code-coverage
Also if you need complete details with video, Cypress has some live tutorial videos, this won't help you with wdio exactly, but you will get an overall idea of how coverage works with e2e: https://docs.cypress.io/guides/tooling/code-coverage#Introduction
No, it is not possible. It is black box testing - your tests can't reach code of your code and check what functions are called and check code coverage.
Check Black box testing - because E2E is kind of Black box testing.
I am able to run automation tests on sample flutter application using flutter_driver on Android Emulator. I am looking for options of executing on Device Clouds. There are few threads which talk about executions on AWS Device Farm. However, I am interested in Firebase Test Lab. Similar to how we can execute automated scripts in SauceLabs, is there an option to run automated tests in Firebase Test Lab using flutter_driver?
It's currently not possible. Test Lab only supports testing Android apps with Espresso or UI Automator, and iOS apps with XCTest. There is currently no other framework support. As stated in the documentation:
Test Lab runs Espresso and UI Automator 2.0 tests on Android apps, and XCTest tests on iOS apps. Write tests using one of those frameworks, then run them through the Firebase console or the gcloud command line interface.
Feel free to file a feature request with Firebase support.
Instead of flutter_driver , use integration_test package
Tests written with the integration_test package can:
1- Run directly on the target device, allowing you to test on multiple Android or iOS devices using Firebase Test Lab.
2- Run using flutter_driver.
3- Use flutter_test APIs, making integration tests more like writing widget tests.
You can learn more about Migrating from flutter_driver here .
I have reportportal installation running on Windows box. I am planning to use it as dashboard to look at unit test and other automated test results. I understand reportportal integration with unit test frameworks is done at the logger level so that the test app itself can send results back to dashboard.
I have a scenario where the test application is an exe that I want to launch by sending a command from dashboard to system under test.
Are there any provisions for doing it?
Do I have to build an agent that talks to reportportal using its api for this?
Thanks
No, nothing similar at the moment.
It is pretty popular request, so we have it in backlog, but still focus on test reports aggregations first. And the other types of functionality will come later.
I have created test result file at particular Unix Sever as below
TC1,Pass
TC2,Fail
TC3,Pass
........
and so on
with the help of jenkins jobs
I have to upload/update test cases result accordingly in HP ALM test lab.
I have two challenges
1. Transfer this test result file from Unix Server to Jenkins work space
2. And then tried to load result in HP ALM using HP ALM plugin
In step 2, It ask for testing framework(Junit,NUnit,TestNG), which I have not used any.
Please suggest...
Have a look at Agiletestware Bumblebee (http://www.agiletestware.com/bumblebee.html).
It has Jenkins plugin which can execute tests in HP ALM and/or upload test execution results in various formats into HP ALM
We are in the process of implementing automated regression testing for our applications, and are looking for a solid batch-testing utility. We have QuickTest Professional 10.0, and it comes bundled with 'Test Batch Runner' which appears to be deprecated. It appears in previous versions there was 'Multi-Test Manager', which has been discontinued as well.
What alternatives exist, if any?
The canonical way to do this is via Quality Center, if you don't have QC you can use QTP's automation model from a vbs file. The documentation for this is available in Start -> Programs -> QuickTest Professional -> Documentation -> Automation Object Model Reference
QTP 10 works excellent with Multi Test Manager V8.2.4.
We use it for our project (previously used it with QTP 9.2).
Try google for an installation (of you don't have one), it should be free but just not supported by HP anymore.
From WinRunner times I very extensively used Test Driver scripts with great success due to the following benefits:
non-programming testers can easily create/maintain batches as their stored in XML format
test input files are externally configurable through mapping
a variety of customization parameters supported, from login credentials to prefixes and switches
test dependencies could be established so that if critical test cases is failed the whole branch of dependant test cases is skipped.
Now I continue using Test Drivers and introducing them to clients.
And Test Driver approach was integrated not only by the client companies that do not use Quality Center. Some others followed it because it gives much more flexibility and robustness in automated test plan execution.
Thank you,
Albert Gareev
http://automationbeyond.wordpress.com
I echo Motti...if i get your question right ....You can see the below written link as well..
Work with Test Batch runner