I am currently working on a project where we show users their metrics on dashboard and on reporting. QA team is testing it manually like running SQL queries in Database and comparing that number to UI of dashboard. Is there any way to automate this testing?
This application is written in .NET, C#. We dont use any specific reporting tool such as Cognos,....
If the dashboards are web based, you can use tools like QTP or Selenium which supports web application testing. You can also develop a Java based utility for the same if its just the numbers you want to compare. Basically, a framework which connects to the database, runs the reporting query at the backend and compares the numbers with the UI of the dashboard.
If there a way to export the dashboard or reports to excel then you can do an excel to excel comparison of the UI and backend database as well. This should be easier to achieve as compared to data comparison with backend DB.
We are using ARES dashboard(built under Testastra and owned by ZenQ) which is a good test automation dashboard based on just few api calls.
ARES, is an acronym for Test Automation Results dashboard. It's a TestAutomation framework/tool agonistic solution, that simplifies the collection of Test automation results and their analysis via live dashboard, daily/weekly trends, frequent failures etc.
Below are some of the features of ARES:
1. Tool agnostic test automation dashboard
2. SaaS based
3. Shows current live execution and historical test automation insights
4. Free for all
Website: http://www.testastra.com/#ares
Below repo has some code samples, documentation and usage of ARES test automation dashboard:
https://github.com/testastra/ARES
Worth trying.
Related
We have a template app written with flutter that each customer can buy a version of it and have the exact same functionality but connecting to a different database etc. Creating an app for each customer and deploying that app takes a lot of time, so we've decided to automate this process. For deploying updates of the apps, I was able to achieve that functionality very easily by integrating fastlane.
The part I am stuck at is how to automate app creation with all the steps (Creating the app, filling main store listing, publishing the first version, etc.). I've searched all over the internet and not found a single solution for this. For the App store there exists the fastlane produce tool, but according to the maintainers they do not plan to support an alternative for android at the moment.
As a solution I'm thinking of doing this using web scraping using tools such as puppeteer or selenium. Is there a better solution, and is doing scraping for this task a bad idea?
I am setting up a DTAP environment for Google App Maker. Google App Maker enables working in a singe file very well, however there is one use case that I would like to simplify.
For each deployment I need to "know" certain things in the back end script. Things like the ip address of the SQL server, or usernames and passwords. This information needs to be retrieved fast and often, given the stateless nature of google.script.run.
The best solution so far is a settings form, combined with google drive tables and caching. This works, but it is not simple, and things could fail easily. The other approach is hard coded and linked to the deployment url. This is fast and simple, but also means that all the credentials are in the source.
I am looking for a better solution. Apps Script used to have the script properties. Is there a similar option in App Maker, with a UI to maintain the settings.
There is no built-in UI to manage script properties, but App Maker's runtime (Apps Script) provides API to perform CRUD operations on it:
PropertiesService.getScriptProperties().setProperty('testKey', 'testValue');
...and you can 'easily' build the UI on top of this API. In answer for this question are highlighted major steps to achieve this: Google App Maker how to create Data Source from Google Contacts
Here is a feature request for the first party support. You can up-vote it by giving it a star:
https://issuetracker.google.com/issues/73584947
I am trying to a good comparison between AppDynamics and Application Insights in regard to Azure App Service.
I tried to google around but couldn't find any good comparison, if someone can point me or summarize here.
Information I got from another website.
Application Insights (AI) is a very simplistic APM tool today. It does do transaction tracing, it has very limited code and runtime diagnostics, and it doesn’t go very deep into analyzing the browser performance. Application Insights is much more like Google Analytics than like a typical APM tool.
AI does not support mobile apps, AppDynamics does Android and iOS
AI only supports Java, .NET, and node.js while AppDynamics supports many
additional languages and technologies.
AI requires code changes to do additional metric capture from the
code. AppDynamics has do this on the fly without code change on most
languages.
AI doesn’t so transaction distributed tracing, it has a simple data
collection model similar to what New Relic does. This makes
troubleshooting much harder in complex apps. If your app is simple
it’s not required.
AI lacks transaction scoring and baselining, you must set manual
thresholds. AppDynamics does this for every metric and every business
transaction.
AI doesn’t monitor databases or data stores. AppDynamics does both.
AI is SaaS only, while AppDynamics can be deployed on premises or
SaaS.
I need to get hardware information from azure web roles / web worker to monitor it for critical conditionals like high memory/cpu usage.
I tried to use some addons which are provided in the azure gallery like the one from "logentries", but the gallery doesn't support my country yet...
Is there an other way to get the log information directly?
Last option would be Azure Diagnostics, but it stores everything in blob storages and I would have to pull everything out there on my own and send it to "manually" to logentries, geckoboard or whatever.
Three good options:
Windows Azure Diagnostics. Yes, it puts everything in table/blob storage which is painful, but there are tools such as Cerebrata's Azure Management Studio that can help gather and visualize the data.
Application Insights. This is still in preview, but it provides a very rich application monitoring and alerting platform.
The built in Azure monitoring. This is not quite as feature rich as Application Insights, but it is very easy to setup and use and includes monitoring and alerting.
I'm surprised that no one mentioned New Relic.
It has a comparable feature set to Application Insights but should be way more stable since it's not in preview like Insights. (although I am following the development of Insights closely, give it a while and it will be an awesome alternative)
Backgroup:
We are looking at SAS BI Dashboard. We have currently implemented almost all of SAS's other applications (with the exception of Enterprise Miner). Other technologies online include Business Objects, some custom reporting stuff, and Project R.
The Question:
What feedback do you have with:
implementing SAS BI Dashboard
building dashboards and reports in BI
linking BI with other technologies, databases, and SAS datasets
Due to licensing costs and difficulty of implementation (you have to use a specific -- not the most recent -- version of WebLogic, etc.), we COMPLETELY dumped the BI Dashboard and replaced it with LifeRay (open source portal).
SAS analytics, graphics, etc. are surfaced through weblogic calls to the SAS Stored Process server.
I haven't used it a lot myself but a friend has and even wrote a paper for the last SAS Global Forum that is on this very topic that might have some useful info for you.
http://support.sas.com/resources/papers/proceedings09/044-2009.pdf
I haven't used the new SAS "BI Dashboard" offering, but I've done a lot of dashboards using SAS/Graph, such as the following (included here, along with the SAS code used to create them):
http://robslink.com/SAS/dashboards/aaaindex.htm
Doing dashboards this way, you can create standalone web output (like the ones above), either interactively or from a batch job, or you can generate them on-the-fly when you click on a web page via SAS/Intrnet or a BI Stored Process. The output can be viewed in a simple web browser, and/or you can display the URL output in a Portal (be it the SAS Portal, SAS Web Report Studio, or other).