How to develop data visualization for time series database? - graph

I have a time series database for which I have to build a front-end. The front-end needs to contain some panels and graph on the basis of the data provided to it from database. Can anyone suggest me a tool which I can use to build the front-end and then connect with the database (InfluxDB)?

You have two popular options as follows:
Chronograf: The 'C' letter of the TICK Stack. It offers a complete dashboarding solution for quickly visualising the data that you have stored in InfluxDB. You can run queries and build alerts easily. It is very simple to use and includes several templates. However, it does not have plugin support to extend its visualisation capabilities. For example, there is no a pie chart and traffic light visualisation out-of-the-box.
Grafana: This is the other popular option. It provides the similar beautiful dashboarding capabilities as Chronograf, but in contrast, you can use it to visualise the data that not only stored in InfluxDB but also other data stores such as Prometheus, Elasticsearch, Graphite, etc. It allows you to install community developed plugins to extend visualisation capabilities of the solution.
In summary, both are very good and can be easily integrated to InfluxDB. I find Grafana more flexible and feature rich. Grafana is used more widely so you may find answers for specific questions easier. I also recommend that you have a look at issues in both solutions' GitHub account before coming to a conclusion.

Related

How can i ship new features only for a group of users?

I would like to ship some new features just for a specific group of users to better test it in production and then release it progressively to everyone, should i put IFs in my code and assign specific policies to users in the database?
Is there a better way to do it?
The normal way to handle this is have two versions of your software. The "main" version is the one most people are on, but you also release an "experimental" version which has the new features.
There are various ways to manage the software, but you should look to use strong version management practices in your source code repository, perhaps using some good branching techniques. You should avoid the two versions from diverging too much.
You can choose to invite certain users to the "experimental" version, or have them opt in but give the necessary caveats that things might not work as well, and if you have any SLAs then you might want to caveat them. If you are hoping users will provide you with feedback then make sure there is a good mechanism for that and that the users are aware of it.
If you have client software then uses will need to get hold of the new version themselves. If your software is purely server side (eg a web application or SAAS platform) then you might look at a routing layer eg in the load balancer which automatically sends users to the normal or experimental version depending on whether they are part of the relevant group.
This is a common scenario in software and you should be able to do some good research. I suggest you start by looking into A/B testing.

Which technology supports creating a web application for graph and tree visualisation?

I am looking for a technology which offers the best and the easiest way to create a specific web application. Besides the standard features like registration, login, CRUD etc., the application needs to give a user the ability to interact with graph/tree structures:
Create a graph/tree
Add/remove/edit nodes and edges
Visualise the current version of a graph/tree
Visualisation and interaction with the visual is the only challenge here. Animations are nice to have, but not mandatory.
If you have any tutorial or example project, I would appreciate it.

Google Data Flow Compared to Ms SSIS ETL Tool

Hi All GCP Developers,
I am Newbie to GCP Data Engineering Products, With an Experience in Microsoft SSIS ETL Tool, I would like to Know what are the Various Transformations And Functionalities are available in Google Data Flow. MS SSIS Tool Provide Easy Interface (Drag and Drop ) and SQL Usage to Perform ETL.
Data flow is mostly written in Python but how do you change or load only certain rows in a CSV/Text File when the particular field value is less than required amount ( Filtering of rows based on one field ) ?
Data flow Name is everywhere(Online) but why No Documentation of Data Processing Examples is Available?
If you Know any online course (other than coursera ) or Book with Practical and Hands-on please share it.
Thank you
Dataflow is a managed Apache Beam service, so general Beam quickstarts apply, just set the runner to DataflowRunner.
Here you can find a summary of available transforms (including the Filter you’d use for the example of filtering rows you mentioned) for the Java SDK. Beam is also available for Python and for Golang, but the Java API is the most mature of the three.
Also, if you want a graphical interface more similar to Microsoft SSIS, you may want to look into Dataprep, which is built on top of Dataflow and does provide some more interactive features.

Creating collaborative data flow charts

I need a tool which can be installed on .aspx platform (on a intranet of a company) which can be used to create collaborative data flow chart diagrams (multiple users can edit the diagram by visiting the intranet webpage).
Have you tried gliffy? - I've seen it used on intranets before, not sure if it's .net or if you can share it, but I recommend it.
I am not aware of a collaborative diagram program that allows you to store the data on your servers. An on premise solution would probably be prohibitively expensive. These SaaS guys aren't really setup to provide that option. You probably would have to get an open source solution and build it out yourself. The company that I work for (Lucidchart) does have a flow chart maker that allows you to lock down the domain so you can't share it with third parties and allows license de-provisioning for someone who leaves the company.
Source: I works for a diagramming company.

Data visualization / analytics / dashboard in ASP.NET (NOT Google analytics integration)

I need to create an ASP.NET site which can display graphs, charts, statistics for a dashboard type application pulling data from a backend data source.
I am trying to locate either:
(a) open-source modules that I can use / build up on
(b) tutorials which teach the above
(c) existing modules (preferably low-cost) that work well.
I did the basic googling, but found only VERY expensive paid solutions (eg: http://www.dundas.com/ $700+, http://www.devexpress.com/ $300 * n).
For simple visualizations, you should take a look at the EXTJS library. It's a free javascript framework.
http://www.sencha.com/products/js/
There are several good examples of dynamic charts there and I've found the API is pretty easy to use.
A non-free library that you can always go to is Adobe's Flex platform. That will give you more of a sexy front end. A basic license for Flash Builder (which comes with the Flex library) is only $249, so that may be within your budget.
If you can publish your data as JSON objects and have the results displayed in a browser, Protovis is a free JS library that's pretty nice to work with:
http://vis.stanford.edu/protovis/
ASP.NET is shipped with everything you need to build the application without having to purchase additional components.
(a) there are plenty of open source projects around charting. http://www.codeproject.com/KB/graphics/zedgraph.aspx
(b) there are plenty ASP.NET tutorials on the next including ones related to charting. Google is your friend here!
(c) see point a (if I understand well what you are asking for.
And the last but not least, don't hesitate to ask your questions on stackoverflow.com !

Resources