How to convert time in investing.com - web-scraping

I am trying to figure out to get 1min data from the below link through web scraping but would like to know what is the root URL for the JSON object for 1min or 5min data.
https://in.investing.com/indices/india-vix-chart or https://www.investing.com/indices/india-vix
, I can see candles data and multiple links -- in Network session --> XHR
candle Datalink: https://sbcharts.investing.com/charts_xml/cb7d5064b1983e14644a41aca0250ebc_1day.json
but here the data is completely different. I am using excel - power query to fetch the JSON directly.

Related

What is correct format/syntax of timestamp in offline event data in google analytics 4

I have some data from CRM and I wanna use Offline Event Data in Data Import of GA 4 to insert CRM's "offline data".
In CSV files that I imported multiple times, All things are good, but although no error found, "timestamp_micros" of events did not appear in results after near 24 hours and time of upload is considered as timestamp of data.
Is this format for "Timestamp_micros" is TRUE?
2021-04-08T22:25:09.335541+02:00
How can I add timestamp dimension on import data offline in Google Analytics 4? Can be done without using GTM?
I expect that timestamp related to each event would appear correctly in results and reports.
That documentation page
https://support.google.com/analytics/answer/10325025?hl=en#template
gives an example
As you see it's a Unix time format

Google Analytics 4 reported for api outdated data

My goal - getted actual data from report GA4 in Backend app, how is it done in the dashboard. But, problem - report contains only part of data. I want get active users with city in interval last half on hour. I do it like this:
BetaAnalyticsDataClient.create().use { analyticsData ->
val request: RunReportRequest = RunReportRequest.newBuilder()
.setProperty("properties/$propertyId")
.addDimensions(Dimension.newBuilder().setName("city"))
.addMetrics(Metric.newBuilder().setName("activeUsers"))
.addDateRanges(DateRange.newBuilder().setStartDate("today").setEndDate("today"))
.build()`
I get a result in which there are no cities that are currently in the dashboard on the map. I had tried in GA4 settings interval updating data, i not found this. What is reason? Thanks!
The Method: properties.runReport is the standard GA4 report, and is limited to data that has been processed. Data processing takes between 24 and 48 hours it is not meant for real time.
You need to use the Creating a Realtime Report if you want real-time data, and you are limited to the dimensions and metrics available real-time these reports are very limited.
I guess what i am saying is you are running the wrong report, and you should not expect to get the data you want from the Realtime report.

Tableau Server hourly google analytics updates

I'm setting up a Dashboard on Tableau Server and with a data source extract from Google Analytics.
I need it to refresh hourly.
When publishing the data source I have selected Fixed start and incremental refresh, and i can see that the end date is hardcoded to yesterday and I can only schedule update once a day.
This means that my Dashboard will only have data for the previous day. Is this a known limitation? Is there a way to achieve hourly automated data refreshes?
I thought of three possible solutions:
1) Using command line data extract update, but I don't see any parameter that allows me to control date range, so the end date would always be hardcoded to yesterday (?)
2) Using Tableau API. But again, my extract will only refresh to latest day yesterday.
3) Setting up a separate process to download the data into a database and then connect to it with Tableau. Not sure if in this case I will be able to incrementally update the extract or if I have to reload the entire extract all the time.
Any help would be much appreciated!!

Attempting to design a flexible reporting system. Getting stuck

I’m having some trouble coming up with a future-proof-ish design for reports for a company. Essentially the requirements are:
Be able to pull whatever data from the database
Generate formatted report from that data by populating a template (HTML, docx)
Export to Word and/or PDF
So initially I made an API endpoint per report (this is a web app), and had PDFs generated and formatted correctly.
But now I need to get the data into .docx/Word format, and I’m trying to figure out how I can design something as D.R.Y. as possible so that I don’t have to put in a TON of work every time the company decides they need another report (they’ve done this two, three times which is how I became aware that I had coded myself into a corner).
Every report I’ve done thus far has been done via a “brute-force” method: code the queries needed for the report, format the data, and then render to PDF (using HTML to PDF via phantomjs).
The complexity occurred when the company came back and said “Hey, we need all of those reports in Word format, also we have 3 other new reports that we need and a report that is a slight variation on the old one but +/- 2 fields”.
I am just having trouble coming up with a solid design/abstraction here, one that doesn’t send me down a week long hacking spree every time a requirement changes.

Sessions by Page load time

putting together a report and I want to try to duplicate this report: https://www.soasta.com/blog/mobile-web-performance-monitoring-conversion-rate/. Trying to figure out how to do it in custom reporting in Google Analytics, but am having a difficult time coming up with the right format. the metrics i need are page load time and conversion rate, but when putting together a custom report i need to enter in a dimension too.... wondering if this is even possible given the way GA collects and stores data. Thanks!!
This is no possible with Google analytics, as it is not possible to use a measure (load time) as a dimension (in the X axis) inside custom reports or dashboards.
What you can do instead is download this data in a spreadsheet format, and create the chart in a spreadsheet.

Resources