I would like to get details and monitor the refresh time for dashboards and reports in PowerBI daily. How to I scrap the table details from Power BI site (without manual copy and paste as I have a lot of them).
For example, I would like to extract the table shown in image below into a csv/xlsx file.
Examples
I tried to use the default get data from weburl in PowerBI but it doesn't work. :(
Related
I have a situation where I need to extract tables from 13 different links, which have the same structure, and then append them into only one table with all the data. This way, at first I extracted the links from a home page by copying the link from the respective hyperlink, and then import the data through the Web connector on Power BI. However, 3 months later, I realized that those links changed every quarter but the link from the homepage where they are listed remain the same.
This way, I did some research and I found out this video on YouTube (https://www.youtube.com/watch?v=oxglJL0VWOI), which explained how I can scrape the links from a website, by building a table with the header of the link as a column and the respective link as another column. This way, I can have the links automatically updated, whenever I refresh the data.
The thing is that I am having issues to figure out how can I use this links to extract the data automatically without having to copy them one by one and then import the data using the Power BI Web connector (Web.BrowserContents). Does anyone can give me a hint of how can I implement this?
Thanks in advance!
I'm working on a dashboard in Google Data Studio and my manager would like to have the last edited time of the Data Studio report displayed on a page in the report. I'm using Google Sheets as the data source for all the charts used. (I do not want to display the date when the Sheet was last edited, but the date when the Data Studio Report was last edited.)
I've tried adding a scorecard and messing around with the fields and formulas to display the date, but I'm only able to show the current date and not the date when the report was last edited.
I'm guessing maybe there's a way to connect to Google Analytics to make this possible, I'm not really sure how. Although, if there's a way without using Google Analytics, that would be wonderful.
I'm not a Data Studio expert, so there might be a way.
But from what I gather from https://support.google.com/datastudio/answer/9265174, easy access to version history requires report edit permissions:
Limits of version history
In order to see version history, you must have edit permission to the report or data source .
First time question here! I'm new to R and am trying to have some fun in it with some NBA data. I want to automatically download shot tracking data and put get it into R so I can produce images, run analysis, etc.
I have been unable to find a website that displays all of the necessary data that I could just grab through web scraping so I turned my attention to finding files that have all of the data.
I found a website that has exactly the data I am looking for, but to download it I have to click a download button. In the upper right corner of the chart at the below link there is a "download csv" link that gives me all of the data related to every shot taken in the NBA. Can anyone please help me to figure out how I can automatically get this with R instead of going and manually downloading it each day?
Below is the link.
http://nbasavant.com/shot_search.php?hfST=&hfQ=&hfSZB=&hfSZA=&hfSZR=&ddlYear=2017&txtGameDateGT=&txtGameDateLT=&ddlGameTimeGT_min=&ddlGameTimeGT_sec=&ddlGameTimeLT_min=&ddlGameTimeLT_sec=&ddlShotDistanceGT=&ddlShotDistanceLT=&ddlTeamShooting=&ddlTeamDefense=&hfPT=&ddlGroupBy=player&ddlOrderBy=shots_made_desc&hfGT=0%7C&ddlShotMade=&ddlMin=0#results
I’m having some trouble coming up with a future-proof-ish design for reports for a company. Essentially the requirements are:
Be able to pull whatever data from the database
Generate formatted report from that data by populating a template (HTML, docx)
Export to Word and/or PDF
So initially I made an API endpoint per report (this is a web app), and had PDFs generated and formatted correctly.
But now I need to get the data into .docx/Word format, and I’m trying to figure out how I can design something as D.R.Y. as possible so that I don’t have to put in a TON of work every time the company decides they need another report (they’ve done this two, three times which is how I became aware that I had coded myself into a corner).
Every report I’ve done thus far has been done via a “brute-force” method: code the queries needed for the report, format the data, and then render to PDF (using HTML to PDF via phantomjs).
The complexity occurred when the company came back and said “Hey, we need all of those reports in Word format, also we have 3 other new reports that we need and a report that is a slight variation on the old one but +/- 2 fields”.
I am just having trouble coming up with a solid design/abstraction here, one that doesn’t send me down a week long hacking spree every time a requirement changes.
I've created a Custom Data Uploader script
which is uploading data to my google analytics profile.
I can see it's working and its uploading the file. I can see it on the "Custom Definitions" Tab in the Profile page. (Second picture on the link I attached).
But I cant see the data on the reports.
I tried to look under Traffic Sources -> Overview, it should be there from what I thought.
Where can I find this data in the reports?
https://developers.google.com/analytics/devguides/platform/features/cost-data-import
The Traffic Sources > Cost Analysis report should contain your data, but it can take 12 hours for the data on a new feed to show up. However, I've found that subsequent loads are usually much faster.