I had linked up my google analytics 4 for a week, export daily to bigquery
but when i checked the result in bigquery, the traffic source simply doesn't add up.
for example, in bigquery it doesn't appear any 'facebook', as it appeared in google analytics report
which part did i missed out during setup the bigquery linking?
does anyone have the same issue?
traffic source in google analytics
traffic source in bigquery
thanks a lot!
GA4 BQ export uses same schema as firebase BigQuery export. You can find the schema documentation here https://support.google.com/firebase/answer/7029846?hl=en
The field you're looking at is not traffic source of the session, but 'Name of the network that first acquired the user.'
What I've found so far is that traffic attribution in GA4 is still not very good. I hope Google is trying to improve it. There's also no way to exclude self-referral traffic as you can in UA.
Related
Any ideas how I get historical data out of Google Analytics?
My problem here is I didn't realise the Firebase / Analytics export to BigQuery wasn't retrospective for history, so I only have data from when I turned on the integration and I need everything from when the Firebase App was launched. The main data I need is events with their parameters.
I have tried a few things:
Connect PowerBI to Google Analytics. I can authenticate and it only
shows "Default Account for Firebase" with no children - it doesn't
show the apps underneath that account.
https://ga-dev-tools.appspot.com/query-explorer/ has the same
problem (not showing child properties).
I can load the
properties and therefore analytics dataset using Google Data Studio,
but this does not have the functionality I require that is in Power
BI. I also couldn't locate the event parameters which I need either.
Any ideas on how to export the data?
You can try to use Google Analytics Data API to export report programmatically: https://developers.google.com/analytics/devguides/reporting/data/v1
However the data are not raw like with BigQuery Export. So if you want raw data there are no solution for the historical data.
I activated google analytics 4 bigquery linking, and it works correctly. I wonder what is the limitation of this link. Api metrics shows that link using api methods below.
google.cloud.bigquery.v2.JobService.GetJob
google.cloud.bigquery.v2.JobService.GetQueryResults
google.cloud.bigquery.v2.JobService.InsertJob
google.cloud.bigquery.v2.TableDataService.List
But I can't found the exact match API name on bigquery documents.
https://cloud.google.com/bigquery/quotas
https://cloud.google.com/bigquery/docs/reference/rest/v2/jobs/insert?hl=ja
Any ideas?
Thanks.
The limit for how many hits you can export from the free version of GA4 to BigQuery is 1M hits per day.
Standard properties have a daily BigQuery Export limit of 1 million events. If your property consistently exceeds the export limit, the daily BigQuery export will be paused and previous days’ exports will not be reprocessed.
https://support.google.com/analytics/answer/9823238?hl=en#zippy=%2Cin-this-article
If you go above that, Google will stop your pipeline.
There are only two solutions to overcome this that I know of.
Upgrade to GA360
Use Parallel Tracking
Once you set up the link from GA360 to BigQuery, as far as I know, there is no limit to this link. According to the document, usually GA sends data 3 times a day to BigQuery. You will see partitioned table for GA data in BigQuery for each day. (This link is only available in Analytics 360, which is not free.)
For more information, refer to the official documents. support.google.com/analytics
Also, limits and quotas for BigQuery.
cloud.google.com/bigquery/quotas
About API names you listed appear here.
https://cloud.google.com/bigquery/docs/reference/auditlogs
So I will try to explain myself the best I can, and I would really appreciate any help!
May main Goal here is to export FireBase data to a DataStudio. I know how easy this is, just link FireBase to BigQuery and create a DataStudio with this data source. There's even already an awesome template for this.
But is not that simple, I work at an agency, this is a huge corporate client and their internal people work is a mess.
The problem here is: I can get "property" access to Firebase, and I have linked my Bigquery account to this project, but what I can't see is the whole app information in Bigquery.
What I see is the data from "crashalytics", "messaging", "performance" and predictions.
But can't seem to find the "normal info" off the app, the events, conversions, audiences, etc...
This is where I can't understand some things that I would like you to help me with, I have some theories.
In the configuration of bigquery integration on firebase I have every switch marked as "On" but one, the analytics one.
enter image description here
Now here is where all my questions come:
- ¿Do I need this switch to be on so I can visualize, for example Events or users information on Bigquery?
If so, what is the realtion between Firebase and Google Analytics?:
- ¿Is it necesary to have a Google Analytics account integrated with the Firebase project in order for bigquery to extract the data and show it?
- ¿Can I extract directly through firebase the data without Google analytics?
And an extra one: If I remove the Google Analytics account from my Firebase project, and add a new one, ¿Would the new Google Analytics also have the data so I can extract it with Bigquery and build my panel?
The biggest problem here is that this Firebase account was created long ago, and the client haves no idea what Google Analytics account is Linked to the Firebase project, they know nobody with acces to it, and they say "I'ts an old analytics, we only need Firebase information to show on datastudio" but I'm starting to feel this is not possible without this Google Analytics acces.
Pleaaase some help with this.
Thank you very much in advance.
I solved it, if anybody comes to this problem, the problem was I needed permision to the analytics web + app created from firebase.
Google analytics api V4- I can't see historical data
Which may be the reason that I can only see data through the API from a certain date.
From GA, I can see everything without a problem.
What can be the reason that the data is only available from 2018?
I think I found the reason, data settings in GA - Administration -> Service -> Data storage.
I will see after 24h whether they will be visible.
I would like to use Google Dataflow to process Google Analytics data from many websites and store the results in a Google SQL.
But I was doing some research and I couldn't find a way to read the GA data from Google Dataflow directly.
There is one way if you have Google Analytics 360 you can enable the bigQuery integration but I will be using the Free version of Google Analytics not the 360.
Has anybody worked with something similar?
Cheers,
It would really depend on what type of data you're looking to pull. The GA360 integration with BigQuery extracts all the raw data (hit level) from Google Analytics. There is no way to do the same thing with the free version of Google Analytics.
However, you should be able to write your own Apache Beam Source that pulls data from Google Analytics using the Reporting API. Of course you would be restricted by the API limits.
As I mentioned in the beginning of my answer, this all depends on what type of data you're trying to get at. Aggregated/high-level data should be possible but granular/hit-level data won't.