We have a Firebase Project setup, with Analytics and export to BigQuery configured.
The integration has been successful and our events are being migrated to BigQuery just fine.
However, we face an issue with the data location set in BigQuery.
Our Firebase project has Default GCP resource location set as eur3 (europe-west). During setting up the integration between Firebase Analytics and BigQuery, we had no option to set any data location.
We can see the location for the dataset is US in BigQuery. I believe BigQuery is now supported in EU data centres, how can we use the EU location rather than US?
Now there is an option to change location as written bellow
Go to the Firebase console and disable the Google Analytics BQ
Export (uncheck all boxes, and turn off the toggle)
Navigate to
https://console.cloud.google.com/bigquery
Create a new dataset to
house a copy of the Analytics data (eg: analytics_123456789_copy).
Open the original analytics_123456789 dataset, and click the "Copy"
button.
Select the new dataset (analytics_123456789_copy) as the
destination; Click "Copy".
Wait for the copy to complete. Status can
be viewed in the BigQuery Transfer page.
Delete the original table,
analytics_123456789 This cannot be undone, so make sure the data is
either backed up, or the copy has completed.
Create a new dataset
with the same name, analytics_123456789, making sure to select the
desired target region (eg: EU).
Open the analytics_123456789_copy
dataset and copy the data to the new analytics_123456789.
Go to the
Firebase console and reenable the Google Analytics BQ Export (enable
the toggle, check the relevant checkboxes).
Optional: Wait for the
copy to complete, then delete the copied dataset,
analytics_123456789_copy.
As of late 2021, BigQuery exports for Analytics are now managed in the Google Analytics admin console, and you can specify the data location at setup time or link to an existing BigQuery dataset in the desired region. However, it isn't possible to change the region for an existing dataset.
Also see Klemen's answer, which suggests a risky workaround for migrating existing data. This is not suggested in Google docs, and is unlikely to be supported, but potentially helpful.
Prior to late 2021, Google Analytics for Firebase BigQuery dataset was created in the US, regardless from which location a developer created their Firebase project.
You cannot control the location of Analytics data in general, only BigQuery exports. GA data is distributed across Google data centers.
Related
Any ideas how I get historical data out of Google Analytics?
My problem here is I didn't realise the Firebase / Analytics export to BigQuery wasn't retrospective for history, so I only have data from when I turned on the integration and I need everything from when the Firebase App was launched. The main data I need is events with their parameters.
I have tried a few things:
Connect PowerBI to Google Analytics. I can authenticate and it only
shows "Default Account for Firebase" with no children - it doesn't
show the apps underneath that account.
https://ga-dev-tools.appspot.com/query-explorer/ has the same
problem (not showing child properties).
I can load the
properties and therefore analytics dataset using Google Data Studio,
but this does not have the functionality I require that is in Power
BI. I also couldn't locate the event parameters which I need either.
Any ideas on how to export the data?
You can try to use Google Analytics Data API to export report programmatically: https://developers.google.com/analytics/devguides/reporting/data/v1
However the data are not raw like with BigQuery Export. So if you want raw data there are no solution for the historical data.
I'm trying to track the usage of a Google Data Studio Report with Google Analytics. I tried to create a stream more than 24 hours ago but it still says No Data received. The stream "source" is a Google Data Studio report so I followed the advise of a blogger that seemed to help many other people but it doesn't work for me. I copied the Analytics tracking ID into the Google Data Studio report and I used https://datastudio.google.com as the stream URL in Google Analytics. Is this the right way of setting up the stream?
Also, do I need to wait for 24 hours every time after I tried to connect the stream before I know that it's working or not?
As such the domain does not matter, but setting it to datastudio.google.com won't hurt
And yes, max 24hr delay.
see https://support.google.com/datastudio/answer/7410792?hl=en for full instructions
You can see the data studio usage information in real time if you connect your google analytics to bigquery, and then you might connect bigquery to datastudio.
In GA4, you need to go to Admin -> BigQuery Links and follow the steps to create the link. It is important to enable the daily and streaming options under the frequency section.
This connection will create a schema in the selected dataset with two tables: events_ and events_intraday_. The events_ table contains historical data and events_intraday_ contains real time data. You might join them into a single table to obtain a real time and historical database all at once.
Finally, just import these tables into data studio, and appreciate your real time analytics of data studio usage.
Currently, we have an app that uses Firebase, with Google Analytics enabled, and linked to BigQuery. The firebase account is on the Spark program.
In BigQuery, I can see the event-based schema, with fields around events and users and a few additional things like geo.
I am not sure what I need to do to get the session-related data in BigQuery, with things like session.visitId (found it referenced as part of ga_analytics_* table that I am missing). Does this require enabling the Blaze plan and export the google analytics data to BigQuery? Is this the reason why I am not seeing the session related fields in BigQuery?
If that is the case, what is the event-driven data model that I am currently seeing called in the Firebase context?
Firebase Export to BigQuery has a specific schema. In the docs the tables are in the form events_YYYYMMDD (this could be the event-driven data you asked for) and session.visitId is not listed as a field.
The field visitId seems to belong to Google Analytics BigQuery Export whose table is in the form ga_sessions_YYYYMMDD. Firebase docs specify that if your Firebase project is on the free Spark plan, you can link ... Google Analytics ... to the BigQuery sandbox, so, it should be feasible to access the ga tables in the sandbox. It is possible that an additional step is missing to get ga tables exported to BigQuery.
I have setup Firebase analytics data to BigQuery. However I received my first export today and it contains all yesterdays user statistics. That is great but I need lifetime statistics history or at least last month's data.
Do I already have access to my entire historic analytics data threw Big Query but I and I do not know how to access it? If so can you point to documentation or give a quick walk threw?
Is it even possible to get the full (or at least a longer period than a day) historic analytics data?
Bonus question: Can I directly access data that is used in Firebase analytics console? They should be feeding it with some API for some things I need aggregates would be sufficient. So is there http://analytics.firebase/data.json I could access while logged in to my Firebase account to save data to my machine?
firebaser here
Firebase Analytics does not expose the historical event level data. It only exposes aggregate information.
Complete event data is only available from the moment you enabled the BigQuery connection. No data from before that time will be added to BigQuery.
The data from the analytics reports that is shown in the Firebase Console is available through the Analytics Data API. See Is there any api for dashboard analytics data?
I have setup Firebase analytics data to BigQuery. However I received my first export today and it contains all yesterdays user statistics. That is great but I need lifetime statistics history or at least last month's data.
Do I already have access to my entire historic analytics data threw Big Query but I and I do not know how to access it? If so can you point to documentation or give a quick walk threw?
Is it even possible to get the full (or at least a longer period than a day) historic analytics data?
Bonus question: Can I directly access data that is used in Firebase analytics console? They should be feeding it with some API for some things I need aggregates would be sufficient. So is there http://analytics.firebase/data.json I could access while logged in to my Firebase account to save data to my machine?
firebaser here
Firebase Analytics does not expose the historical event level data. It only exposes aggregate information.
Complete event data is only available from the moment you enabled the BigQuery connection. No data from before that time will be added to BigQuery.
The data from the analytics reports that is shown in the Firebase Console is available through the Analytics Data API. See Is there any api for dashboard analytics data?