We have an app with many analytics logs. We'd like to export the raw events and their parameters. Some events have a lot of parameters which are not reasonable to setup as "custom dimension". Hence, we'd rather export the data and analyze ourselves. A .csv file would be great. Can it be done?
You can get raw data by exporting it to Google BigQuery
Here is how to link FireBase to Google BigQuery:
1. Sign in to Firebase.
2. Click the Settings icon, then select Project Settings.
3. On the Project Settings page, click the Integrations tab.
4. On the BigQuery card, click Link.
https://support.google.com/firebase/answer/6318765?hl=en#zippy=%2Cin-this-article
Your data will be presented in BigQuery as tables and you can query them using SQL. You can save your data to csv (or other formats) by using the SAVE RESULTS button in BigQuery console as well.
Related
Any ideas how I get historical data out of Google Analytics?
My problem here is I didn't realise the Firebase / Analytics export to BigQuery wasn't retrospective for history, so I only have data from when I turned on the integration and I need everything from when the Firebase App was launched. The main data I need is events with their parameters.
I have tried a few things:
Connect PowerBI to Google Analytics. I can authenticate and it only
shows "Default Account for Firebase" with no children - it doesn't
show the apps underneath that account.
https://ga-dev-tools.appspot.com/query-explorer/ has the same
problem (not showing child properties).
I can load the
properties and therefore analytics dataset using Google Data Studio,
but this does not have the functionality I require that is in Power
BI. I also couldn't locate the event parameters which I need either.
Any ideas on how to export the data?
You can try to use Google Analytics Data API to export report programmatically: https://developers.google.com/analytics/devguides/reporting/data/v1
However the data are not raw like with BigQuery Export. So if you want raw data there are no solution for the historical data.
We have a Firebase Project setup, with Analytics and export to BigQuery configured.
The integration has been successful and our events are being migrated to BigQuery just fine.
However, we face an issue with the data location set in BigQuery.
Our Firebase project has Default GCP resource location set as eur3 (europe-west). During setting up the integration between Firebase Analytics and BigQuery, we had no option to set any data location.
We can see the location for the dataset is US in BigQuery. I believe BigQuery is now supported in EU data centres, how can we use the EU location rather than US?
Now there is an option to change location as written bellow
Go to the Firebase console and disable the Google Analytics BQ
Export (uncheck all boxes, and turn off the toggle)
Navigate to
https://console.cloud.google.com/bigquery
Create a new dataset to
house a copy of the Analytics data (eg: analytics_123456789_copy).
Open the original analytics_123456789 dataset, and click the "Copy"
button.
Select the new dataset (analytics_123456789_copy) as the
destination; Click "Copy".
Wait for the copy to complete. Status can
be viewed in the BigQuery Transfer page.
Delete the original table,
analytics_123456789 This cannot be undone, so make sure the data is
either backed up, or the copy has completed.
Create a new dataset
with the same name, analytics_123456789, making sure to select the
desired target region (eg: EU).
Open the analytics_123456789_copy
dataset and copy the data to the new analytics_123456789.
Go to the
Firebase console and reenable the Google Analytics BQ Export (enable
the toggle, check the relevant checkboxes).
Optional: Wait for the
copy to complete, then delete the copied dataset,
analytics_123456789_copy.
As of late 2021, BigQuery exports for Analytics are now managed in the Google Analytics admin console, and you can specify the data location at setup time or link to an existing BigQuery dataset in the desired region. However, it isn't possible to change the region for an existing dataset.
Also see Klemen's answer, which suggests a risky workaround for migrating existing data. This is not suggested in Google docs, and is unlikely to be supported, but potentially helpful.
Prior to late 2021, Google Analytics for Firebase BigQuery dataset was created in the US, regardless from which location a developer created their Firebase project.
You cannot control the location of Analytics data in general, only BigQuery exports. GA data is distributed across Google data centers.
Currently, we have an app that uses Firebase, with Google Analytics enabled, and linked to BigQuery. The firebase account is on the Spark program.
In BigQuery, I can see the event-based schema, with fields around events and users and a few additional things like geo.
I am not sure what I need to do to get the session-related data in BigQuery, with things like session.visitId (found it referenced as part of ga_analytics_* table that I am missing). Does this require enabling the Blaze plan and export the google analytics data to BigQuery? Is this the reason why I am not seeing the session related fields in BigQuery?
If that is the case, what is the event-driven data model that I am currently seeing called in the Firebase context?
Firebase Export to BigQuery has a specific schema. In the docs the tables are in the form events_YYYYMMDD (this could be the event-driven data you asked for) and session.visitId is not listed as a field.
The field visitId seems to belong to Google Analytics BigQuery Export whose table is in the form ga_sessions_YYYYMMDD. Firebase docs specify that if your Firebase project is on the free Spark plan, you can link ... Google Analytics ... to the BigQuery sandbox, so, it should be feasible to access the ga tables in the sandbox. It is possible that an additional step is missing to get ga tables exported to BigQuery.
I'd like to make a dashboard with the data that I stored in Firebase Analytics Log Events.
The only way I can use the data is downloading CSV file from each event and move the useful data to my database one by one and customise them.
But I want to fetch the data of Firebase Events directly to my dashboard for real time data. Is it possible?
Firebase Events is belong to Firebase Analytics. Check here: https://firebase.google.com/docs/analytics/events?platform=android
In Analytics under "User Explorer" it is possible to export a single users sessions as "user-report-export.json".
Google has made an analytics sample dataset available in BigQuery (https://support.google.com/analytics/answer/7586738?hl=en&ref_topic=3416089). Is it possible to create a query to output a similar format as the "User Explorer" report to enable exporting all my users in one large .json file instead of having to export the files one by one?