Is there a way to extract only required columns/data from Stackdriver logging.
From stackdriver, I have extracted data with adding some filters to Google Cloud BigQuery but it became a table with large number of columns in which all columns are not required.
Related
Currently, we have an app that uses Firebase, with Google Analytics enabled, and linked to BigQuery. The firebase account is on the Spark program.
In BigQuery, I can see the event-based schema, with fields around events and users and a few additional things like geo.
I am not sure what I need to do to get the session-related data in BigQuery, with things like session.visitId (found it referenced as part of ga_analytics_* table that I am missing). Does this require enabling the Blaze plan and export the google analytics data to BigQuery? Is this the reason why I am not seeing the session related fields in BigQuery?
If that is the case, what is the event-driven data model that I am currently seeing called in the Firebase context?
Firebase Export to BigQuery has a specific schema. In the docs the tables are in the form events_YYYYMMDD (this could be the event-driven data you asked for) and session.visitId is not listed as a field.
The field visitId seems to belong to Google Analytics BigQuery Export whose table is in the form ga_sessions_YYYYMMDD. Firebase docs specify that if your Firebase project is on the free Spark plan, you can link ... Google Analytics ... to the BigQuery sandbox, so, it should be feasible to access the ga tables in the sandbox. It is possible that an additional step is missing to get ga tables exported to BigQuery.
I have setup Firebase analytics data to BigQuery. However I received my first export today and it contains all yesterdays user statistics. That is great but I need lifetime statistics history or at least last month's data.
Do I already have access to my entire historic analytics data threw Big Query but I and I do not know how to access it? If so can you point to documentation or give a quick walk threw?
Is it even possible to get the full (or at least a longer period than a day) historic analytics data?
Bonus question: Can I directly access data that is used in Firebase analytics console? They should be feeding it with some API for some things I need aggregates would be sufficient. So is there http://analytics.firebase/data.json I could access while logged in to my Firebase account to save data to my machine?
firebaser here
Firebase Analytics does not expose the historical event level data. It only exposes aggregate information.
Complete event data is only available from the moment you enabled the BigQuery connection. No data from before that time will be added to BigQuery.
The data from the analytics reports that is shown in the Firebase Console is available through the Analytics Data API. See Is there any api for dashboard analytics data?
I've linked firebase analytics app to BigQuery and getting raw data under app_events and app_events_intraday tables.
Our major requirement behind using BigQuery is to get analytics data that we get under Firebase analytics dashboard e.g. active_users, new users, audience geo locations and so on.
We can get these kinds of data using GA REST API for web applications but here we are using firebase app for mobile application and we came to know that BigQuery is the only option to get analytics data.
Can I get google analytics historic data like I get it on Firebase analytics dashboard?
Also, I get this data by downloading CSV from the same dashboard but that is a manual approach and I am looking to automate it.
Please acquaint me with the right approach to get analytics data for firebase app.
Thanks!
I know that we can link the Firebase analytics to BigQuery to run our own custom analytics on the current data. But what about historical data. Is there any way to get the historical event data.
Data from Firebase to Big Query is not retroactive. The point in time since the linkage was established would only be available in Big Query.
Historical data before that would be available in Firebase Console for analysis.
I have setup Firebase analytics data to BigQuery. However I received my first export today and it contains all yesterdays user statistics. That is great but I need lifetime statistics history or at least last month's data.
Do I already have access to my entire historic analytics data threw Big Query but I and I do not know how to access it? If so can you point to documentation or give a quick walk threw?
Is it even possible to get the full (or at least a longer period than a day) historic analytics data?
Bonus question: Can I directly access data that is used in Firebase analytics console? They should be feeding it with some API for some things I need aggregates would be sufficient. So is there http://analytics.firebase/data.json I could access while logged in to my Firebase account to save data to my machine?
firebaser here
Firebase Analytics does not expose the historical event level data. It only exposes aggregate information.
Complete event data is only available from the moment you enabled the BigQuery connection. No data from before that time will be added to BigQuery.
The data from the analytics reports that is shown in the Firebase Console is available through the Analytics Data API. See Is there any api for dashboard analytics data?