I want to create one AB Test using Firebase, I can not found the metrics for tracking user engagement durations, is there have one suggestion or solution to solve this problem?
I try to use screen_view event to measure the duration, but this event be track as event count only, I expect using the event property value for measure the metrics.
Thanks!
Related
Is it possible on firebase A/B tests to monitor the event counts instead of the conversion rates?
For example, I would like to know if users in Variant A trigger a certain event more times than the Baseline (not only if they trigger the event or not, but how many times they trigger it).
Thanks!
Oriol
That's a really good question. For each event that is triggered, you should be able to derive event count as well as an event DAU metric. Firebase has limited capability to run such analysis. One way to do this is to download the data and run a manual analysis. Or use a tool like Statsig that allows you compute these metrics automatically. Here's a screenshot of what you get for every A/B experiment, and you can see how the tool breaks down Event Count and Event DAU for each metric.
Disclaimer: I work at Statsig.
Recently noticed some difference in Users count of screen_view and session_start events. Which one will be used in Active Users calculation?
Thanks in advance.
In short session_start is an application-level metric, while screen_view is a lower level event about views within your app. So if your app has more screens, the later will be generally higher count. A bit more precisely:
screen_view when a screen transition occurs and any of
the following criteria are met:
No screen was previously set
The new screen name differs from the previous screen name
The new screen-class
name differs from the previous screen-class name
The new screen id differs from the previous screen id
session_start on the other hand is when a user engages
the app for more than the minimum session duration after a period of
inactivity that exceeds the session timeout duration.
Please refer to more details in the Firebase docs:
https://support.google.com/firebase/answer/6317485?hl=en
We just had this question asked of us, and looking at the screen_view metrics provided some possible explanation. Firebase released an update to how they track sessions, see here.
https://firebase.googleblog.com/2018/12/new-changes-sessions-user-engagement.html
So in theory using the old calculation if you have users who just quickly opened the app for less than 10 seconds, it would count as a screen_view but not as a session_start. This means that your session_start user count would be less than your screen_view user count.
Based on the update, this scenario will no longer be the case and they should start to match up moving forward.
EDIT: Note that in order to use the new calculation, you'll need to install the latest Firebase SDK with you app.
When creating Firebase AB experiment our custom events don't show up on the Activation event list nor on the Goal metric event list. Both of those events are properly showing on the Analytics Event dashboard. To make things weirder, at different points in time there was a possibility to select one of them but they were never shown at the same time. Anyone experiencing something similar?
It seems that the issue was fixed somehow and now the events are being shown. We didn't do anything from our side so I am hoping someone from the firebase team has intervened and that the issue won't resurface in the next experiment. Thanks!
Firebase ABT will show events which have been logged in the last 30 days. Please check if the event you want has been logged by your app recently.
Anytime a customer completes the payment of a order on our website, we send an analytics event with the following data:
Category: Order
Action: Status
Label: Complete
Now I want to see in what kind of rate sessions achieve this goal over time. I can't seem the find this view.
So that I can see for instance:
On 08/01/2017 31% of the sessions sent this event
On 08/02/2017 32% of the sessions sent this event
On 08/03/2017 30% of the sessions sent this event
etc.
How can I achieve this?
This is best done with a Goal; you can set the goal up to count Session where the event was triggered.
Unfortunately, this won't work retrospectively. If you want to do that, I recommend defining a Segment as 'Sessions which included Event X', and looking at the number of Sessions that that Segment has.
EDIT:
As pointed out by Eike, I should clarify that both of these methods would only count up to one event per Session. If you want to potentially count multiple events per Session, you'd need a different method.
I would like to know at what time the user logged into the website. How to achieve this? I had came across events and custom variables. What to use and what not?
You can setup event to see the hour of day (custom dimension) to determine at what time event occurred.