So I am new with Firebase and also new to linking Firebase data to BigQuery (I have some BigQuery experience though).
According to the documentation:
"After you link a project to BigQuery, the first daily export of events creates a corresponding dataset in the associated BigQuery project. Then, each day, raw event data for each linked app populates a new daily table in the associated dataset, and raw event data is streamed into a separate intraday BigQuery table in real-time."
Let's say I have this dataset mydataset.myapp, the corresponding BigQuery tables containing streamed data from Firebase looks like this:
mydataset.myapp.events_
mydataset.myapp.events_intraday_20191227
My question is:
Are the previous intradays (events_intraday_20191227) automatically merged/appended to the main table (events_) by the next day? So myapp will not be populated with intraday_<date> crumbs of data ? Just want to confirm how this works.
The table events_ contains all your data for different dates, the table events_intraday_ is a temporary table, which its data is moved into events_
In here you can find a video that explains how it works
Related
I want to have user_id from users that they had an event.
I can see ids in user explorer and extract data into a CSV file.
but it is not a complete data set (sampled data).
I tried a short period of time (1 day).
I used looker studio too but there , ids are often null!
LookerML question:
I have got this snowflake query which joins one static table (does not refresh) and one table that refreshes every day.
I want to pop this query into Looker and create a simple Looker dashboard using it.
Two options I think are available to me to do so:
Create view file and PDT but that would mean I need to add a trigger value and the data including the static table would refresh, right? - Isn't this very inefficient?
Create regular DT with the explore being a PDT?
A derived table will be temporary and will not be written to the database. Each time the dashboard is refreshed, a query will be rerun against your data source to extract data.
A persistent derived table will store the data results in a database, whilst using a persistent strategy to refreshing the data based on time or a data driven trigger. If the persistent data already exists and is still valid, Looker will extract the results from the persisted data rather than creating a query against your source database.
I am new to Firebase cloud firestore. My database structure looks something like in the picture below. So, basically I have got a document for 'Liked' which tracks the timestamp at which user has liked the content. It has got 'chapter' as subcollection and inside each chapter there are sub-chapters which has the actual timestamp. Now I want to retrieve all the liked data ordered by the timestamp. I am not sure how can I achieve this!
You may use orderBy() to specify the sort order for your data like shown in the following example:
db.collection("liked").orderBy('timestamp').get()
I would also suggest you to follow this doc, it demostrates how to set up Cloud Firestore, add, read data and secure data.
UPDATE
I created the following database to replicate your scenario:
reprod(collections)/
test1(document)/
liked(collections)/
0(document)/
type(filed)
To stream the timestamps in ascending order I iterated manually to the doc and fetched the data ordered by timestamp:
reprod = db.collection(u'reprod').document(u'test1').collection(u'liked')
timestamps = reprod.stream()
for doc in timestamps:
print(f'{doc.id} => {doc.to_dict()}')
To do that I used the Firestore documentation on how to retrieve data and how to order data.
[appmaker] I'm trying to import data from related data in google sheets into an App Maker. I created the fields by importing them from sheets. The date field defaulted to a time stamp but my data only uses the date, so I changed the fields to date only but the import keeps failing because App maker is still expecting a time stamp. Any ideas?
So the images show how I have set up the data model for this data. It is set up as a 'Date' . But it keeps getting rejected.
Details from App Maker
I created a sample spreadsheet and a sample AppMaker app to try and replicate your issue. It works perfectly well for me. To have perfect sync, you might need to re-check these two points.
Are you sure you used "Date" SQL Type in the AppMaker model's field like this?
Are you sure your spreadsheet's date column has the correct date format set like this?
I am trying to build an app with group-chat feature by using react-native now.
There are two pages here, one is use to store info of new groups (such as group name and group profile), the other page is for list down all the groups already stored into firebase database.
Now I am able to store those data into database, but listview is empty in this moment.
{rowData.text.groupName}
This is the way I am fetching my data. The 'groupName' is my column name.