Cloudsearch - how to run index in api - amazon-dynamodb

I am using cloud search (2013) and I want to run indexing on an api instead of the console to keep it in sync with DynamoDB. How can I accomplish this?

Related

Schedule Rscript in a server

Currently, I am scheduling a daily bat from my laptop with TaskScheduler on windows and I would like to do it automatically in a server. Actually, the situation is:
I read some SQLite DB that I have stored in local.
Once I read them I do a webscraping based on some information.
I store this new information in the DB mentioned above.
I've read that is possible do it with Amazon EC2 (REF: http://www.louisaslett.com/RStudio_AMI/), but it doesn't mention anything related with SQLite local db.
Could you give me some recommendations about how to manage and which tool could be the best approach (Azure, AWS, Google Bigquery)
You could build a Cloud Run task to do this. Then schedule it using cloud scheduler.
https://cloud.google.com/run/docs/triggering/using-scheduler
You can find samples how to build a cloud run task in the docs:
https://cloud.google.com/run/docs
To write to big query, you can use the bigquery api client libraries: https://cloud.google.com/bigquery/docs/reference/libraries

Querying Firebase A/B testing using API

I'm writing a script that will generate extended A/B testing results. Is it possible to query Firebase A/B testing using API to get an experiment variant list, start date, end date, etc?
There currently is no API to get/manage the list of experiments for Firebase A/B testing. All management of experiments must be done through the Firebase console at the moment.
You might want to file a feature request, and keep an eye out on the Firebase blog and release notes for changes.

How can I use Firebase to query an external API and store data in Firestore?

I'm teaching myself to use Flutter and I'm making an app that queries The Movie Database API. Currently, I'm having the client query the API on launch but I'm thinking this is not the most efficient way of doing it, and I would rather have the client query a backend service like Firebase to get the same data.
I would appreciate some guidance into where to start in order to setup a periodical process to query the API and use the results as entries into a Firestore DB. I've looked online but I might be using suboptimal keywords since I haven't found a good tutorial or example for this.
Thanks.
You can use Firebase Cloud Functions to build code that runs on Firebase servers to fill your Firebase database, but you can only make HTTP requests to non-Google addresses if you use a paid plan.
https://firebase.googleblog.com/2017/03/how-to-schedule-cron-jobs-with-cloud.html explains how to invoke periodic tasks with Cloud Functions. It utilizes Google AppEngine for that because Cloud Functions doesn't provide that out of the box.

How to migrate collections from Mongodb to Cloud Firestore

We are currently running on MongoDB but are now interested in moving over to Cloud Firestore. We have not found any tools for such a task so our planned approach is to create a "schema aware" script that makes a special sequence of queries from the MongoDB, and for each document create a new entry in Firestore while creating a map between the old mongo _id and the newly assigned id in Firestore. These maps will be used in later queries in the sequence that need to make reference to other documents in other collections.
Has anyone else tried something similar or found a better, more general purpose tools for the task?

Firebase for half and SQL for another half

I have built an app using firestore as we are interested in the realtime updates portion of things. However,we are not building a website that has CRM component where a lot of reports will be generated. The contents of that CRM are all new. There is only one report that would need firebase data as well as the new data (you can say 1 report out of 20).
I was thinking of building the CRM backend off mysql DB? Do you recommend to go with this approach or shall I do the CRM in the same firebase/firestore db?
Thanks
If you are looking for a real-time backend database for your CRM, then the Firebase RTDB / Cloud Firestore would be ideal for this. I'm not sure why you'd want to add a mySQL component, unless you are going to create some reports that require complex joins. However, if your data is modelled correctly, this also shouldn't be an issue.
Take a look at this video to get a better understanding: What is a NoSQL Database? How is Cloud Firestore structured? - Get to Know Cloud Firestore Ep.1

Resources