I'm trying to import workflow in HUE oozie workflow editor. but Section like this
<env-var>HDFS_DIR=${HOME_DIR}</env-var>
<env-var>TARGET_TABLE=${SOURCE_TABLE}</env-var>
<env-var>SOURCE_DATABASE=${SOURCE_DATABASE}</env-var>
didn't want to import. How can i fix it ?
Related
I have a use case where I need to execute dataproc workflow template from composer. I am using set of gcloud commands to perform creation and instantiation of workflow template.
Now I want to implement it from composer so I got two options which can be used for implementation:
-use bashoperator to run the gcloud commands batch file
-Create the template and then use DataprocWorkflowTemplateInstantiateOperator for instantiation
I need know what approach is recommended and why?
You can use DataprocInstantiateInlineWorkflowTemplateOperator which create, instantiate and delete Workflow. More information about inline instantiate can be found in GCP documentation.
Is there a way to import pipelines using CDAP CLI?
I am interested in automated pipeline deployment.
You can import pipeline using CDAP REST API.
PUT /v3/namespaces/<namespace>/apps/<pipeline name>
The body of the request should be the pipeline JSON that you have exported.
Meteor currently advises to import everything. Like import Meteor from 'meteor/meteor';.
So if I want to do something like console.log(process.env.MONGO_URL), what should I import?
Bonus question: I can't find the documentation for process, where is it?
process is a global object (so no need for import) and only available on the server. It is part of the node environment.
See https://nodejs.org/docs/latest-v8.x/api/process.html
I am trying to understand how to import an action (like a job I created in the job designer) with the new Oozie editor that there is. Here is the best documentation I can find to describe the basics of the changes:
http://gethue.com/new-apache-oozie-workflow-coordinator-bundle-editors/
My question is... Where is this button (highlighted) in the new editor:
I want to be able to import a job that I created in the job designer like in the old editor. There is a "sub workflow button", but that will only allow me to import workflows and not jobs. The import action would let me pick from all jobs and workflows. I can't find this in the new editor (SS in link). Any thoughts?
From Cloudera forum admin (http://community.cloudera.com/t5/Web-UI-Hue-Beeswax/Import-Action-in-New-Oozie-Editor/m-p/44098#M1648):
Currently there is no way to import jobs from the Job Designer in the
Workflow Editor.
This will be back in Hue 4 though.
As per the oozie documentation, I can create a Custom Oozie ActionExecutor.
To do this, I need to create a class that extends ActionExecutor. The class needs to be packaged as a Jar. This jar should be placed under the lib directory of oozie server. This part is clear.
However, where should I place the XSD file that defines the Action? Searched in the oozie server locations and I could not find a clue. Any help?
Per the Oozie documentation:
The XML schema (XSD) for the new Actions should be added to
oozie-site.xml, under the property
'oozie.service.WorkflowSchemaService.ext.schemas'. A comma separated
list for multiple Action schemas.