I would like to know whether Cloudera supports YARN Node labels? if yes, then which version of Cloudera can be used?
Found the information in one of the cloudera documentation:
YARN Unsupported Features in Cloudera 6.2
Node labels are not supported.
CDH 6.3 still not supported.
https://docs.cloudera.com/documentation/enterprise/6/release-notes/topics/rg_cdh_630_unsupported_features.html#yarn_600_unsupported
In CDP, Supported.
https://docs.cloudera.com/runtime/7.2.0/yarn-allocate-resources/topics/yarn-configuring-node-labels.html
Related
I am planning to upgrade artifactory-pro from 4.14.2 to 5.7. Has anyone done this so far? We use npm, bower, debian, yum repositories. Any recommendation or insight is appreciated.
As I see it, the upgrade depends on two main factors:
Your installation type(ZIP/RPM/RPM OSS/Debian/Docker). Here you can find detailed instructions for each type:
ZIP installation
RPM installation
RPM OSS installation
Debian installation
Docker installation
In case you use an HA cluster, here are the instructions.
While no special operations are required except those are mentioned in the instructions - please pay attention to updates and other special instructions since there are specific instructions to upgrading from Artifactory 4.x to 5.4.x and above. As can be seen here (for example).
Like in any other upgrade process, make sure you have a full system backup (Artifactory configuration, metadata, and artifacts)
I'm trying to install Spark2 in my cloudera cluster (evaluation version) following the cloudera's instructions to install this component. I downloaded the CSD, installed it and using the parcel downloaded the component, distribute it but when I try to activate it I'm having this message:
CDH (5.8 and higher) parcel required for SPARK2
(2.2.0.cloudera1-1.cdh5.12.0.p0.142354) is not available.
This is the information of the cluster:
Version: Cloudera Enterprise Data Hub Edition Trial 5.12.1 (#6 built
by jenkins on 20170818-0807 git:
9bdee611802535491d400e03c98ef694a2c77d0a)
Java VM Name: Java HotSpot(TM) 64-Bit Server VM
Java VM Vendor: Oracle Corporation
Java Version: 1.7.0_67
CSD
SPARK2_ON_YARN-2.2.0.cloudera1.jar
Parcel
http://archive.cloudera.com/spark2/parcels/2.2.0.cloudera1/
I'm thinking it could be because my CDH version (5.12.1) and the version of the last spark2 parcel (cdh5.12.0) but I don't find any other package for cdh5.12.1 and my next question is: for cdh5.13.0 which is the spark2 parcel?
The error message is misleading. The real issue is that your cluster is running on Java 1.7. Spark 2.2 is only supported on Java 1.8. Upgrade Java on your cluster and you should be able to install the Spark 2.2 parcel.
Finally solved. The problem was that I need to update de cdh core, after update, spark 2 just works fine.
The latest version of Nexus Repository Manager OSS supports a new artefact types: Docker, npm, RubyGems. But it appears to drop support for artefact formats supported in the previous version: Maven, P2, OBR, Yum. Why is that?
Maven should be there, in fact we setup default repos for it when it starts. P2, OBR, Yum have not been rebuilt for Nexus Repository Manager 3 as of yet. Yum will likely be the next up, P2 and then maybe OBR (jury is still out on if we have enough people using it to include it in the core product).
If you'd like to kickstart any of these, we would love that. A community member recently created an APT format for himself:
https://github.com/mpoindexter/nexus-repository-apt
You might be able to follow his example and create one for OBR for example.
my company is using artifactory 2.6.2 version. They want to upgrade it to the latest version (4.7.4). Any idea how to proceed ...?Or is there any link or documentation to follow?
You need to first upgrade 2.x -> 3.x using this documentation, once you did that you can upgrade 3.x -> 4.x using this documentation.
when i'm trying to upgrade cloudera manager via CM parcel page (at: http://hostname:7180/cmf/parcel/status) i get the flowing errors:
Local parcel error for parcel CDH-5.6.0-1.cdh5.6.0.p0.45-el6.parcel : The version 5.6.0-1.cdh5.6.0.p0.45 is too new to be supported. Please upgrade Cloudera Manager to at least 5.6.0 before using this parcel..
when trying to activate the parcel i get the following error:
The new version of CDH: '5.6.0-1.cdh5.6.0.p0.45' is newer than the running Cloudera Manager version: '5.4.8'.
how can i fix that?
It seems your cloudera manager is older version. So first update your manager then try to upgrade your cluster. Refer below link for more details
http://www.cloudera.com/documentation/enterprise/latest/topics/install_upgrade_to_cdh56.html