cloudera installation process and clustering in local network - cloudera

How to install cloudera in local system .I'm using centos 6.5.And also I want to do clustering in cloudera .Any one suggest me some documentation to this process properly

You can either use VM or Docker. Please follow the instructions here to get it installed locally.

Related

Artifactory OSS 7.46.11 version not getting installed in Windows 10 laptop

I am not able to install JFrog Artifactory OSS version 7.46.11 in my Windows 10 laptop.
I am trying to setup Devops CI/CD pipeline using Jenkins in my laptop for my hands on Devops skills. I tried to setup Artifactory OSS 7.46.11 version in my laptop. However, I am not able to install the software. Even I tried to install as a service but in vain. I have enabled the ports as well. I tried setting up the JVM parameters as mentioned in the JFrog documentation.
Can someone help me in this.
Thanks.
Are you facing the issue while installing Artifactory itself or installation is successful but unable to start it?
you can try the below things.
Navigate to %JFROG_HOME/artifactory/app/bin directory and you will find a file
Open Power shell and try to run the artifactory.bat file.
This give you better idea on what is happening.
Navigate to %JFROG_HOME/artifactory/var/log folder where the complete logs will be printed. Try to focus on the below log files.
artifactory-service.log
access-service.log
router-service.log
This should reveal some useful information. If you could find anything, share the Error snippet from artifactory-service.log

Install Openstack on single node

I want to install Openstack on CentOS 8(single node). I am having single machine (physical machine) where I want to install all nodes of Openstack. This setup I required for simulation only not production use.
I have tried to install Openstack using packstac 3 times but couldn't success.
I got different issues during installation:
1.In first attempt After installation, I tried to create instance, but not getting console of instances even after it got created successfully.
2. In second attempt, during deployment of instance, network not getting allocated.
3. In third attempt, it got stuck at packstack, puppet testing only.
I have followed below 2 links:
https://computingforgeeks.com/install-openstack-victoria-on-centos/
https://www.google.com/amp/s/www.linuxtechi.com/install-openstack-centos-8-with-packstack/amp/
I followed each and every steps mention in the likns.
I want to create two Ubuntu VMs on Openstack.
Can someone provide me some links/video, where I can get everything which is required to install Openstack on single node and create two Ubuntu VMs and assign network to them and test the connectivity between these two VMS.
Thanks in advance.
I would use official Packstack documentation. Note that you should start with a totally fresh Centos installation; i.e. don't try to install Packstack on a server where a previous installation failed (or succeeded).
You can also try Devstack. Its default configuration requires a smaller machine than Packstack (in my experience, 8GB RAM should be sufficient). Same remark: Start with a fresh installation of Centos or Ubuntu.
Microstack is another alternative. Its advantage is a very simple and quick installation; its disadvantage is a very strange (in my opinion) configuration and not a lot of documentation. However, it is suitable for your purpose. It claims to work on any Linux, Windows and MacOS; it does require snap.
I suggest directly installation onto Ubuntu Server.
some time ago I wrote a serie of posts in which I explained in detail how to install OpenStack Rocky. The 2 first blog posts ([1] and [2]) contain commands, examples, content of configuration files that cover common scenarios and tips for the successful installation of most OpenStack services (keystone, nova, glance, etc.) in a single node, and the third post [3] describes the installation of a computing node. This 3rd post is installed in a different node for the sake of making it easier to understand how nova works, but the installation can be safely carried out in the same node than the other components.
I find that the posts are short enough and are very easy to follow (I use that blog as my installation tips, and so I have used them for several deployments). The only caveat is that it is based on Ubuntu, but if you know about your installation, it should be easy to translate the installation to CentOS (some colleagues have used these tips for CentOS installations).
I tried to install Openstack several times last week (october 2021): a) with CentOS 8 Stream to metal hardware (real server) with devstack - no one version was installed (neither Master nor Xena & Wallaby, version Viktoria & below are not for Stream OS); b) Virtual machine with CentOS 8 Stream installed with packstack - installation was clearly successful (!), quite easy for install (according to official RDO project and its homepage), however there is the real problem with virtual and actual networking: no external network is accessible, router created was OK with external connection (router IP was detected successfully from outside) but no connection was possible from and to instance. So I conclude the Openstack package is not completely documented to resolve problems, however its installation can be quite easy (when successfully finish ;) )
Addition: Of coarse, there are resources with an information how network can be configured, official Openstack docs describes different network configurations as well (however it is difficult to find it for one click and being newbie), but anyway this system requires a lot of time to study before usage.

Install kubernetes cluster in devstack

I have installed devstack in my server as per this steps and I was looking for some updated instructions to install kubernates cluster in it. Even though my question is on kubernetes I would like to clarify few points.
Is Openstack opensource ? or the opensource version is called devstack. Because I was trying to install a production ready environment but everywhere I see examples to install devstack or the one is few years old.
How to Install Openstack not Devstack
And finally can someone please help me with instruction to install kubernetes on devstack as thats the one I could install now and I guess the instructions would be almost similar.
I know there are posts but almost all of them are few years old so a help would be greatly appreciated.
Hoping that it is allowed to reference my own work: I wrote a short series of articles about Kubernetes on Devstack, both Kubernetes from scratch and using OpenStack Magnum.
The document that you used to install OpenStack describes not Devstack, but Microstack.
OpenStack is 100% open-source, yes. See https://www.openstack.org/.
Devstack is one of the many ways to deploy an OpenStack cloud. Its original purpose is to set up a test environment for OpenStack developers, and not so much to be user-friendly, but it is often used for training or proof-of-concept.
There are many other deployment methods: Microstack (easy but not very flexible), Packstack (requires RHEL or Centos), Tripleo (also requires RHEL or Centos and a bit more powerful hardware), Kolla-Ansible, and the best method for learners in my opinion: Manual setup. This list is far from complete.

Adding nodes to Cloudera Quickstart VM

I have Cloudera Quickstart VM installed and it is single node. How can I add multi nodes to it and make it as a cluster ? I am now using Virtualboax and tried to clone the base quickstart VM and then network it and use the Add Cluster wizard in Cloudera manager. But it is failing. Anyone knows how to add multiple nodes to it ?
Your quickest/easiest option (instead of using a VM) is to install the multi-node version of QuickStart for Docker:
http://blog.cloudera.com/blog/2016/08/multi-node-clusters-with-cloudera-quickstart-for-docker/
Or, you could use Vagrant to set up a virtualized multi-node cluster:
http://blog.cloudera.com/blog/2014/06/how-to-install-a-virtual-apache-hadoop-cluster-with-vagrant-and-cloudera-manager/

Openstack and devstack

Does devstack completely install openstack? I read somewhere that devStack is not and has never been intended to be a general OpenStack installer. So what does devstack actually install? Is there any other scripted method available to completely install openstack(grizzly release) or I need to follow the manual installation steps given on openstack website?
devstack does completely install from git openstack.
for lesser values of completely anyways. devstack is the version of openstack used in jenkins gate testing by developers committing code to the openstack project.
devstack as the name suggests is specifically for developing for openstack. as such it's existence is ephemeral. in short, after running stack.sh the resulting ( probably ) functioning openstack is setup... but upon reboot it will not come back up. there are no upstart or systemd or init.d scripts for restarting services. there is no high availability, no backups, no configuration management. And following the latest git releases in the development branch of openstack can be a great way to discover just how unstable openstack is before a feature freeze.
there are several vagrant recipes in the world for deploying openstack, and openstack-puppet is a puppet recipe for deploying openstack. chef also maintains an openstack recipe as well.
Grizzly is a bit old now. Havana is the current stable release.
https://github.com/stackforge/puppet-openstack
http://docs.opscode.com/openstack.html
http://cloudarchitectmusings.com/2013/12/01/deploy-openstack-havana-on-your-laptop-using-vagrant-and-chef/
and ubuntu even maintains a system called maas and juju for deploying openstack super quickly on their OS.
https://help.ubuntu.com/community/UbuntuCloudInfrastructure
http://www.youtube.com/watch?v=mspwQfoYQks
so lots of ways to install openstack.
however most folks pushing a production cloud use some form of configuration management system. that way they can deploy compute nodes automatically. and recover systems quickly.
also check out openstack on openstack.
https://wiki.openstack.org/wiki/TripleO
I think the code should be same, but at least the configuration is not same, for example, devstack will by default use nova network. In a manual installation, you can choose neutron. so:
if you are starting to learn openstack, devstack is a good starting point. with it, you can quickly have a development env.
if you are deploying openstack env, devstack is not a choice, and
instead you need install it following the installation guide.
If you would like another scripted option for deployment, you can try Packstack. This will work only on Fedora and RHEL.
https://wiki.openstack.org/wiki/Packstack
https://www.rdoproject.org/install/quickstart/
In this, you can choose which services you would like to install. For example you may choose to install Neutron for networking purposes, instead of using nova.
Also, it lets you deploy multiple instances of compute nodes by just providing it's IP !!
Yes. Devstack is a tool which help you build all in one for Openstack environment in quickly (Just take a coffee cup and wait until complete). Normally they were using for developer to develop new features and/ or test code quickest. For operator, we need to setup by manual step by step for each services.
To build via devstack repo then you need pull newest source-code from http://git.openstack.org/openstack-dev/devstack. then create new local.conf in devstack folder. And run ./stack.sh.
For example local.conf: https://github.com/pshchelo/stackdev/blob/master/conf/local.conf.sample
Yes, Devstack install all the components of Openstack. But when you use basic configuration then it will install core components of openstack which are the base of openstack cloud platform to run some basic things.
And in Advance configuration of openstack you should configure your local.conf file for what type of services and components you want to install or use in your cloud.
https://github.com/openstack/tacker/blob/master/devstack/local.conf.example

Resources