I built the Apache Oozie 5.2.1 from the source code in my MacOS and currently having trouble running it. The ClassNotFoundException indicates a missing class org.apache.hadoop.conf.Configuration but it is available in both libext/ and the Hadoop file system.
I followed the 1st approach given here to copy Hadoop libraries to Oozie binary distro.
https://oozie.apache.org/docs/5.2.1/DG_QuickStart.html
I downloaded Hadoop 2.6.0 distro and copied all the jars to libext before running Oozie in addition to other configs, etc as specified in the following blog.
https://www.trytechstuff.com/how-to-setup-apache-hadoop-2-6-0-version-single-node-on-ubuntu-mac/
This is how I installed Hadoop in MacOS. Hadoop 2.6.0 is working fine.
http://zhongyaonan.com/hadoop-tutorial/setting-up-hadoop-2-6-on-mac-osx-yosemite.html
This looks pretty basic issue but could not find why the jar/class in libext is not loaded.
OS: MacOS 10.14.6 (Mojave)
JAVA: 1.8.0_191
Hadoop: 2.6.0 (running in
the Mac)
$ pwd
/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1
$ ll libext/hadoop-common-2.6.0.jar
-rw-r--r-- 1 ckit 1837102431 3.1M 10 May 06:58 libext/hadoop-common-2.6.0.jar
$ oozie-5.2.1$ bin/oozied.sh run
Setting OOZIE_HOME: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1
Setting OOZIE_CONFIG: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/conf
Sourcing: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/conf/oozie-env.sh
Setting OOZIE_CONFIG_FILE: oozie-site.xml
Setting OOZIE_DATA: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/data
Setting OOZIE_LOG: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/logs
Setting OOZIE_LOG4J_FILE: oozie-log4j.properties
Setting OOZIE_LOG4J_RELOAD: 10
Setting OOZIE_HTTP_HOSTNAME: C02VR2JSHTDD
Setting OOZIE_INSTANCE_ID: C02VR2JSHTDD
Setting JETTY_OUT: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/logs/jetty.out
Setting JETTY_PID_FILE: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/embedded-oozie-server/oozie.pid
Using Java executable from /Library/Java/JavaVirtualMachines/jdk1.8.0_191.jdk/Contents/Home/
Using JETTY_OPTS:
Adding to JETTY_OPTS: -Doozie.home.dir=/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1 -Doozie.config.dir=/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/conf -Doozie.log.dir=/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/logs -Doozie.data.dir=/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/data -Doozie.instance.id=C02VR2JSHTDD -Doozie.config.file=oozie-site.xml -Doozie.log4j.file=oozie-log4j.properties -Doozie.log4j.reload=10 -Djava.library.path= -cp /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/embedded-oozie-server/*:/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/embedded-oozie-server/dependency/*:/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/lib/*:/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libtools/*:/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/embedded-oozie-server
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/activation-1.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/aopalliance-1.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/apacheds-i18n-2.0.0-M15.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/apacheds-kerberos-codec-2.0.0-M15.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/api-asn1-api-1.0.0-M20.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/api-util-1.0.0-M20.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/asm-3.2.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/avro-1.7.4.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/aws-java-sdk-1.7.4.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-beanutils-1.7.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-beanutils-core-1.8.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-cli-1.2.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-codec-1.4.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-collections-3.2.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-compress-1.4.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-configuration-1.6.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-daemon-1.0.13.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-digester-1.8.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-el-1.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-httpclient-3.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-io-2.4.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-lang-2.6.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-logging-1.1.3.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-math3-3.1.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/commons-net-3.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/curator-client-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/curator-framework-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/curator-recipes-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/gson-2.2.4.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/guava-11.0.2.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/guice-3.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/guice-servlet-3.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-annotations-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-ant-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-archives-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-auth-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-aws-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-common-2.6.0-tests.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-common-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-datajoin-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-distcp-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-extras-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-gridmix-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-hdfs-2.6.0-tests.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-hdfs-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-hdfs-nfs-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-client-app-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-client-common-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-client-core-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-client-hs-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-client-hs-plugins-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-client-jobclient-2.6.0-tests.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-client-jobclient-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-client-shuffle-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-mapreduce-examples-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-nfs-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-openstack-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-rumen-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-sls-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-streaming-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-api-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-applications-distributedshell-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-client-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-common-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-registry-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-server-applicationhistoryservice-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-server-common-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-server-nodemanager-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-server-resourcemanager-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-server-tests-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hadoop-yarn-server-web-proxy-2.6.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/hamcrest-core-1.3.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/htrace-core-3.0.4.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/httpclient-4.2.5.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/httpcore-4.2.5.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jackson-annotations-2.2.3.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jackson-core-2.2.3.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jackson-core-asl-1.9.13.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jackson-databind-2.2.3.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jackson-jaxrs-1.9.13.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jackson-mapper-asl-1.9.13.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jackson-xc-1.9.13.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/java-xmlbuilder-0.4.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/javax.inject-1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jaxb-api-2.2.2.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jaxb-impl-2.2.3-1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jersey-client-1.9.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jersey-core-1.9.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jersey-guice-1.9.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jersey-json-1.9.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jersey-server-1.9.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jets3t-0.9.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jettison-1.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jetty-6.1.26.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jetty-util-6.1.26.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jline-0.9.94.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/joda-time-2.5.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jsch-0.1.42.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/jsr305-1.3.9.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/junit-4.11.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/leveldbjni-all-1.8.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/log4j-1.2.17.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/metrics-core-3.0.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/mockito-all-1.8.5.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/mysql-connector-java-8.0.24.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/netty-3.6.2.Final.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/paranamer-2.3.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/protobuf-java-2.5.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/servlet-api-2.5.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/slf4j-api-1.7.5.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/slf4j-log4j12-1.7.5.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/snappy-java-1.0.4.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/stax-api-1.0-2.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/xercesImpl-2.9.1.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/xml-apis-1.3.04.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/xmlenc-0.52.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/xz-1.0.jar
INFO: Adding extension: /Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/zookeeper-3.4.6.jar
/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/embedded-oozie-server/webapp/ext-2.2 already exists
Setting up oozie DB
Validate DB Connection
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/lib/slf4j-log4j12-1.6.6.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/Users/ckit/platforms/oozie-5.2.1/oozie_install/oozie-5.2.1/libext/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
Loading class `com.mysql.jdbc.Driver'. This is deprecated. The new driver class is `com.mysql.cj.jdbc.Driver'. The driver is automatically registered via the SPI and manual loading of the driver class is generally unnecessary.
DONE
DB schema exists
The SQL commands have been written to: /var/folders/hs/7z8yx1n535s5b_rvw3c59kqh34zx3v/T/ooziedb-485151057635515282.sql
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/conf/Configuration
at java.lang.Class.getDeclaredMethods0(Native Method)
at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)
at java.lang.Class.privateGetMethodRecursive(Class.java:3048)
at java.lang.Class.getMethod0(Class.java:3018)
at java.lang.Class.getMethod(Class.java:1784)
at sun.launcher.LauncherHelper.validateMainClass(LauncherHelper.java:544)
at sun.launcher.LauncherHelper.checkAndLoadMain(LauncherHelper.java:526)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.conf.Configuration
at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 7 more
I was able to sort the above issue and few other ClassNotFoundException by copying the following jar files from extlib to lib. Both folder are in oozie_install/oozie-5.2.1.
libext/hadoop-common-2.6.0.jar
libext/commons-configuration-1.6.jar
libext/hadoop-mapreduce-client-core-2.6.0.jar
libext/hadoop-hdfs-2.6.0.jar
While I am not sure how many more jars need to be moved from libext to lib while I try to run an example workflow/job in oozie. This fix brought up Oozie web site at http://localhost:11000/oozie/
I am also not sure why Oozie doesn't load the libraries in the libext/ folder.
Related
Development environment:
Apache Maven 3.6.3
Maven home: /usr/share/maven
Java version: 11.0.6, vendor: Oracle Corporation, runtime: /home/linuxlp/opt/graalvm/graalvm-svm-linux-20.1.0-ea+28
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "5.4.0-31-generic", arch: "amd64", family: "unix"
My application uses Reactor Netty for client http rest services. The io.netty libraries are generating INFO errors since some of these classes are getting initialized at build time, but they need to be initialized at runtime. There is a Graalvm flag --initialize-at-run-time that I would like to try, but I don't see how to implement it. I tried to implement it in a config file "initruntime" and put that file in the resources/META-INF/substrate/config directory, but this didn't work. Part of client-debug0.log file is included below showing one of the exceptions:
[Sun May 24 18:38:16 EDT 2020][INFO] [SUB] Error: Class initialization of io.netty.handler.ssl.JettyNpnSslEngine failed. Use the option --initialize-at-run-time=io.netty.handler.ssl.JettyNpnSslEngine to explicitly request delayed initialization of this class.
You can add this command to the list of native-image commands like this:
<nativeImageArgs>
<nativeImageArg>--initialize-at-build-time=com.mycompany.main.internal.NativeImageStaticInitializer</nativeImageArg>
</nativeImageArgs>
I'm trying to add a project in my django admin panel, but get an OperationalError. I was searching and found that is a
compatibility problem. How can i set other version of sqlite3 in my project?
I tried to install some other version of sqlite but doesn't work. I also search in the documentation of django and other pleases but nothing so far.
This is my Project model:
class Project(models.Model):
title = models.CharField(max_length=200)
description = models.TextField()
image = models.ImageField() .
created = models.DateTimeField(auto_now_add=True)
updated = models.DateTimeField(auto_now=True)
And this is the OperationalError:
OperationalError at /admin/portfolio/proyect/add/
no such table: main.auth_user__old
Request Method: POST
Request URL: http://127.0.0.1:8000/admin/portfolio/proyect/add/
Django Version: 2.0.2
Exception Type: OperationalError
Exception Value:
no such table: main.auth_user__old
Exception Location: /Users/carloseduardoloreshernandez/anaconda3/envs/django2/lib/python3.7/site-packages/django/db/backends/sqlite3/base.py in execute, line 303
Python Executable: /Users/carloseduardoloreshernandez/anaconda3/envs/django2/bin/python
Python Version: 3.7.4
Python Path:
['/Users/carloseduardoloreshernandez/Desktop/Apps/Personal/Python/Django2-Udemy/Web '
'personal/Web-personal-Django2/Backend',
'/Users/carloseduardoloreshernandez/anaconda3/envs/django2/lib/python37.zip',
'/Users/carloseduardoloreshernandez/anaconda3/envs/django2/lib/python3.7',
'/Users/carloseduardoloreshernandez/anaconda3/envs/django2/lib/python3.7/lib-dynload',
'/Users/carloseduardoloreshernandez/anaconda3/envs/django2/lib/python3.7/site-packages']
Server time: Dom, 15 Sep 2019 10:10:05 +0000
I solved it making a django upgrade:
pip install django --upgrade
then a migration:
python manage.py migrate
now all is working perfectly.
When publishing our plugin we got this
[info] Done packaging.
[trace] Stack trace suppressed: run last *:publish for the full output.
[error] (*:publish) java.io.IOException: PUT operation to URL https://nexus.mycompany.com/repository/maven-snapshots/com/foo/foo-sbt-plugin_2.10_0.13/1.0.0-SNAPSHOT/foo-sbt-plugin-1.0.0-SNAPSHOT.pom failed with status code 400: Invalid path for a Maven 2 repository
We set up the plugin using
sbtPlugin := true
publishMavenStyle := true
This was fixed by setting the repository Layout Policy to permissive in the nexus admin.
http://nexus.mycompany.com/#admin/repository/repositories:maven-releases
http://nexus.mycompany.com/#admin/repository/repositories:maven-snapshots
After installing JsFormValidatorBundle, I keep getting the error bellow when I try to open my page on localhost. I installed the bundle following the instruction on https://github.com/formapro/JsFormValidatorBundle, composer installed the bundle successfully. My Symfony version is the 2.8. And my composer is updated.
InvalidArgumentException in FormPass.php line 59:
Tagged form type extension must have the extended type configured using the extended_type/extended-type attribute, none was configured for the "fp_js_form_validator.extension" service.
I tried to add this information at app/config/services.yml, but did not work:
fp_js_form_validator.extension:
class: Fp\JsFormValidatorBundle\Form\Extension\FormExtension
tags:
- { name: form.type_extension, alias='form', extended_type: Symfony\Component\Form\Extension\Core\Type\FileType }
Thanks
I'm trying to install sbt on windows 7 but testing it, I get the following error:
java.nio.channels.OverlappingFileLockException
at sun.nio.ch.SharedFileLockTable.checkList(Unknown Source)
at sun.nio.ch.SharedFileLockTable.add(Unknown Source)
at sun.nio.ch.FileChannelImpl.tryLock(Unknown Source)
at java.nio.channels.FileChannel.tryLock(Unknown Source)
at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:88)
at xsbt.boot.Locks$GlobalLock.withChannelRetries$1(Locks.scala:81)
at xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:102)
at xsbt.boot.Using$.withResource(Using.scala:11)
at xsbt.boot.Using$.apply(Using.scala:10)
at xsbt.boot.Locks$GlobalLock.ignoringDeadlockAvoided(Locks.scala:62)
at xsbt.boot.Locks$GlobalLock.liftedTree1$1(Locks.scala:52)
at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:52)
at xsbt.boot.Locks$.apply0(Locks.scala:31)
at xsbt.boot.Locks$.apply(Locks.scala:28)
at xsbt.boot.Update.apply(Checks.java:100)
at xsbt.boot.Launch.update(Launch.scala:266)
at xsbt.boot.Launch.retrieve$1(Launch.scala:136)
at xsbt.boot.Launch$$anonfun$3.apply(Launch.scala:144)
at scala.Option.getOrElse(Option.scala:108)
at xsbt.boot.Launch$$anon$2.call(Launch.scala:129)
at xsbt.boot.Locks$GlobalLock.withChannel$1(Locks.scala:98)
at xsbt.boot.Locks$GlobalLock.withChannelRetries$1(Locks.scala:81)
at xsbt.boot.Locks$GlobalLock$$anonfun$withFileLock$1.apply(Locks.scala:102)
at xsbt.boot.Using$.withResource(Using.scala:11)
at xsbt.boot.Using$.apply(Using.scala:10)
at xsbt.boot.Locks$GlobalLock.ignoringDeadlockAvoided(Locks.scala:62)
at xsbt.boot.Locks$GlobalLock.liftedTree1$1(Locks.scala:52)
at xsbt.boot.Locks$GlobalLock.withLock(Locks.scala:52)
at xsbt.boot.Locks$.apply0(Locks.scala:31)
at xsbt.boot.Locks$.apply(Locks.scala:28)
at xsbt.boot.Launch.locked(Launch.scala:165)
at xsbt.boot.Launch.app(Launch.scala:82)
at xsbt.boot.Launch.app(Launch.scala:80)
at xsbt.boot.Launch$.run(Launch.scala:51)
at xsbt.boot.Launch$$anonfun$explicit$1.apply(Launch.scala:45)
at xsbt.boot.Launch$.launch(Launch.scala:60)
at xsbt.boot.Launch$.apply(Launch.scala:16)
at xsbt.boot.Boot$.runImpl(Boot.scala:31)
at xsbt.boot.Boot$.main(Boot.scala:20)
at xsbt.boot.Boot.main(Boot.scala)
at SbtJansiLaunch.main(SbtJansiLaunch.java:4)
Error during sbt execution: java.nio.channels.OverlappingFileLockException
which seems related to the fact that I do have access to my remote HOME drive according to this post:
https://groups.google.com/forum/#!topic/simple-build-tool/lJvOvZ5RUwE
I tried to follow what they suggest, but I have never found any sbt.boot.properties file. I have also tried to overwrite the boot and working dir via:
sbt -sbt-dir C:\my\new\home -sbt-boot C:\my\new\home
Would any of you have gone through all these problems and could have a step-by-step recipy to solve that ?
Ok so I had the same problem. The sbt.boot.properties file resides inside the sbt-launch.jar archive. Open it with an archive tool like winzip or 7zip and then look in the folder /sbt and you will see the sbt.boot.properties file.
The current version looks like this
[scala]
version: ${sbt.scala.version-auto}
[app]
org: ${sbt.organization-org.scala-sbt}
name: sbt
version: ${sbt.version-read(sbt.version)[0.13.6]}
class: ${sbt.main.class-sbt.xMain}
components: xsbti,extra
cross-versioned: ${sbt.cross.versioned-false}
resources: ${sbt.extraClasspath-}
[repositories]
local
typesafe-ivy-releases: https://repo.typesafe.com/typesafe/ivy-releases/, [organization]/[module]/[revision]/[type]s/[artifact](-[classifier]).[ext], bootOnly
maven-central
[boot]
directory: ${sbt.boot.directory-${sbt.global.base-${user.home}/.sbt}/boot/}
[ivy]
ivy-home: ${sbt.ivy.home-${user.home}/.ivy2/}
checksums: ${sbt.checksums-sha1,md5}
override-build-repos: ${sbt.override.build.repos-false}
repository-config: ${sbt.repository.config-${sbt.global.base-${user.home}/.sbt}/repositories}
Make sure you add the property lock in the [boot] section or you will get another error. So eventually it should look like this:
[scala]
version: ${sbt.scala.version-auto}
[app]
org: ${sbt.organization-org.scala-sbt}
name: sbt
version: ${sbt.version-read(sbt.version)[0.13.6]}
class: ${sbt.main.class-sbt.xMain}
components: xsbti,extra
cross-versioned: ${sbt.cross.versioned-false}
resources: ${sbt.extraClasspath-}
[repositories]
local
typesafe-ivy-releases: https://repo.typesafe.com/typesafe/ivy-releases/, [organization]/[module]/[revision]/[type]s/[artifact](-[classifier]).[ext], bootOnly
maven-central
[boot]
directory: ${sbt.boot.directory-${sbt.global.base-${user.home}/.sbt}/boot/}
lock: false
[ivy]
ivy-home: ${sbt.ivy.home-${user.home}/.ivy2/}
checksums: ${sbt.checksums-sha1,md5}
override-build-repos: ${sbt.override.build.repos-false}
repository-config: ${sbt.repository.config-${sbt.global.base-${user.home}/.sbt}/repositories}
Another point of attention is also what they said on that google group. Do not run two sbt processes at the same time, as this parameter might cause inconsistencies then.