I was using 1.6.0_19 jdk and installed 1.6.0_20 jdk..
Glassfish doesn't like that...
Here are my windows environment variables..
ALLUSERSPROFILE=C:\ProgramData
ANT_HOME=C:\apache-ant-1.8.1\
APPDATA=C:\Users\Parhs\AppData\Roaming
CommonProgramFiles=C:\Program Files\Common Files
COMPUTERNAME=PARHS-PC
ComSpec=C:\Windows\system32\cmd.exe
FP_NO_HOST_CHECK=NO
HOMEDRIVE=C:
HOMEPATH=\Users\Parhs
JAVA_HOME=C:\Program Files\Java\jdk1.6.0_20\
LOCALAPPDATA=C:\Users\Parhs\AppData\Local
LOGONSERVER=\\PARHS-PC
NUMBER_OF_PROCESSORS=2
OS=Windows_NT
Path=C:\Program Files\PHP\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wb
em;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Toshiba\Bluetoot
h Toshiba Stack\sys\;C:\Program Files\Microsoft SQL Server\90\Tools\binn\;C:\apa
che-ant-1.8.1\bin
PATHEXT=.COM;.EXE;.BAT;.CMD;.VBS;.VBE;.JS;.JSE;.WSF;.WSH;.MSC
PHPRC=C:\Program Files\PHP\php.ini
PROCESSOR_ARCHITECTURE=x86
PROCESSOR_IDENTIFIER=x86 Family 6 Model 14 Stepping 8, GenuineIntel
PROCESSOR_LEVEL=6
PROCESSOR_REVISION=0e08
ProgramData=C:\ProgramData
ProgramFiles=C:\Program Files
PROMPT=$P$G
PSModulePath=C:\Windows\system32\WindowsPowerShell\v1.0\Modules\
PUBLIC=C:\Users\Public
SESSIONNAME=Console
SystemDrive=C:
SystemRoot=C:\Windows
TEMP=C:\Users\Parhs\AppData\Local\Temp
TMP=C:\Users\Parhs\AppData\Local\Temp
USERDOMAIN=Parhs-PC
USERNAME=Parhs
USERPROFILE=C:\Users\Parhs
VS90COMNTOOLS=C:\Program Files\Microsoft Visual Studio 9.0\Common7\Tools\
windir=C:\Windows
Also here is my asenv.bat
REM DO NOT ALTER OR REMOVE COPYRIGHT
NOTICES OR THIS HEADER. REM REM
Copyright 2004-2009 Sun Microsystems,
Inc. All rights reserved. REM REM Use
is subject to License Terms REM
set AS_IMQ_LIB=....\mq\lib set
AS_IMQ_BIN=....\mq\bin set
AS_CONFIG=..\config set AS_INSTALL=..
set AS_DEF_DOMAINS_PATH=..\domains set
AS_DERBY_INSTALL=....\javadb set
AS_JAVA="C:\Program
Files\Java\jdk1.6.0_20"
And although restarting system and server i am getting this report
Operating System Information:
Name of the Operating System: Windows 7
Binary Architecture name of the Operating System: x86, Version: 6.1
Number of processors available on the Operating System: 2
System load on the available processors for the last minute: -1.0. (Sum of running and queued runnable entities per minute)
General Java Runtime Environment Information for the VM: 6152#Parhs-PC
JRE BootClassPath: C:\glassfishv3\glassfish/modules/endorsed\javax.annotation.jar;C:\glassfishv3\glassfish/modules/endorsed\jaxb-api-osgi.jar;C:\glassfishv3\glassfish/modules/endorsed\webservices-api-osgi.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\resources.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\rt.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\sunrsasign.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\jsse.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\jce.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\charsets.jar;C:\Program Files\Java\jdk1.6.0_19\jre\classes;C:\glassfishv3\glassfish\lib\monitor\btrace-boot.jar
JRE ClassPath: C:\glassfishv3\glassfish\modules\glassfish.jar;C:\glassfishv3\glassfish\lib\monitor\btrace-agent.jar
JRE Native Library Path: C:\Program Files\Java\jdk1.6.0_19\bin;.;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Program Files\PHP\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Toshiba\Bluetooth Toshiba Stack\sys\;C:\Program Files\Microsoft SQL Server\90\Tools\binn\;C:\apache-ant-1.8.1\bin
JRE name: Java HotSpot(TM) Client VM Vendor: Sun Microsystems Inc. Version: 16.2-b04
List of System Properties for the Java Virtual Machine:
ANTLR_USE_DIRECT_CLASS_LOADING = true
AS_CONFIG = C:\glassfishv3\glassfish\config\..\config
AS_DEF_DOMAINS_PATH = C:\glassfishv3\glassfish\config\..\domains
AS_DERBY_INSTALL = C:\glassfishv3\glassfish\config\..\..\javadb
AS_IMQ_BIN = C:\glassfishv3\glassfish\config\..\..\mq\bin
AS_IMQ_LIB = C:\glassfishv3\glassfish\config\..\..\mq\lib
AS_INSTALL = C:\glassfishv3\glassfish\config\..
AS_JAVA = C:\Program Files\Java\jdk1.6.0_20\jre
GlassFish_Platform = Felix
awt.toolkit = sun.awt.windows.WToolkit
catalina.base = C:\glassfishv3\glassfish\domains\domain1
catalina.home = C:\glassfishv3\glassfish\domains\domain1
catalina.useNaming = false
com.sun.aas.configRoot = C:\glassfishv3\glassfish\config
com.sun.aas.derbyRoot = C:\glassfishv3\javadb
com.sun.aas.domainsRoot = C:\glassfishv3\glassfish\domains
com.sun.aas.hostName = Parhs-PC
com.sun.aas.imqBin = C:\glassfishv3\mq\bin
com.sun.aas.imqLib = C:\glassfishv3\mq\lib
com.sun.aas.installRoot = C:\glassfishv3\glassfish
com.sun.aas.installRootURI = file:/C:/glassfishv3/glassfish/
com.sun.aas.instanceName = server
com.sun.aas.instanceRoot = C:\glassfishv3\glassfish\domains\domain1
com.sun.aas.instanceRootURI = file:/C:/glassfishv3/glassfish/domains/domain1/
com.sun.aas.javaRoot = C:\Program Files\Java\jdk1.6.0_19\jre
com.sun.enterprise.config.config_environment_factory_class = com.sun.enterprise.config.serverbeans.AppserverConfigEnvironmentFactory
com.sun.enterprise.hk2.cacheDir = C:\glassfishv3\glassfish\domains\domain1\osgi-cache\felix
com.sun.enterprise.jaccprovider.property.repository = C:\glassfishv3\glassfish\domains\domain1/generated/policy
com.sun.enterprise.security.httpsOutboundKeyAlias = s1as
common.loader = ${catalina.home}/common/classes,${catalina.home}/common/endorsed/*.jar,${catalina.home}/common/lib/*.jar
eclipselink.security.usedoprivileged = true
ejb.home = C:\glassfishv3\glassfish\modules\ejb
felix.config.properties = file:/C:/glassfishv3/glassfish/osgi/felix/conf/config.properties
felix.fileinstall.bundles.new.start = true
felix.fileinstall.debug = 1
felix.fileinstall.dir = C:\glassfishv3\glassfish/modules/autostart/
felix.fileinstall.poll = 5000
felix.system.properties = file:/C:/glassfishv3/glassfish/osgi/felix/conf/system.properties
file.encoding = Cp1253
file.encoding.pkg = sun.io
file.separator = \
glassfish.version = GlassFish v3 (build 74.2)
hk2.startup.context.args = #Mon Jun 07 20:27:37 EEST 2010
-startup-classpath=C\:\\glassfishv3\\glassfish\\modules\\glassfish.jar;C\:\\glassfishv3\\glassfish\\lib\\monitor\\btrace-agent.jar
__time_zero=1275931657334
hk2.startup.context.mainModule=org.glassfish.core.kernel
-startup-args=--domain,,,domain1,,,--domaindir,,,C\:\\glassfishv3\\glassfish\\domains\\domain1
--domain=domain1
-startup-classname=com.sun.enterprise.glassfish.bootstrap.ASMain
--domaindir=C\:\\glassfishv3\\glassfish\\domains\\domain1
hk2.startup.context.root = C:\glassfishv3\glassfish\modules
http.nonProxyHosts = localhost|127.0.0.1|Parhs-PC
java.awt.graphicsenv = sun.awt.Win32GraphicsEnvironment
java.awt.printerjob = sun.awt.windows.WPrinterJob
java.class.path = C:\glassfishv3\glassfish\modules\glassfish.jar;C:\glassfishv3\glassfish\lib\monitor\btrace-agent.jar
java.class.version = 50.0
java.endorsed.dirs = C:\glassfishv3\glassfish/modules/endorsed;C:\glassfishv3\glassfish/lib/endorsed
java.ext.dirs = C:\Program Files\Java\jdk1.6.0_19\jre/lib/ext;C:\Program Files\Java\jdk1.6.0_19\jre/jre/lib/ext;C:\glassfishv3\glassfish\domains\domain1/lib/ext
java.home = C:\Program Files\Java\jdk1.6.0_19\jre
java.io.tmpdir = C:\Users\Parhs\AppData\Local\Temp\
java.library.path = C:\Program Files\Java\jdk1.6.0_19\bin;.;C:\Windows\Sun\Java\bin;C:\Windows\system32;C:\Windows;C:\Program Files\PHP\;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files\Toshiba\Bluetooth Toshiba Stack\sys\;C:\Program Files\Microsoft SQL Server\90\Tools\binn\;C:\apache-ant-1.8.1\bin
java.net.useSystemProxies = true
java.rmi.server.randomIDs = true
java.runtime.name = Java(TM) SE Runtime Environment
java.runtime.version = 1.6.0_19-b04
java.security.auth.login.config = C:\glassfishv3\glassfish\domains\domain1/config/login.conf
java.security.policy = C:\glassfishv3\glassfish\domains\domain1/config/server.policy
java.specification.name = Java Platform API Specification
java.specification.vendor = Sun Microsystems Inc.
java.specification.version = 1.6
java.util.logging.config.file = C:\glassfishv3\glassfish\domains\domain1\config\logging.properties
java.vendor = Sun Microsystems Inc.
java.vendor.url = http://java.sun.com/
java.vendor.url.bug = http://java.sun.com/cgi-bin/bugreport.cgi
java.version = 1.6.0_19
java.vm.info = mixed mode
java.vm.name = Java HotSpot(TM) Client VM
java.vm.specification.name = Java Virtual Machine Specification
java.vm.specification.vendor = Sun Microsystems Inc.
java.vm.specification.version = 1.0
java.vm.vendor = Sun Microsystems Inc.
java.vm.version = 16.2-b04
javax.net.ssl.keyStore = C:\glassfishv3\glassfish\domains\domain1/config/keystore.jks
javax.net.ssl.keyStorePassword = changeit
javax.net.ssl.trustStore = C:\glassfishv3\glassfish\domains\domain1/config/cacerts.jks
javax.net.ssl.trustStorePassword = changeit
javax.rmi.CORBA.PortableRemoteObjectClass = com.sun.corba.ee.impl.javax.rmi.PortableRemoteObject
javax.rmi.CORBA.StubClass = com.sun.corba.ee.impl.javax.rmi.CORBA.StubDelegateImpl
javax.rmi.CORBA.UtilClass = com.sun.corba.ee.impl.javax.rmi.CORBA.Util
javax.security.jacc.PolicyConfigurationFactory.provider = com.sun.enterprise.security.provider.PolicyConfigurationFactoryImpl
jdbc.drivers = org.apache.derby.jdbc.ClientDriver
jpa.home = C:\glassfishv3\glassfish\modules\jpa
line.separator =
org.glassfish.web.rfc2109_cookie_names_enforced = false
org.jvnet.hk2.osgimain.autostartBundles = osgi-adapter.jar, org.apache.felix.shell.jar, org.apache.felix.shell.remote.jar, org.apache.felix.configadmin.jar, org.apache.felix.fileinstall.jar
org.jvnet.hk2.osgimain.bundlesDir = C:\glassfishv3\glassfish\modules
org.jvnet.hk2.osgimain.excludedSubDirs = autostart/
org.omg.CORBA.ORBClass = com.sun.corba.ee.impl.orb.ORBImpl
org.omg.CORBA.ORBSingletonClass = com.sun.corba.ee.impl.orb.ORBSingleton
org.osgi.framework.storage = C:\glassfishv3\glassfish\domains\domain1\osgi-cache\felix
os.arch = x86
os.name = Windows 7
os.version = 6.1
osgi.shell.telnet.ip = 127.0.0.1
osgi.shell.telnet.maxconn = 1
osgi.shell.telnet.port = 6666
package.access =
package.definition =
path.separator = ;
security.home = C:\glassfishv3\glassfish\modules\security
server.loader = ${catalina.home}/server/classes,${catalina.home}/server/lib/*.jar
shared.loader = ${catalina.home}/shared/classes,${catalina.home}/shared/lib/*.jar
sun.arch.data.model = 32
sun.boot.class.path = C:\glassfishv3\glassfish/modules/endorsed\javax.annotation.jar;C:\glassfishv3\glassfish/modules/endorsed\jaxb-api-osgi.jar;C:\glassfishv3\glassfish/modules/endorsed\webservices-api-osgi.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\resources.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\rt.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\sunrsasign.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\jsse.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\jce.jar;C:\Program Files\Java\jdk1.6.0_19\jre\lib\charsets.jar;C:\Program Files\Java\jdk1.6.0_19\jre\classes;C:\glassfishv3\glassfish\lib\monitor\btrace-boot.jar
sun.boot.library.path = C:\Program Files\Java\jdk1.6.0_19\jre\bin
sun.cpu.endian = little
sun.cpu.isalist = pentium_pro+mmx pentium_pro pentium+mmx pentium i486 i386 i86
sun.desktop = windows
sun.io.unicode.encoding = UnicodeLittle
sun.java.launcher = SUN_STANDARD
sun.jnu.encoding = Cp1253
sun.management.compiler = HotSpot Client Compiler
sun.os.patch.level =
user.country = GR
user.dir = C:\glassfishv3\glassfish\domains\domain1
user.home = C:\Users\Parhs
user.language = el
user.name = Parhs
user.timezone = Europe/Athens
user.variant =
web.home = C:\glassfishv3\glassfish\modules\web
weld.home = C:\glassfishv3\glassfish\modules\weld
Why is it so hard??? What am i missing?
I'm using Glassfish v3 with Java 1.6.0_20, I didn't change anything in asenv.bat and I don't have any problem. However, I have the java executable in the PATH (i.e. %JAVA_HOME%\bin is in the PATH). You don't (and I would fix this, I would not touch the asenv.bat, and try again).
Just in case it saves someone some PITA, I had receive the same error, having had defined the JAVA_HOME with quotes. Mine JAVA_HOME was "C:\Program Files\Java\jdk1.6.0_31\" and in the PATH %JAVA_HOME%\bin was present. The java, eclipse, tomcat ant and quite a few other java programmes would start, but the glassfish would not.
Related
I have Oracle 11g installed locally on each of my virtualbox machines (working under Windows 7 64bit). Suddenty, after a simple reboot, the database on one of the 5 virtual machines doesn't want to connect anymore.
With SID connection I obtain ORA-12505 error, and with service name : "Network adapter could not establish the connection", in SqlDeveloper with both cases. If I try a connection with SqlPlus as sysdba, I obtain the connection but with "connected to an idle instance". Hence if I try to see, for example, the list of sessions and processes working, I have the error 01034 ("ORACLE not available"). I tried a lot of tricks but nothing works. Could it be a specific problem with virtual machines ?
Here what I tried :
the services (of my base and of the listener) are working (and I wait enough between relaunch and connection retry) ;
the files tnsnames.ora, listener.ora and sqlnet.ora seem correct (see below) ;
If I force localhost to be 127.0.0.1 in hosts file, I have the 12514 error ;
ORACLE_HOME and ORACLE_SID are correctly set ;
It can't a priori be a memory problem (I even try to allow more memory to the specific VM which doesn't work) ;
If I force "startup" on sysdba session, the next requests obtain : ORA-03114 : not connected to ORACLE ;
It's not a priori a problem of system files size. In all cases, the not working database is not my biggest database among all my databases (and any file in oradata are bigger than in others VMs which have exactly the same configurations).
# tnsnames.ora Network Configuration File: C:\oracle_32\product\11.2.0\dbhome_2\network\admin\tnsnames.ora
# Generated by Oracle configuration tools.
LISTENER_ORCL =
(ADDRESS = (PROTOCOL = TCP)(HOST = localhost)(PORT = 1521))
ORACLR_CONNECTION_DATA =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1521))
)
(CONNECT_DATA =
(SID = CLRExtProc)
(PRESENTATION = RO)
)
)
ORCL =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = localhost)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = orcl)
)
)
SQLNET.AUTHENTICATION_SERVICES= (NTS)
NAMES.DIRECTORY_PATH= (TNSNAMES, EZCONNECT)
# listener.ora Network Configuration File: C:\oracle_32\product\11.2.0\dbhome_2\network\admin\listener.ora
# Generated by Oracle configuration tools.
SID_LIST_LISTENER =
(SID_LIST =
(SID_DESC =
(SID_NAME = CLRExtProc)
(ORACLE_HOME = C:\oracle_32\product\11.2.0\dbhome_2)
(PROGRAM = extproc)
(ENVS = "EXTPROC_DLLS=ONLY:C:\oracle_32\product\11.2.0\dbhome_2\bin\oraclr11.dll")
)
)
LISTENER =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = localhost)(PORT = 1521))
)
)
ADR_BASE_LISTENER = C:\oracle_32
Thank you to read !
Here the alert log for the first connection of this morning :
Fri Jun 23 11:08:13 2017
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 2
Using LOG_ARCHIVE_DEST_1 parameter default value as USE_DB_RECOVERY_FILE_DEST
Autotune of undo retention is turned on.
IMODE=BR
ILAT =167
LICENSE_MAX_USERS = 0
SYS auditing is disabled
Starting up:
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options.
Using parameter settings in server-side spfile C:\ORACLE_32\PRODUCT\11.2.0\DBHOME_2\DATABASE\SPFILEORCL.ORA
System parameters with non-default values:
processes = 1000
sessions = 1524
memory_target = 1232M
control_files = "C:\ORACLE_32\ORADATA\ORCL\CONTROL01.CTL"
control_files = "C:\ORACLE_32\FLASH_RECOVERY_AREA\ORCL\CONTROL02.CTL"
db_block_size = 8192
compatible = "11.2.0.0.0"
db_recovery_file_dest = "C:\oracle_32\flash_recovery_area"
db_recovery_file_dest_size= 3852M
undo_tablespace = "UNDOTBS1"
remote_login_passwordfile= "EXCLUSIVE"
db_domain = ""
dispatchers = "(PROTOCOL=TCP) (SERVICE=orclXDB)"
local_listener = "LISTENER_ORCL"
audit_file_dest = "C:\ORACLE_32\ADMIN\ORCL\ADUMP"
audit_trail = "DB"
db_name = "orcl"
open_cursors = 300
diagnostic_dest = "C:\ORACLE_32"
Fri Jun 23 11:08:20 2017
PMON started with pid=2, OS id=2160
Fri Jun 23 11:08:20 2017
VKTM started with pid=3, OS id=2164 at elevated priority
VKTM running at (10)millisec precision with DBRM quantum (100)ms
Fri Jun 23 11:08:21 2017
GEN0 started with pid=4, OS id=2168
Fri Jun 23 11:08:21 2017
DIAG started with pid=5, OS id=2172
Fri Jun 23 11:08:21 2017
DBRM started with pid=6, OS id=2176
OER 7451 in Load Indicator : Error Code = OSD-04500: option indiquée interdite !
Fri Jun 23 11:08:21 2017
PSP0 started with pid=7, OS id=2180
Fri Jun 23 11:08:21 2017
DIA0 started with pid=8, OS id=2184
Fri Jun 23 11:08:21 2017
MMAN started with pid=9, OS id=2188
Fri Jun 23 11:08:21 2017
DBW0 started with pid=10, OS id=2192
Fri Jun 23 11:08:21 2017
LGWR started with pid=11, OS id=2196
Fri Jun 23 11:08:21 2017
CKPT started with pid=12, OS id=2200
Fri Jun 23 11:08:21 2017
SMON started with pid=13, OS id=2204
Fri Jun 23 11:08:21 2017
RECO started with pid=14, OS id=2208
Fri Jun 23 11:08:21 2017
MMON started with pid=15, OS id=2212
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
Fri Jun 23 11:08:21 2017
MMNL started with pid=16, OS id=2216
starting up 1 shared server(s) ...
ORACLE_BASE from environment = C:\oracle_32
Fri Jun 23 11:08:22 2017
alter database mount exclusive
Successful mount of redo thread 1, with mount id 1475182246
Database mounted in Exclusive Mode
Lost write protection disabled
Completed: alter database mount exclusive
alter database open
Fri Jun 23 11:08:31 2017
Errors in file c:\oracle_32\diag\rdbms\orcl\orcl\trace\orcl_lgwr_2196.trc:
ORA-00338: log 3 of thread 1 is more recent than control file
ORA-00312: online log 3 thread 1: 'C:\ORACLE_32\ORADATA\ORCL\REDO03.LOG'
Errors in file c:\oracle_32\diag\rdbms\orcl\orcl\trace\orcl_lgwr_2196.trc:
ORA-00338: log 3 of thread 1 is more recent than control file
ORA-00312: online log 3 thread 1: 'C:\ORACLE_32\ORADATA\ORCL\REDO03.LOG'
Errors in file c:\oracle_32\diag\rdbms\orcl\orcl\trace\orcl_ora_2232.trc:
ORA-00338: fichier journal 1 du thread plus recent que le fichier de controle
ORA-00312: journal en ligne 3 thread 1 : 'C:\ORACLE_32\ORADATA\ORCL\REDO03.LOG'
USER (ospid: 2232): terminating the instance due to error 338
Fri Jun 23 11:08:34 2017
Instance terminated by USER, pid = 2232`
Did you check the alert log of the database? that could be a good place to start looking.
Also when logged as sysdba, did you try to start the database: startup ?
If yes, what is the error message if any?
New to spark and spakrR. For Hadoop, only have a file called winutils/bin/winutils.exe.
Running system:
OS
Windows 10
Java
Java version "1.8.0_101"
Java(TM) SE Runtime Environment (build 1.8.0_101-b13)
Java HotSpot(TM) 64-Bit Server VM (build 25.101-b13, mixed mode)
R
platform: x86_64-w64-mingw32
arch: x86_64
os: mingw32
RStudio:
Version 1.0.20 – © 2009-2016 RStudio, Inc.
Spark
2.0.0
I can read data on my local machine, but on the deployed workers, I cannot do that.
Could anybody help me?
Run at local:
Sys.setenv(SPARK_HOME = "D:/SPARK2")
library(SparkR)
sparkR.session(master = "local[*]", enableHiveSupport = FALSE,sparkConfig = list(spark.driver.memory="4g",spark.sql.warehouse.dir = "d:/winutils/bin",sparkPackages = "com.databricks:spark-avro_2.11:3.0.1"))
Java ref type org.apache.spark.sql.SparkSession id 1
multiPeople <- read.json(c(paste(getwd(),"people.json",sep = "/"),"D:/RwizSpark_Private/people2.json"))
rand_10m_x <- read.df(x = "./demo.csv",source = "csv", inferSchema="true",na.strings= "NA")
Run at deployed workers:
Sys.setenv(SPARK_HOME = "D:/SPARK2")
library(SparkR)
sparkR.session(master = "spark:/mymasterIP", enableHiveSupport = FALSE,appName = "sparkRenzhi", sparkConfig = list(spark.driver.memory="6g",spark.sql.warehouse.dir = "d:/winutils/bin",spark.executor.memory = "2g", spark.executor.cores= "2"),sparkPackages = "com.databricks:spark-avro_2.11:3.0.1")
Java ref type org.apache.spark.sql.SparkSession id 1
multiPeople <- read.json(c(paste(getwd(),"people.json",sep = "/"),"D:/RwizSpark_Private/people2.json"))
Error in invokeJava(isStatic = FALSE, objId$id, methodName, ...) :
org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 in stage 0.0 failed 4 times, most recent failure: Lost task 1.3 in stage 0.0 (TID 6, 172.29.110.101): java.io.FileNotFoundException: File file:/D:/RwizSpark_Private/people2.json does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:609)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:822)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:599)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:140)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:341)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at org.apache.hadoop.mapred.LineRecordReader.(LineRecordReader.java:109)
at org.apache.hadoop.mapre
rand_10m_x <- read.df(x = "./demo.csv",source = "csv", inferSchema="true",na.strings= "NA")
Error in invokeJava(isStatic = TRUE, className, methodName, ...) :
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 1.0 failed 4 times, most recent failure: Lost task 0.3 in stage 1.0 (TID 11, 172.29.110.101): java.io.FileNotFoundException: File file:/D:/RwizSpark_Private/demo.csv does not exist
at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:609)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:822)
at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:599)
at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:421)
at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.(ChecksumFileSystem.java:140)
at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:341)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:767)
at org.apache.hadoop.mapred.LineRecordReader.(LineRecordReader.java:109)
at org.apache.hadoop.mapred.T
I'm developing a program using Android Studio that runs as expected when the normal APK is run, but if I compile it for Debugging, it crashes before the 1st line of code executes, so setting a brake-point on the 1st line of my code to execute, never trips.
I have already
Completely deleted the program from the test target (nexus 7)
Power offed the tablet and then restarted tablet
Power off/rebooted the development machine
Cleaned the project
Rebuilt the project.
The program still runs as expected when compiled/run without debugging.
Crashes after loading, but before running when compiled/run in debug.
Any ideas on how to try and overcome this problem would be welcome.
Android Studio 2.1.2
compileSdkVersion 21
buildToolsVersion "21.1.2
Copy of exception variable after crash
shadow$klass = {Class#613} "class java.lang.Class"
superClass = {Class#1356} "class java.lang.Exception"
2 = {ArtMethod#3613}
17 = {ArtMethod#3628}
numReferenceStaticFields = 0
verifyErrorClass = null
iFields = {ArtField[2]#3636}
stackState = {Object[22]#3602}
3 = {ArtMethod#3614}
0 = {ArtMethod#3611}
errno = 2
classLoader = null
8 = {ArtMethod#3619}
dexCache = {DexCache#3633}
functionName = "stat"
virtualMethods = {ArtMethod[3]#3639}
shadow$monitor = -1294973706
primitiveType = 0
Exception = {ErrnoException#3590}
16 = {ArtMethod#3627}
value = {char[4]#3607}
ifTable = {Object[2]#3637}
vtable = null
4 = {ArtMethod#3615}
suppressedExceptions = {Collections$EmptyList#3604} size = 0
classSize = 468
functionName = "stat"
6 = {ArtMethod#3617}
errno = 2
hashCode = 3540564
referenceStaticOffsets = 0
1 = {ArtMethod#3612}
13 = {ArtMethod#3624}
detailMessage = null
18 = {ArtMethod#3629}
stackTrace = {StackTraceElement[0]#3603}
sFields = null
dexClassDefIndex = 4
componentType = null
15 = {ArtMethod#3626}
status = 10
10 = {ArtMethod#3621}
shadow$klass = {Class#3428} "class java.lang.String"
shadow$klass = {Class#183} "class android.system.ErrnoException"
19 = {ArtMethod#3630}
12 = {ArtMethod#3623}
5 = {ArtMethod#3616}
referenceInstanceOffsets = -1090519040
cause = {ErrnoException#3590} "android.system.ErrnoException: stat failed: ENOENT (No such file or directory)"
suppressedExceptions = {Collections$EmptyList#3604} size = 0
objectSize = 36
detailMessage = null
shadow$klass = {Class#183} "class android.system.ErrnoException"
dexCacheStrings = {String[23663]#3634}
dexTypeIndex = 6
shadow$monitor = -1665173294
offset = 0
14 = {ArtMethod#3625}
numReferenceInstanceFields = 1
Variables debug info not available
21 = {int[21]#3632}
name = "android.system.ErrnoException"
stackState = {Object[22]#3602}
clinitThreadId = 456
directMethods = {ArtMethod[2]#3635}
7 = {ArtMethod#3618}
20 = {ArtMethod#3631}
9 = {ArtMethod#3620}
11 = {ArtMethod#3622}
count = 4
shadow$monitor = -1353303322
cause = {ErrnoException#3590} "android.system.ErrnoException: stat failed:
ENOENT (No such file or directory)"
stackTrace = {StackTraceElement[0]#3603}
accessFlags = 524305
Well, I solved the problem myself. NOT in a way that I'd like to have solved it, or that in any way explained what caused the problem, but the problem was corrected. - I've been in IT long enough to know you need to do backups, and once I remembered I had them, I pulled the backup of a day before the problem surfaced, restored the entire directory tree when the project resided and PUFF, everything worked. Re-applied any code changes I made in the day after the backup (I keep pretty good paper notes on changes) and away I went.
- BUT -
This doesn't explain why the system was working one day and after a night of sleep, the system wouldn't work the next day. And I still have no idea how a person who received the error message I received would go about debugging/fixing the problem if he/she didn't have a good set of backups.
ALSO – it seems that someone downgraded my question. Maybe it did deserve to be downgraded, but I have no idea why it was downgraded. The question seemed reasonable to me. One day late in the evening the system worked, and the next day it didn't and the information the system offered was posted in the question.
I'd be very happy if anyone could explain to me how a person could extract information from the posted log, to find out what was wrong – or – at least explain why the question was improper enough to warrant a downgrade ?
any reasonable comments would be welcome.
Joe Cullity
i am new to flume. My flume agent is not writing data to HDFS. Please help. Here is the code. The purpose of the code is to get the data from apache and park it to HDFS.
#identify the components on agent a1
a1.sources = apache_server
a1.sinks = hdfs_sink
a1.channels = c1
# Configure the source:
a1.sources.apache_server.type = exec
a1.sources.apache_server.command = tail -f /var/log/httpd/error_log
# Describe the sink:
a1.sinks.hdfs_sink.type = hdfs
a1.sinks.hdfs_sink.hdfs.path = hdfs://hadoop1.example.com:9000/Apache_Logs
a1.sinks.hdfs_sink.hdfs.writeFormat = Text
a1.sinks.hdfs_sink.hdfs.fileType = DataStream
a1.sinks.hdfs-sink.hdfs.rollInterval = 10
a1.sinks.hdfs_sink.hdfs.rollSize = 0
a1.sinks.hdfs-sink.hdfs.filePrefix=apacheaccess
# Configure a channel that buffers events in memory:
a1.channels.c1.type = memory
a1.channels.c1.capacity = 20000
a1.channels.c1.transactionCapacity = 100
# Bind the source and sink to the channel:
a1.sources.apache_server.channels = c1
a1.sinks.hdfs_sink.channel = c1
i am running 4 carbon cache instance behind 1 carbon relay instance. Below is my carbon.conf.
[cache:1]
LINE_RECEIVER_PORT = 2103
PICKLE_RECEIVER_PORT = 2104
CACHE_QUERY_PORT = 7102
STORAGE_DIR = /graphite_data/01
LOCAL_DATA_DIR = /graphite_data/01
[cache:2]
LINE_RECEIVER_PORT = 2203
PICKLE_RECEIVER_PORT = 2204
CACHE_QUERY_PORT = 7202
STORAGE_DIR = /graphite_data/02
LOCAL_DATA_DIR = /graphite_data/02
[cache:3]
LINE_RECEIVER_PORT = 2303
PICKLE_RECEIVER_PORT = 2304
CACHE_QUERY_PORT = 7302
STORAGE_DIR = /graphite_data/03
LOCAL_DATA_DIR = /graphite_data/03
[cache:4]
LINE_RECEIVER_PORT = 2403
PICKLE_RECEIVER_PORT = 2404
CACHE_QUERY_PORT = 7402
STORAGE_DIR = /graphite_data/04
LOCAL_DATA_DIR = /graphite_data/04
I have configured my carbon relay with below configutaion
LINE_RECEIVER_INTERFACE = 0.0.0.0
LINE_RECEIVER_PORT = 2003
PICKLE_RECEIVER_INTERFACE = 0.0.0.0
PICKLE_RECEIVER_PORT = 2004
RELAY_METHOD = consistent-hashing
.
REPLICATION_FACTOR = 1
DESTINATIONS=127.0.0.1:2104:1,127.0.0.1:2204:2,127.0.0.1:2304:3,127.0.0.1:2404:4
I have configured my graphite webapp with the below configuration to get the data from all carbon cache process
STANDARD_DIRS = ['/graphite_data/01',
'/graphite_data/02',
'/graphite_data/03',
'/graphite_data/04']
# You *should* use 127.0.0.1 here in most cases
CARBONLINK_HOSTS = ["127.0.0.1:7102:1", "127.0.0.1:7202:2", "127.0.0.1:7302:3","127.0.0.1:7402:4"]
After configuration , i started pushing data with example-client.py to my carbon relay process. I could see that relay is pushing data to carbon-cache process.
**[root#poc-graphite graphite]# ls /graphite_data/02/system/loadavg_5min.wsp
/graphite_data/02/system/loadavg_5min.wsp
[root#poc-graphite graphite]# ls /graphite_data/03/system/loadavg_1min.wsp
/graphite_data/03/system/loadavg_1min.wsp
[root#poc-graphite graphite]# ls /graphite_data/04/system/loadavg_15min.wsp
/graphite_data/04/system/loadavg_15min.wsp**
But I am not able to see this metrics in my webapp. is there something wrong with configuration.
You should check the path of the twisted plugin with blow commands:
$python
Python 2.7.6 (default, Mar 22 2014, 22:59:56)
[GCC 4.8.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import sys
>>> sys.path
['', '/usr/lib/python2.7', '/usr/lib/python2.7/plat-x86_64-linux-gnu', '/usr/lib/python2.7/lib-tk', '/usr/lib/python2.7/lib-old', '/usr/lib/python2.7/lib-dynload', '/usr/local/lib/python2.7/dist-packages', '/usr/lib/python2.7/dist-packages']
If in the results exist the path "/usr/local/lib/python2.7/dist-packages", just remove it:
sudo rm -rf /usr/local/lib/python2.7/dist-packages/twiste*
and then
sudo service carbon-cache stop ## wait a few seconds here
sudo service carbon-cache start