I’m getting the following error when I try to submit a training job to Cloud ML using the cloudml package (I’m replicating the keras fraud example here):
Error in gsutil_binary() : failed to find 'gsutil' binary
I’ve used gcloud_install() and installed everything, and set up my configurations with the shell as it opens after install. Running gsutil --version gives me gsutil version: 4.28, so it seems to have installed OK.
Anything I’m missing?
Other info:
$ python --version
Python 3.6.3
Also asked here
Solved here with issue 122 on the github repo. It was an error with the cloudml package.
Related
I am trying to install package SBCK from R build using Rscript build.R -c -v -i in windows command prompt following the steps given here. However, I ended up with package SBCK being not installed because of following error/warning InstallationWarning: package 'SBCK' is in use and will not be installed. I have no package with name SBCK installed on my system, so I do not understand why I am getting this warning message and thus not to be able to install the R package.
I know that similar question have been asked before here but solution there does not work in my case.
I am using R version 4.2.0 on Windows 10.
Once 'build.R' is run, "SBCK_0.5.0.tar.gz" is created in the 'SBCK-R' folder.
You can now install it via the package archive file option or pointing to that file in the install.packages command. I faced the same issue and this solved it.
I am try to install tensorflow within R and subsequently a package called "cellassign". I have installed tensorflow, reticulate, and keras with the following command and they all seem to be installed without any hiccups. I am also able to load the packages after installing.
devtools::install_github("rstudio/reticulate")
devtools::install_github("rstudio/tensorflow")
devtools::install_github("rstudio/keras")
However, I keep encountering the following issue when trying to use any command within tensorflow or keras package.
tensorflow::install_tensorflow()
Error: 'activate' is not a conda command.
Did you mean "source activate /home/users/ntu/ling0086/.conda/envs/r_env" ?
+ . /app/anaconda/3/bin/activate
+ conda activate '/home/users/ntu/ling0086/.conda/envs/r_env'
Also ran into another error if I tried using the following
> tensorflow::tf_config()
Python environments searched for 'tensorflow' package:
/home/users/ntu/ling0086/.conda/envs/r_env/bin/python3.10
/usr/bin/python
Python exception encountered:
ModuleNotFoundError: No module named 'six'
Any idea why this might be so? I am not familiar with linux-environment variables and I do not have sudo privilege. I was told that my "R" is loaded in a virtual environment and this might affect the path finding to the right packages. But I am unsure as to how I should rectify the above error. Any help would be deeply appreciated.
Not sure if this is of any help, but how I would normally run R entails:
module load anaconda/3
source activate r_env
R
I used to work in R 3.4.0 version. Hovewer, this version doesn't support such packages as keras and tensorflow.
I was adviced to upgrade my R version to the newest one.
I downloaded the most recent R version 4.0.2 from the official site, then ran the following code:
install.packages("keras")
library(keras)
install_keras()
And got the following error:
Error in install_keras() :
You should call install_keras() only in a fresh R session that has not yet initialized Keras and TensorFlow (this is to avoid DLL in use errors during installation)
After this, when I tried to quit R session by q() , I faced the following error:
Error: option error has NULL value
Error: no more error handlers available (recursive errors?); invoking 'abort' restart
Error: option error has NULL value
I've never faced such an error before. When I used old R version, I typed q() and then had to choose between y and n. No errors appeared.
I'm asking you to help to to solve this problem.
You need to create a new environment and then you can install R 4.+ in Anaconda. Follow these steps.
conda create --name r4-base
After activating r4-base run these commands
conda activate r4-base
conda install -c conda-forge r-base
conda install -c conda-forge/label/gcc7 r-base
Finally, you will notice r-basa version 4 will be installed.
Thereafter, you can install any supported packages. But with this only, you won't have the ability to use it in the Jupyter notebook. You need to install install.packages('IRkernel') and Jupyter notebook as well if you want to use it. Otherwise you are good to go with R-Studio.
For Jupyter Installation and RKernel.
conda install jupyter
Then open the R console. Write in R console
install.packages('IRkernel')
IRkernel::installspec()
Congrats! You can use Notebook for Python and R.
Find the location of R.exe on your computer. In my computer, this executable is at
C:\Program Files\R\R-3.4.3\bin
Open another Anaconda Prompt as Administrator and change directories to wherever R.exe is on your computer with cd file path. On my computer, it’s cd C:\Program Files\R\R-3.4.3\bin, but it might be different for you.
Then run R from within Anaconda Prompt in Admin mode with R.exe
You’ll notice that you’re in an R session. From here, run the following three commands into the terminal.
install.packages("devtools")
devtools::install_github("IRkernel/IRkernel")
IRkernel::installspec()
In order, they (1) install the devtools package which gets you the install_github() function, (2) install the IR Kernel from GitHub, and (3) tell Jupyter where to find the IR Kernel.
Open Jupyter notebook and enjoy your new R kernel!
Get more information here
#Rheatey Bash works perfectly. but i was facing python.exe this program cant start because api-ms-win-core-path-l1-1-0.dll python system error. this is a problem running on windows 7 but i resolved this issue by installing the kernel following https://richpauloo.github.io/2018-05-16-Installing-the-R-kernel-in-Jupyter-Lab/ and it works fine
Problem
I have hortonworks sandbox 2.4 on virtual box. I am following the tutorial found here for installing rHive on the sandbox. I am unable to duplicate steps 4 and 6 without producing errors. They are as follows:
Step 4 Error: Being in the ~/RHive/ directory and using ant build gives me the following error:
BUILD FAILD /root/RHive/build.xml:39: /root/RHive/usr/hdp/current/hive-server2/lib does not exist
Step 6 Error: Using R CMD INSTALL RHive_2.0-0.10.tar.gz produces the following error:
ERROR: dependencies "rJava", "Rserve" are not available for package "RHive"
Attempts
I have followed the directions as specified on here as well, which is the Rhive documents, but unfortunately have gotten nowhere.
Step 4: I am at a loss as to why ant build could be failing. I have verified I installed it correctly and it states Apache Ant(TM) version 1.9.7 compiled April 9 2016 when I run command ant -version. So I followed those procedures correctly.
Step 6:
I used rStudio to install rJava and Rserve using install.package() command. Indeed, the tutorial suggests this as well. I suspect something is wrong with my java dependencies?
I have used Ambari to use Hive before, but this is the first time I am trying to use it in R and I am abviously still new to the hortonworks vm, so I would appreciate any kindness and assistance to help me fix the issues I am encountering.
I think the answer is to abandon rHive. It was yanked from CRAN. Anyone thinking about using it with R and finds this post, please consider RJDBC.
I'm trying to install Apache Zeppelin on my old computer that runs Ubuntu. So far, I'm able to install Zeppelin very easily by cloning the latest 0.6.0 snapshot release using
git clone https://github.com/apache/incubator-zeppelin.git
cd incubator-zeppelin
mvn clean package -DskipTests
but I want to have R on Zeppelin. Supposedly, the 0.6.0 snapshot has two R interpreters, but when I run the R tutorial (the pre-made note that uses %r), I get this list of errors.
I followed several guides to try and install R as an interpreter, but each one resulted in some kind of error. I tried this instructional:
http://www.r-bloggers.com/interactive-data-science-with-r-in-apache-zeppelin-notebook/, and got a build failure on "R Interpreter". The error message was
"dependency 'evaluate' is not available for package 'rzeppelin'
* removing '/home/rebecca/Zeppelin-With-R/R/lib/rzeppelin'"
and then a bit lower down
Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (default) on project zeppelin-zrinterpreter: Command execution failed. Process exited with an error: 1
I also tried this Stack Overflow guide: Anyone tried to add R interpreter onto Apache Zeppelin?, and while I was able to run incubator-zeppelin, I received an error when I used either the %spark.r or %r interpreter tags, saying both "interpreter not found" and "prefix not found". Spark doesn't work either after following the first solution, getting the same error mentioned in the second solution (the jar file not being there), and then trying the second solution.
Does anyone have a guide for installing R onto the newest version of Zeppelin? I'm very flexible in the way I can install it. I can run other operating systems onto my computer, and I also have Virtual Box installed on my other computer, which is a mac.
There is currently a bug in the latest HEAD of zeppelin that was recently introduced and prevents the R interpreter from launching cleanly
Did anyone created a Zeppelin Jira Issue for that?
For me it is working on Zeppelin branch-0.6
build Zeppelin with r profile: -DskipTests -Prthis will...
create a directory 'R' in git repo root
copy the 'zeppelin-rinterpreter*.jar' into git_repo_root/interpreter/spark
build Zeppelin with build distro profile: e.g. -DskipTests -Pbuild-distr -Pspark-1.6 -Phadoop-2.6
use zeppelin-distribution/target/zeppelin*.tar.gz for installation
ensure both 1.1 and 1.2 are present in your zeppelin installation
The error you're getting is that you need to have the R package evaluate installed. You can install this simply by launching R and typing install.packages('evaluate').
That said, your excerpt mentions the directory Zeppelin-with-R. That's my repo, which is the R interpreter in the form when it was accepted into Zeppelin. That is version 0.5.6, not 0.6.0. There is currently a bug in the latest HEAD of zeppelin that was recently introduced and prevents the R interpreter from launching cleanly. Your best bet for now is to use the one from my repo and install clean, without trying to pull-in from Zeppelin HEAD.