I want to do web scraping on linux server. But linux servers don't have GUI and browser. They have only got a black screen i.e terminal. Recently I prepared a selenium script on windows using python and chromedriver which messages your friends on whatsapp. I want to deploy it on linux server. It won't run there, right? So, how is it done?
You can run Chrome/Firefox with option --headlessand it will run without displaying window so it will no need XWindow (GUI). It is called headless web browser. (And server without monitor is called headless server)
Selenium can use webdriver PhantomJS (instead of Chrome/Firefox) which doesn't display window (probably it uses WebKit/Qt). But this driver is not developed any more.
Linux can also use Xfbv to create fake/virtual monitor and run programs which need XWindow.
Related
How do i achieve below using robot framework. SSHLibrary is not of any help
Using Remote Desktop, log into the web server. Using Windows Explorer navigate to the /folder1 for the web (for instance, \abc\W\india\1.exe). Doubleclick on the executable file: 1.exe
Is it even possible ?
Using Microsoft SysInternals PsExec you can open a terminal session to a windows box and execute commands like you would normally.
I would write a batch or powershell script that does what you want, and then write a robot framework keyword that calls that batch or powershell script.
The preceding answers by Bryan Oakley and A. Kootstra are what I would go for.
If you specifically need to interact with a Windows GUI application, you might want to try the Robot Framework AutoIT Library. AutoIT works pretty well for Windows GUI apps and is a whole language (BASIC-style) to itself. Otherwise, if it can be done via command-line, I'd go with one of their answers.
I believe, besides robot framework. SSHLibrary you need to install a SSH server in the remote windows machine https://serverfault.com/questions/8411/what-is-a-good-ssh-server-to-use-on-windows
hope that helps
I am aware that I can use RStudio server on my remote machine, and connect to that via a web browser on my client machine.
However, I would prefer not to use my web browser. Is it possible to set up RStudio Desktop to connect to the RStudio Server?
Many thanks
There is an alternative: create Rstudio Server webapp.
This is how I did it:
Login to the rstudio server from the browser using serverip:8787
On the menu bar, go to File (or Tools in some cases) -> Create application shortcut. This dialogue box will appear:
Rstudio shortcut
Add it to your desktop by selecting and run it as if you're running rstudio desktop version.
Rstudio webapp screenshot
I am transitioning my debian setup into one where all debian-repository external apps run in dedicated docker containers.
In this context rstudio, of which I am a heavy user, has me puzzled ... does anybody have insight into whether it's possible to run it as a client to remote R installation?
What is a very cool feature of RStudio is RStudio Server. You install RStudio Server on you Ubuntu server and log in to a specific port where RStudio Server is running. You then get your full RStudio interface in your web browser. This allows you to run all your R analyses from any computer that has a modern browser and an internet connection.
R then runs on the remote server, asking almost no resource from the computer you are connecting from.
I want to now what is the easiest way to deploy asp.net site to a windows server? Normally we do by uploading files through FTP client.
But as we can checkout repository on linux server and just running "svn up" command though SSH deploys the latest changes, is there any similar way on windows?
Thanks
Web deployment tool is what I use. It can be automated from the command line, and MSBuild can be used to generate deployment packages if you use a CI server. On the simplest level though it supports 1 click deploy from the toolbar in Visual Studio (probably only recommended to development servers).
You can do nearly the same thing on Windows.
Use Remote Desktop Connection to
access the server (this is the
windows counterpart of SSH)
Run "svn
up"
An SVN client doesn't ship with Windows, but the client ports from SilkSVN and CollabNet work just as well as any other.
No, no, I'm not getting hives ;).
I am able to run a local version of my .NET 3.5 site on IIS and troubleshoot whilst I develop. However, my flash developer is forced to log onto our Windows 2003 and mess with our staging server when he wants to see how his work is doing. This is unacceptable, I understand, but right now there are time concerns so this hack is going to have to fly for a little.
How do I set up a dev environment for my flash developer to be able to work on his local machine? I'm sure this gets done in other places.
VMWare Fusion or Parallels, or give him a virtual machine/PC that he can Remote Desktop to from his Mac.
Not to sound the fool, but isn't Flash not platform dependent? Is the flash developer doing anything more complex than connecting to a remote client to update an .swf file? You don't "need" to be running windows/iis to copy a file from mac to windows. You might try the Remote Desktop client:
http://www.microsoft.com/mac/products/remote-desktop/default.mspx
or set up an FTP account (on the staging server in question?) for him. I agree with the above about using Parallels or VMWare. It's not necessarily a "hack" or "workaround" that you can use and test on multiple platforms. It's a huge plus! As a user of VMWare and ex-parallels user, I recommend VMWare. It takes about as long as "installing windows" to be up and running on a mac, and the resources from your Mac can be available via a "documents" on the desktop (or other) if you so choose.
What kind of Mac is it? The Intel ones can run Windows natively.
Dual boot Windows on his Mac with Boot Camp?
Setup IIS in a VMWare Fusion virtual machine. Do a simplified install of Windows XP and it should run excellent.
That way you can interface with the IIS Server from Mac OS X or from other PC's from anywhere on the local network for that matter.
I use Vmware Fusion to run subversion and Apache servers and it runs beautifully.
well an alternative is the Q Emulator
What is the actual problem? As I see it, Flash dev. makes a Flash movie, and tests it locally, if it needs to communicate with the server, it does just that. If the Flash dev. wants to see it in a page, or see how it communicates with the surrounding HTML and Javascript, he uploads the file to the server using a ordinary windows share (aka Samba-share) or FTP or whathaveyou and then presto, it works.
I've just discovered http://www.virtualbox.org">VirtualBox which is a free alternative to Parallels and Bootcamp. I'm running Windows XP pro on my MacBook no problem at all - note it's for Intel Macs only though.