I have found ways to do this in python by starting a chrome debugger browser and using --remote-debugging-port such as this answer here. But I have not found any solutions for this using RSelenium. Does anyone know if this is possible using RSelenium?
Related
I need to scrape content and sniff network activity from an asynchronous web page using R.
The problem is that in my team we work both on Mac and Windows machines on a project directory shared via github.
This creates quite some problem in using external headless browsers via RSelenium (mac/windows path differences, different locations of executables, dynamic number of collaborators).
So an ideal solution would be to use some simple headless browser written directly in R and installed as a package, so that we don't have to take care of OS support, location, etc...
Does such a package exist?
Looks like there are now solutions to do this through packages like https://github.com/rstudio/chromote or https://github.com/RLesur/crrri without installing any headless browser since recently Chrome exposes an API for interacting with it.
For those of you that have tried using Resurrectio have probably noticed that it hardly works. Has anybody forked this project or can suggest an alternative to recording browser behavior and exporting it as casper.js? Or something similar to this?
I am using PhantomJS version 1.9.8 and CasperJS version 1.1.0-beta3. I am open to using different version of Phantom and Casper if I have to.
If anyone can suggest a different tool (javascript based) for web scraping, that would be great too.
Thanks in advance!
I have a windows machine. I use R shiny (R 3.0.1 and Shiny 0.10.2.1) to share some apps with others on the same network.
Just running an app using runApp("some_app") works fine on chrome/IE10 but not of much use because others on the network can't access it. When I run using: runApp("some_app", host="XX.XXX.XX.XXX", port=3456), others can access the page but can't see any reactive output only on IE10.
Any idea what would be the problem with reactive output on IE10 when I use my computer's ip while it works okay on chrome?
Many Thanks
Pradeep
I'm not an expert, but my impression is that a lot of things don't work in IE, especially things that are new / cool.
A quick google search provided some helpful links, especially this one on shiny's google group.
If people really can't use Chrome or Firefox, I would consider having people connect to a remote server that does have Chrome installed.
I found this package on Ruby http://sup.rubyforge.org/
Wonder if there is something similar to run on Windows without all these Ruby packages.. ?
There is. You can use Command line tools for the Google Data APIs( http://code.google.com/p/googlecl/) There is also extensive documentation attached, of examples and best usages.
It supports Gmail, Picasa etc. and allows you to do most of the things thought console statements.
You could try finding a command line IMAP client. I did a quick Google search and got some hits but I don't have any experience using them. I recommend you look into that. Seeing as gmail supports IMAP and POP3, you probably don't need a specialized gmail client.
Just search for: Windows IMAP command line client
I'm using Chrome 5.0.375.86. Can anyone point me to a working example of an HTML page communicating (or at least establishing a handshake) in Chrome with a C# (faux) web server?
The current version of WebSockets in hixons-76 (or whatever) and not -75. What does production Chrome currently support? I think it's -75. Do I need the nightly build for -76?
This is also a nice example (The author says it should work with -76)
http://nugget.codeplex.com/
Heres a Related Question on SO, Should help you to get started
Maybe you will find useful my demo http://programistka.com/en/websockets-c/ which uses two open source libraries - one for server and one for client. In my opinion it is really worth to check them.