How to scrape data off websites that require validation code? [closed] - r

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 4 years ago.
Improve this question
Is it possible to scrape data automatically from websites that require a validation code each time a webpage is accessed? Such as the case when the website shows you a picture of the code and asks you to enter what is shown in the picture. I'm using the rvest package. Is this possible to do?

What you're trying to do is beat CAPTCHAs. That's possible but very hard. This is a spammer's hardest job - to come up with an algorithm smart enough to fill out those fields correctly. It's not something you're supposed to do, the whole point of those validation codes is to prevent access from non-humans. If you're smart and motivated enough to figure out how to answer those questions programatically, you can probably make more money doing that than whatever you're trying to do :)
Some websites offer a direct API, which is the way you're supposed to interact with their data. But getting past a CAPTCHA by scraping is not an easy deed.

Related

How to show up feed along with promoted posts? [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 2 years ago.
Improve this question
I was trying to make an Instagram-like app with Flutter. I which users can promote their for some amount, and once the promotion is done I'll add the post id into the promoted posts database.
Now, I want to focus on natural posts (I mean posts of user's 'following list') so I used a StreamBuilder to listen to the friends' collection.
Meanwhile, I also wanted to mix the content with promoted posts. Seriously, can't find a solution.
Any idea about implementing this? This will be a great help for me.
The promoted posts' collection would be of a large space, so I'm kinda worried about retrieving all documents in the collection at once and showing it up.
Let me know your thoughts :)
I am not clear of your question but still what I can say is,
If you want to mix both of the posts, then just add data from both stream builders to a list. Its like list.addAll(data)
Another thing is, you are worried about large data load. You can load/fetch data on scroll. You can find tutorials by searching lazy loading, infinite scrolling etc.
Let me know if you got it!

Convenient way to navigate throught views on uno-platform [closed]

Closed. This question is opinion-based. It is not currently accepting answers.
Want to improve this question? Update the question so it can be answered with facts and citations by editing this post.
Closed 2 years ago.
Improve this question
I am very new to UnoPlatform. I am trying to create a new application. Yet for some time I am stuck at creating convenient way to navigate through views.
I searched through webs and forums. I found that the best design pattern would be MVVM. Demo Apps on platform.uno seems to be implemented using this pattern as well. However some approaches i found online are not possible with unoplatform, as far as I understand it.
To give an example:
The app starts at LoginPage. On successful login I want to be taken to a completely different view with different controls. One of the approaches I found is by holding currently active viewmodel and render pages accordingly.
Is there some approach you would recommend for navigating through views? Or some material I could read to understand this concept better?
Using MVVM Light, the navigation needs to be performed using the NavigationService, as you'll find in this documentation: http://www.mvvmlight.net/doc/nav5.cshtml.
You can also use Prism for Uno, which handles navigation per regions. You can find documentation here https://prismlibrary.com/docs/ and samples here: https://github.com/PrismLibrary/Prism/blob/c71957ad56c0cfedf479d46dcb1870c96232d86c/e2e/Uno/HelloUnoWorld.Shared/ViewModels/ShellViewModel.cs#L30

modifying url to display more results per page [closed]

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
How would one find out if it's even possible on specific site?
For example https://forums.eveonline.com/default.aspx?g=topics&f=257
There are many more sites where I wanted to display more results per page but option is not available.
Without knowledge of the code base, there is no way to know whether you can change the page behavior via a URL parameter, other than trial and error.
If the site is well designed, all URL parameters ought to be validated against a white list, so it should not be possible to hack the URL. So you should not rely on this.
I know that this is not answering the real question and i know that John Wu is right: You can't obtain this via querystring if you don't know if this is coded server side. What i think is that there is always a way:
For example, in this case you can use rss feed (the button placed at the bottom of the page):
https://forums.eveonline.com/default.aspx?g=rsstopic&pg=Topics&f=257

Displaying Database info in rows of boxes/divs [closed]

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 9 years ago.
Improve this question
I want to display different messages from a database in rows of divs, it's for a portion of the site where people will be able to share stories. I want it to look like rows of post-it notes with the stories on them, then if they want to read more they can click on one and it goes to a detailed view of it. It's an ASP.net application, so I've been using VB for a lot of the other stuff.
It's a pretty simple database, with two-three fields (PK, Story, name) and I think it will use a page load event. Just not sure how to access the data. Previously I dealt with displaying grids and rows, but now I want something more organic.
I'm not an ASP guy, but the question seems a little vague. When pulling the data, you'll want to truncate the info from the database for the front page and then link to a full page with all of the info from that post.
For the display, you could use the help of the jQuery masonry plugin.

How can one protect from malicious code inside a website? [closed]

Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 8 years ago.
Improve this question
I have recently taken ownership of an Wordpress website, after having a long dispute with the previous developer.
Because of this, I want to make sure that he didn't left some malicious code inside - to steal passwords, change things in the database, remove files ....
So the question is that instead of checking each file inside (Wordpress core, plugins, and so on) - what other possibilities I have to make sure that there is no threat? How can one protect himself from an inside attack?
I know that this can be difficult to answer, but maybe you have some past experience with this kind of situations...
If it's a stock installation of Wordpress, you can use "diff" or a similar file-comparison tool to compare your installation against the official distribution to see what changes, if any, have been made.
After you've done that and made sure you understand the purpose of any changes, you'll need to go over the configuration, account settings, and the like to make sure there aren't any backdoors or other security holes deliberately left behind.
Unfortunately the only definitive safe answer I can offer is a fresh install, followed by a copy of TEXT content into the new site. Non-text-content items you want to retain will need to be either rewritten or thoroughly vetted.

Resources