Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
How would one find out if it's even possible on specific site?
For example https://forums.eveonline.com/default.aspx?g=topics&f=257
There are many more sites where I wanted to display more results per page but option is not available.
Without knowledge of the code base, there is no way to know whether you can change the page behavior via a URL parameter, other than trial and error.
If the site is well designed, all URL parameters ought to be validated against a white list, so it should not be possible to hack the URL. So you should not rely on this.
I know that this is not answering the real question and i know that John Wu is right: You can't obtain this via querystring if you don't know if this is coded server side. What i think is that there is always a way:
For example, in this case you can use rss feed (the button placed at the bottom of the page):
https://forums.eveonline.com/default.aspx?g=rsstopic&pg=Topics&f=257
Related
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 6 years ago.
Improve this question
i want to crawl every pages from the same head url
ex:"http://www.htc.com/tw/XXXXXXX"
Hanv any way to do?
thanks.
That won't work since most web servers have directory listing disabled.
There is no way to crawl every page. However, you can crawl every sub page which is linked on the main page. You could for example create an array of all links found on that site, and filter those with the same domain name. But this won't find directory's which aren't linked anywhere.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 4 years ago.
Improve this question
Is it possible to scrape data automatically from websites that require a validation code each time a webpage is accessed? Such as the case when the website shows you a picture of the code and asks you to enter what is shown in the picture. I'm using the rvest package. Is this possible to do?
What you're trying to do is beat CAPTCHAs. That's possible but very hard. This is a spammer's hardest job - to come up with an algorithm smart enough to fill out those fields correctly. It's not something you're supposed to do, the whole point of those validation codes is to prevent access from non-humans. If you're smart and motivated enough to figure out how to answer those questions programatically, you can probably make more money doing that than whatever you're trying to do :)
Some websites offer a direct API, which is the way you're supposed to interact with their data. But getting past a CAPTCHA by scraping is not an easy deed.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 7 years ago.
Improve this question
I don't know what I did but suddenly all my pages have a duplicate pages with the extension /google.com/+cormilubr (which is my website's google+ page).
I used screaming frog and it's showing me over 50 404 errors. Below an extract of screaming frog seo. You'll see all pages with 404 errors. They also exist without the extension and are code 200.
My website is http://cormilu.com.br
this is one of the duplicate urls that have appeared:
http://cormilu.com.br/google.com/+CormiluBr
Does anybody have an idea how this could have come upon so I can resolve it? I've deactivated all plugins , so this doesn't have anything to do with it. Pointing me in the right direction would be awesome!
Thanks a lot for you help.
Best regards,
Amir
Well in the footer of the website you have list of all your social networks. In the source of google plus link, you have added something like
google.com/+CormiluBr
Replace this with the exact url (with http://)
http://google.com/+CormiluBr
Here is the image with the link
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 7 years ago.
Improve this question
I've got three home pages:
1. home
2. home-student
3. home-teacher
Based on their custom user role (student, teacher or not logged in) I would like to show a different homepage. My knowledge of PHP is pretty basic, so I'm hoping for an easy answer (or line of code I could paste in my child theme). Many thanks!
Since you do not have a lot of php experience, you may want to use a plugin like this one
https://wordpress.org/plugins/user-specific-content/
You can then use shortcodes in your homepage content to designate who see what. Like...
[O_U user_id="1"]Content goes here[/O_U]
There are other methods, but they would require hacking the page.php template. As long as you're not trying to have the header and footer look different, the plugin should late you have different page content for different roles.
Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 9 years ago.
Improve this question
I want to display different messages from a database in rows of divs, it's for a portion of the site where people will be able to share stories. I want it to look like rows of post-it notes with the stories on them, then if they want to read more they can click on one and it goes to a detailed view of it. It's an ASP.net application, so I've been using VB for a lot of the other stuff.
It's a pretty simple database, with two-three fields (PK, Story, name) and I think it will use a page load event. Just not sure how to access the data. Previously I dealt with displaying grids and rows, but now I want something more organic.
I'm not an ASP guy, but the question seems a little vague. When pulling the data, you'll want to truncate the info from the database for the front page and then link to a full page with all of the info from that post.
For the display, you could use the help of the jQuery masonry plugin.