Closed. This question needs to be more focused. It is not currently accepting answers.
Want to improve this question? Update the question so it focuses on one problem only by editing this post.
Closed 2 years ago.
Improve this question
I have a site where users can enter their profile and password-protect certain details. I would like search engines to crawl the 'unprotected' parts of the profile (which varies from user to user). Similar to how if you enter a user's name in facebook, their Facebook profile comes up in the search results. Do I have to do anything special to ensure that the bot doesn't crawl the password-protected sections, but still crawls the (always-public) username?
I'm not sure if this is even an issue, but I'd like to update my robots.txt to allow for this.
Also, how do I ensure that the usernames are available to the bots (in a safe manner)? Do I have to create a separate directory with a list of names, or is there a better way?
Thanks for any advice
The search engines will only index what an anonymous user sees. If you don't already, I would create a listing page to browse the user profiles in which you only show the data you want to. This ensures that a link exists for every userProfile.aspx?uid=XXXXXX you have. The search engine spiders will not be able to see any data that is behind a password protected.
I would also add a site map to ensure the search engine spiders get to the listing page. Don't assume that Google will magically find ALL of your pages though typically they do based on links to your content. Submit a site map to Google.
Edit regarding Site Maps and Search Results
In order for spiders to crawl search results, I would specify an entry in the site map that points spiders to the search results page that displays all (e.g. search.aspx?param=all).
You don't have to do anything. Search bots won't be able to access to your protected pages while they'll access without problems to the public content as long as you don't explicitly disallow it on robots.txt
Related
I apologize for posting a question that is not related to any specific issue, but this question will allow me to improve my understanding of the inner workings of content aggregators.
As far as I understand, Feedly, when a user enters a query, searches for the corresponding resource on the Internet (if it is searched for the first time, otherwise it most likely goes to the database), analyzes all pages of this site for RSS feeds and returns the result.
Is it so? If so, why is the analysis of all pages of the resource so fast? Or maybe such services somehow filter the pages of a certain site, giving preference to those that meet some criteria?
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
This question does not appear to be about programming within the scope defined in the help center.
Closed 1 year ago.
Improve this question
my client is sending a link to costumers across 3 countries with utm to track on google analytics. these links are send through linkedin, fb, twitter etc. something like this:
https://wwww.example.com/page?utm_source=linkedin_stem&utm_medium=cpc&utm_campaign=lk_stem_tkt
https://www.example.com/page?utm_source=facebook_stem&utm_medium=cpc&utm_campaign=fb_stem_tkt
however these links are not being tracked on analytics, i believe due to the language prefix being added as you enter the website, like this:
https://www.example.com/en/page
https://www.exemple.com/es/page
https://www.example.com/pt-pt/page
is there a way to track this utm's without mentioning the language prefix?
Analytics parses query parameters. It doesn't care about the path itself. However, in your examples with lang set, the utm params are missing.
So what I believe your issue is, is a trivial redirection from a url where the language is not set to a url where it's set. During the redirection, you lose your utm-params.
Most likely, the redirection kicks in before GTM has a chance to fire a pageview (utm-params have to be set just on one hit in a session), thus, the attribution is lost completely.
Now the best fix for it would be changing the redirection rule to pass query parameters to the destination url. It should be a trivial task for whoever set up the redirection in the first place. Presuming the redirection is backend-driven. There may be other fixes for GTM, but they are out of scope.
Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 10 years ago.
Improve this question
I've wanted to apply google analytics on my music page at www.soundclick.com/bands/default.cfm?bandid=976533
But I am unable to use that URL as my default on analytics because it contains a query.
I have a Domain URL at www.SilentNoizeMusic.com that forwards to the above address, but I'm questioning if using the www.SilentNoizeMusic.com url as my default on Analytics will actually track the stats for the real site.
Are my suspicions correct?
If so, is there any sort of workaround, like a modification to the original URL that could bypass the query error but still direct to the same page to be tracked?
(as a side note, I'm not sure how relevant it would be to any potential answers, but the music hosting site I'm using does not allow javascript, which is what initially prevented my from using analytics since I couldn't paste the tracking code. I have found a workaround that I want to test out, but I just need to fix the above problem in order to do so.)
Thanks
If you are using domain forwarding provided by your DNS server, then no, Google Analytics won't be able to track stats of visitors who reach your soundclick.com page via your SilentNoizeMusic.com URL.
Some DNS providers offer a "domain cloaking" option, which makes the destination page appear in the browser at your SilentNoizeMusic.com URL. All this is doing is returning an HTML page containing an iframe that loads the destination page. Cloaking is a terrible hack and not very reliable, since any link clicked on in the destination page (inside the iframe) will cause the browser to navigate to the destination page anyway.
Another approach might be to try to embed a trackable item in the destination page. You said that soundclick.com doesn't allow you to embed javascript; do they allow you to embed HTML?
Option 1: See if you can embed an iframe in the html of your soundclick.com page. Point the iframe to an html page on some other web server that you have control of, and put your javascript and google analytics stub in there. The javascript won't violate the 'no javascript' mandate of soundclick.com, because it won't be executing in the context of soundclick.com - it will be sequestered inside the iframe. The iframe doesn't even have to be large enough to show on your soundclick.com page. Just having it there will be enough to get the sequestered page to load, and that's all that Google Analytics really needs. You won't get any stats about what the user is doing on the soundclick.com page, and you won't get any referal data (what sites contain a link to yours that users clicked on to get to your site) but you should get full stats about number of visitors, new vs returning, etc.
Option 2: If soundclick.com doesn't allow you to put an iframe HTML element on your page, will they allow you to reference an image on another server? Again, set up an image file (preferably small) on a server you have control of and place an link on the soundclick.com page referencing the image on the other server. You can then collect request stats on the image file, which will give you some small degree of traffic measurement. This is what the old-school hit counters did, basically.
Closed. This question is off-topic. It is not currently accepting answers.
Want to improve this question? Update the question so it's on-topic for Stack Overflow.
Closed 9 years ago.
Improve this question
I have studied most of the posts concerning web page being viewed in an iframe here but I was wondering if this can hurt the SEO of the framed site! I own a niece blog, lets call it mynieceblog.com and I recently found out that my web content, mynieceblog.com/mypostname.html, is viewed in an iframe by a site acting like a blog aggregator. A toolbar exists on top (has a closing button) and the url looks like aggregator.com/content/myposttitle.html The visitor can view my entire site content through this iframe and has the opportunity to visit relevant posts of other aggregated blogs. Here are my questions:
a. When a user visits mynieceblog.com/mypostname.html who gets to see visits/impressions on his google analytics?
b. Do I get incoming links from aggregator.com? Could this be possible only if the user closes down the toolbar?
c. Does this hurt the ranking of mynieceblog.com since I both see mynieceblog.com/mypostname.html and aggregator.com/content/myposttitle.html in search engine results for some keywords?
The view of my blog content through this aggregator does not hurt my site reputation. I have read that bandwidth use is an issue too! I am more concerned about my rankings and page views.
It can't harm you and probably gives you some credit. You found it yourself so it's getting traffic.
Your own Google Analytics code will be run so you will see the visitors. You can actually tell who is framing your website via the Hostname parameter in Google Analytics. Hostname seems to get set to the domain shown in the address bar.
Google does see the link but how much ranking you get from that is unknown. Somewhere between 0 and 100%! I have recently read a test where someone believed some framed content was indexed.
It cannot hurt your ranking. Worst case is that it ranks higher for a keyword so Google presents their page for you instead of yours directly.
If you're really worried about it then you could implement some JavaScript code to make your page break out of the frame. Something like this:
if (top.location != location) {
top.location.href = document.location.href;
}
If your viewer views your website through aggregator.com then surely i wont help you for SEO. For good SEO viewers needs to visit your site directly from aggregator.com
It's not a question of hurting your site reputation - it won't; however, will it benefit your site? I'm unsure, but if you get any benefit, I imagine it would be less than if your site was access directly.
As this article suggests, the SEs may be able to spider your content through the aggregator, but the aggregator won't gain from your content (framed content is rightly considered to be outside the site), and given the dynamic architecture of many aggregators, you may also not gain much/anything.
I would imagine that the you could consider exposure of your site through an aggregator could be considered an in-bound link, but it is unclear whether SEs would agree.
Closed. This question does not meet Stack Overflow guidelines. It is not currently accepting answers.
Questions asking for code must demonstrate a minimal understanding of the problem being solved. Include attempted solutions, why they didn't work, and the expected results. See also: Stack Overflow question checklist
Closed 9 years ago.
Improve this question
I want to make stats for my website. One thing I want to do is to know how many people bookmark my website. What's the best way to do that without a survey?
There is no way to tell.
A proportion of people who arrive at the page without sending referer information will have bookmarked it — but they might also have come from a link in an email, typed the URL, dragged it from their history, turned referers off, etc, etc,etc.
Your best bet is to have a Javascript "Bookmark us" link that bookmarks the site and makes an AJAX call to a backend script to store info about a new bookmark in your db. This won't catch people who bookmark your site directly using their browser, but it will give you some idea about the stickiness of your site.
As David said there's no way to tell how many people bookmark it in their browser.
But I do all my bookmarking with Delicious.com, so you could look at getting some sorts of stats from the various third party bookmarking sites.
It's not 100% accurate but you can try putting a cookie when they first arrive to your site. If a request is made with that cookie and no referrer information in the Request object, than you can assume that the user has added your site into bookmarks (a very optimistic assumption but the worst case is that the user is loyal enough to visit your page directly typing the url which is as good as adding to the bookmarks I believe...)
I think the answers given are over complicated. Just use Addthis.com. It gives you an analytical report that shows you have many people bookmarked the link.
You can put a link which add your website in user's bookmark, and notify you that someone added your site to his bookmark.
You can also monitor numbers of people that come directly to your website, that usually means they have you in their bookmarks, or better, that they know your site's name so well that they just type it.
Edit : Using google analytics, you can have a good overview of the proprotion and number of people comming "directly" on your website.
No other way i think, except polls
This is not useful information. Bookmarking is meaningless in isolation. I currently have hundreds of bookmarks, most of them for articles that I tagged as "looks interesting, but I don't have time/energy to read and understand it right now, so I should come back later"... and then never got around to going back to. On the other hand, I have about a dozen bookmarks that I visit daily. Even if you knew I had your site bookmarked, you wouldn't know which group you're in (but it's overwhelmingly likely that you'd be in the "never used" bookmark pile).
The only way to determine which category you're in is to count actual visits to your site. This also has the added advantage of telling you about people who subscribe to RSS feeds, which are at least as "sticky" as bookmarks, regardless of whether or not they bookmark in addition to subscribing.
It sounds like the actual information you want may be how many "loyal" visitors you have - people who keep coming back. Counting bookmarks won't tell you that. Counting visits, along with some simple cookie and/or IP address based code to identify repeat visitors, will. If you don't want to write the code to manage that visit tracking yourself (and there probably isn't any reason why you should), you can get it free and easy from Google Analytics.