Gmail Calendar Documents Reader Web more »
Recently Visited Groups | Help | Sign in
Google Groups Home
Discussions > Random chit-chat > Web crawl error.
There are currently too many topics in this group that display first. To make this topic appear first, remove this option from another topic.
There was an error processing your request. Please try again.
flag
  7 messages - Collapse all  -  Translate all to Translated (View all originals)
The group you are posting to is a Usenet group. Messages posted to this group will make your email address visible to anyone on the Internet.
Your reply message has not been sent.
Your post was successful
 
From:
To:
Cc:
Followup To:
Add Cc | Add Followup-to | Edit Subject
Subject:
Validation:
For verification purposes please type the characters you see in the picture below or the numbers you hear by clicking the accessibility icon. Listen and type the numbers you hear
 
geveN  
View profile  
 More options Nov 29 2008, 5:13 pm
From: geveN
Date: Fri, 28 Nov 2008 22:13:27 -0800 (PST)
Local: Sat, Nov 29 2008 5:13 pm
Subject: Web crawl error.
After posting a very topical issue in my blog http://geveandeveryotherthing.blogspot
com on the terrorist attack on Mumbai MUMBAI UNDER SIEGE!!! Mujaheedin
strike the commercial capital of India!    ..........after publishing
this on my blog  I went to "google search" and could not locate my
post in the hundreds of other posts on this topic..........search
words "Mumbai under siege"

This perplexed me because I have this far found/located all my posts
in google search by using the right key words.

I went to Google Webmasters Tools >>>>>>Overview>>>>>Top search
queries>>>>>web crawl errors>>>>

..............and found "URLs restricted by robots.txt"   and  the
details show:

URL restricted by robots.txt   detected on Nov 16th 2008 :
http://geveandeveryotherthing.blogspot.com/feedReaderJson

what is this URL?...........I have no idea........from the read up on
this matter I have not created  robots.txt file to restrict google
from crawling my site.

How do I get this set right? Please help

Geve


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
Phil Payne  
View profile  
 More options Nov 29 2008, 9:09 pm
From: Phil Payne
Date: Sat, 29 Nov 2008 02:09:58 -0800 (PST)
Local: Sat, Nov 29 2008 9:09 pm
Subject: Re: Web crawl error.

> URL restricted by robots.txt   detected on Nov 16th 2008 :
> http://geveandeveryotherthing.blogspot.com/feedReaderJson

> what is this URL?...........I have no idea........from the read up on
> this matter I have not created  robots.txt file to restrict google
> from crawling my site.

Your robots.txt file:

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Noindex: /feedReaderJson

Sitemap: http://geveandeveryotherthing.blogspot.com/feeds/posts/default?orderb...


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
webado  
View profile  
(1 user)  More options Nov 30 2008, 9:27 am
From: webado
Date: Sat, 29 Nov 2008 14:27:49 -0800 (PST)
Local: Sun, Nov 30 2008 9:27 am
Subject: Re: Web crawl error.
It's perfectly normal for those uris to be disallwoed, thsoe are feeds
that must not get indexed.

I see other pages on the web with chunks of content also found on your
homepage:
http://copyscape.com/view.php?o=41389&u=http%3A%2F%2Fwww.nationmaster...

It boils down to how unique your content is.

If you search for something actually unique to your site, you will
find it, like:
http://www.google.com/search?sourceid=navclient&ie=UTF-8&rlz=1T4GGLL_...

This too is found readily:
http://www.google.com/search?sourceid=navclient&ie=UTF-8&rlz=1T4GGLL_...

So I don't see any particular problem.

On Nov 29, 5:09 am, Phil Payne wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
geveN  
View profile  
 More options Dec 1 2008, 1:12 pm
From: geveN
Date: Sun, 30 Nov 2008 18:12:33 -0800 (PST)
Local: Mon, Dec 1 2008 1:12 pm
Subject: Re: Web crawl error.
Thank you Phil,
this robots.txt file User-agent: Mediapartners-Google
Disallow:               etc

you then provided a link:      Sitemap:http://
geveandeveryotherthing.blogspot.com/feeds/posts/default?orderb...

whats this supposed to mean.

I am sorry my computer literacy is not quite like yourself and others,
I am now 65 and more interested in blogging straightaway, sharing my
thoughts with all bloggers.

Geve

On Nov 29, 11:09 pm, Phil Payne wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
geveN  
View profile  
 More options Dec 1 2008, 1:19 pm
From: geveN
Date: Sun, 30 Nov 2008 18:19:32 -0800 (PST)
Local: Mon, Dec 1 2008 1:19 pm
Subject: Re: Web crawl error.
Many thanks webado,

dear webado, when one writes on verified and factual history, the
content is sure to be anything but unique; I hope I try to present it
in language my own, but the content will be the same as in other sites
because it contains the same facts.

I am a 65 year old keeping my mind sharp by blogging and at the same
time sharing my 45 years reading on history, places of interest, my
reactions to things happening around me..........so my blog.

thanks again webado, we all need your support, which ofcourse you do
give us.

Geve

On Nov 30, 11:27 am, webado wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
yorkyron  
View profile  
 More options Dec 1 2008, 5:14 pm
From: yorkyron
Date: Sun, 30 Nov 2008 22:14:09 -0800 (PST)
Local: Mon, Dec 1 2008 5:14 pm
Subject: Re: Web crawl error.
Hi There Geve you are a young pup still whelping i am 70 and these
guys are treeeemendous,
welcome to the group, sorry if you have been around a while but i have
not noticed you, this is a great forum for help and advice, and
socialising

On Dec 1, 2:19 am, geveN wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
geveN  
View profile  
 More options Dec 1 2008, 8:28 pm
From: geveN
Date: Mon, 1 Dec 2008 01:28:43 -0800 (PST)
Local: Mon, Dec 1 2008 8:28 pm
Subject: Re: Web crawl error.
Hi yorkyron,

yes, I guess I am a pup aged 65, I have been blogging since April of
last year...........not just treeeeemondous guys here but tremendous
scope in blogging ..........bring out all one's insides without the
need to "yell"........but when it comes to computer technicalities I
am a "sorry I can't sign, I can give a thumb impression"  hahahaha

please see my blog http://geveandeveryotherthing.blogspot.com

Geve

On Dec 1, 7:14 pm, yorkyron wrote:


    Forward  
You must Sign in before you can post messages.
To post a message you must first join this group.
Please update your nickname on the subscription settings page before posting.
You do not have the permission required to post.
End of messages
« Back to Discussions « Newer topic     Older topic »

Create a group - Google Groups - Google Home - Terms of Service - Privacy Policy
©2009 Google