Disallow Search Engines in Robots.txt File? No Worries on Google

Here’s a first. Well, actually I’m not surprised when it comes to Google, but this is the first time I have seen a website disallow the search engines from indexing their website. But the website still ranks number one in Google for their primary keyword phrase.

Take a look at this screen capture, for a search query “Dallas Dental Clinics”. Granted it doesn’t have a huge search volume every month, but it is a major city (Dallas, Texas) and there are a lot of dental clinics competing in the market.

Yep, leave it up to Google to give you a number one ranking even if you purposely are stopping the search engines from indexing your website. Google doesn’t seem to care, they will rank your website number one in the search results whether you like it or not.

I have seen all sorts of crazy search results in the past, but this one certainly takes the cake for me. A website has a robots.txt file directive for the search engines to NOT index their website. And Google actually shows that they know about that directive NOT to index the website.

Let’s take a look at the robots.txt file, here is what it says:
User-agent: *
Disallow: /

Even though this says to the search engines: DO NOT index my website, Google doesn’t care, they index the website, and rank it number one in the search results.

Makes sense to me, what about you?!?