• About
    • History of Dallas SEO
    • SEO Expert Witness Service
  • Contact
  • Topics
    • Bing
    • Blogging
    • Branding
    • Domain Names
    • Google
    • Internet Marketing
    • Link Building
    • Local Search
    • Marketing
    • Public Relations
    • Reputation Management
    • Search Engine Marketing
    • Search Engine Optimization
    • Search Engines
    • Social Media
    • Tech
  • Advertise
  • Email Newsletter

Bill Hartzer

Bill Hartzer on Search, Marketing, Tech, and Domains.

traffic analysis tools

Home » Google » Disallow Search Engines in Robots.txt File? No Worries on Google

Disallow Search Engines in Robots.txt File? No Worries on Google

Posted By Bill Hartzer on January 3, 2014at 10:38 am

Here’s a first. Well, actually I’m not surprised when it comes to Google, but this is the first time I have seen a website disallow the search engines from indexing their website. But the website still ranks number one in Google for their primary keyword phrase.

Take a look at this screen capture, for a search query “Dallas Dental Clinics”. Granted it doesn’t have a huge search volume every month, but it is a major city (Dallas, Texas) and there are a lot of dental clinics competing in the market.

dallas dental clinics search

Yep, leave it up to Google to give you a number one ranking even if you purposely are stopping the search engines from indexing your website. Google doesn’t seem to care, they will rank your website number one in the search results whether you like it or not.

I have seen all sorts of crazy search results in the past, but this one certainly takes the cake for me. A website has a robots.txt file directive for the search engines to NOT index their website. And Google actually shows that they know about that directive NOT to index the website.

Let’s take a look at the robots.txt file, here is what it says:
User-agent: *
Disallow: /

Even though this says to the search engines: DO NOT index my website, Google doesn’t care, they index the website, and rank it number one in the search results.

Makes sense to me, what about you?!?

Filed Under: Google, Search Engines

traffic analysis tools

Listen to "Digital Marketing with Bill Hartzer" on Spreaker.

About Bill Hartzer

Bill Hartzer is CEO of Hartzer Consulting, LLC, an SEO Consulting firm that includes services such as search engine optimization, technical SEO audits, domain name consulting, and online reputation management.

Recent Posts

  • Andrew Muller on Testing Google Ads Using Facebook Ads January 15, 2021
  • Mike Rhodes from Web Savvy On Google Ads January 8, 2021
  • How to Opt Out of Google Analytics December 16, 2020
  • Majestic Just Changed SEO and Linking Forever December 15, 2020
  • Yext Consumer Search Trend Predictions for 2020 December 8, 2020
  • SearchBox Launches SearchAI SmartSuggest, SearchAI Answers and SearchAI Personalization December 7, 2020
  • Google Poly is Shutting Down December 2, 2020
  • Domain Name Brokers Put FFF.com and HHH.com Domains Up for Sale December 1, 2020
  • Google Webmaster Tools Moves Twitter Account November 11, 2020
  • Email Deliverability, Setting Up DMARC, DKIM, and SPF on Your Domain October 29, 2020
  • The Bing Search Engine is Now Microsoft Bing October 6, 2020
  • Beck Power on Building Authority on Social Media and Repurposing Content October 2, 2020
  • Naira Perez on Paid Media, and an Intro to Social Paid Media, and Audiences September 17, 2020
  • Fake Birth Date Used on Google and Apple Accounts Is on Credit Report August 17, 2020
  • What is Bill Hartzer Disease? July 20, 2020
  • Web Host Agents Sending Fake Invoices for Website Hosting July 17, 2020
  • Duane Forrester On Search Intent and Internal Site Search July 9, 2020
  • Google Loses Blogspot.In Domain Name July 8, 2020
  • Peter Leshaw on In-House Digital Marketing and Dashboards for Reporting July 2, 2020
  • Mark Traphagen on Schema, Schema Tools, and On Page SEO Tools June 29, 2020

DFWSEM logo

Bill Hartzer is a Brand Ambassador for:



Industry Friends

WTFSEO
SEO By the Sea
Jeff Lenney
Jeff Gabriel
Phil Drinkwater
Dixon Jones

Connect With Bill Hartzer

Bill Hartzer on Twitter
Bill Hartzer on Instagram
Hartzer Consulting on Facebook
Bill Hartzer on Facebook
Bill Hartzer on YouTube

Categories

  • Advertising (19)
  • Bing Search Engine (6)
  • Blogging (42)
  • Branding (12)
  • Domain Names (197)
  • Google (228)
  • Internet Marketing (24)
  • Internet Usage (84)
  • Link Building (52)
  • Local Search (38)
  • Marketing (176)
  • Marketing Foo (30)
  • Pay Per Click (1)
  • Podcast (8)
  • Public Relations (8)
  • Reputation Management (9)
  • Search Engine Marketing (44)
  • Search Engine Marketing Events (47)
  • Search Engine Marketing Firms (19)
  • Search Engine Marketing Jobs (33)
  • Search Engine Optimization (156)
  • Search Engines (202)
  • Social Media (187)
  • Tech (7)
  • Web Analytics (16)




Note: All product names, logos, and brands are property of their respective owners. All company, product and service names used in this website are for identification purposes only, and are mentioned only to help my readers. All other trademarks cited herein are the property of their respective owners. Use of these names, logos, and brands does not imply endorsement.




Hartzer Consulting



Website, Content, and Marketing by Hartzer Consulting, LLC.

Copyright © 2021 by Bill Hartzer and Hartzer Consulting, LLC.

Disclaimer - Privacy Policy - Terms of Use
Go to mobile version