• About
    • History of Dallas SEO
  • Contact
  • Topics
    • Bing
    • Blogging
    • Branding
    • Domain Names
    • Google
    • Internet Marketing
    • Link Building
    • Local Search
    • Marketing
    • Public Relations
    • Reputation Management
    • Search Engine Marketing
    • Search Engine Optimization
    • Search Engines
    • Social Media
  • Tech
  • Advertise
  • Services
    • Search Engine Optimization
    • Ongoing SEO Services
    • SEO Expert Witness
    • Google Penalty Recovery
    • Mini SEO Audit
    • Link Audit
    • Keyword Research
    • Combine Websites SEO Services
    • PPC Management
    • Online Reputation Management
    • Domain Name Consultant
    • Domain Names & Expired Domains
    • Domain Name Appraisal

Bill Hartzer

..
Home » Google » Disallow Search Engines in Robots.txt File? No Worries on Google

Disallow Search Engines in Robots.txt File? No Worries on Google

Posted on January 3, 2014 Written by Bill Hartzer

Here’s a first. Well, actually I’m not surprised when it comes to Google, but this is the first time I have seen a website disallow the search engines from indexing their website. But the website still ranks number one in Google for their primary keyword phrase.

Take a look at this screen capture, for a search query “Dallas Dental Clinics”. Granted it doesn’t have a huge search volume every month, but it is a major city (Dallas, Texas) and there are a lot of dental clinics competing in the market.

dallas dental clinics search

Yep, leave it up to Google to give you a number one ranking even if you purposely are stopping the search engines from indexing your website. Google doesn’t seem to care, they will rank your website number one in the search results whether you like it or not.

I have seen all sorts of crazy search results in the past, but this one certainly takes the cake for me. A website has a robots.txt file directive for the search engines to NOT index their website. And Google actually shows that they know about that directive NOT to index the website.

Let’s take a look at the robots.txt file, here is what it says:
User-agent: *
Disallow: /

Even though this says to the search engines: DO NOT index my website, Google doesn’t care, they index the website, and rank it number one in the search results.

Makes sense to me, what about you?!?

Related Posts

  • Hackers Hijack Google Results: Bybit Exposes AI-Powered macOS Malware Targeting Claude Code Searches
  • Brandpoint: 60% of Google Searches End Without Clicks
  • RyghtSites.com Launches: The Free AI Search Engine That Could Fix Clinical Trial Delays Overnight
  • The Mystery of “Bill Hartzer Disease”: A Deep Dive into Google Autosuggest Anomalies
  • Google’s New Discover Update Is Live

Filed Under: Google, Search Engines

About Bill Hartzer

Bill Hartzer is the CEO of Hartzer Consulting and founder of DNAccess, a domain name protection and recovery service. A recognized authority in digital marketing and domain name strategy, Bill is frequently called upon as an Expert Witness in internet-related legal cases. He's been sharing his insights, expertise, and research here on BillHartzer.com for over two decades.

Bill Hartzer on Search, Marketing, Tech, and Domains.

Hartzer Domains

DFWSEM logo

 

 

Brand Ambassador for:

Majestic logo

Oncrawl logo

Industry Friends

  • David Daniels
  • WTFSEO
  • SEO By the Sea
  • Jeff Lenney
  • Jeff Gabriel
  • Scott Hendison
  • Dixon Jones
  • Brian Hartzer
  • Navah Hopkins
  • DNAccess
  • Hartzer on IT.com
  • Jason Olson

Connect With Bill Hartzer

  • Bill Hartzer on X
  • Bill Hartzer on BlueSky
  • Bill Hartzer on Instagram
  • Hartzer Consulting on Facebook
  • Bill Hartzer on Facebook
  • Bill Hartzer on YouTube

Recent Posts

  • Why Google Says 77% of My SearchEngines.net Traffic Is Branded
  • Paid Search Gets a Second Act: fullthrottle.ai Turns Search and Social Clicks Into Household Audiences
  • The Reputation Engagement I Would Rather Have Than the Friday Afternoon One
  • A Judge Ordered an Expert’s AI Prompts Produced. There Is Still No Standard, So I Wrote One
  • Facebook Says an Account Called “Meta Verrified” Sending Phishing Messages Doesn’t Violate Its Rules
  • I Read 30 Digital Marketing Tool Licenses. Most Do Not Say What You Think.
  • 131 SEO Experts Just Ranked Google’s Ranking Factors. Backlinks Did Not Die.
  • AI Local Business Recommendations Went From 6% To 45% In A Year. The Bigger Number Is 88%
  • IAB: 56% Want Creator Voices In AI Shopping Advice, But Nobody Can Verify Which Creators Are Honest
  • Semrush Says Showing Up Once In A ChatGPT Category Is Worse Than Not Showing Up
Note: All product names, logos, and brands are property of their respective owners. All company, product and service names used in this website are for identification purposes only, and are mentioned only to help my readers. All other trademarks cited herein are the property of their respective owners. Use of these names, logos, and brands does not imply endorsement.

  Hartzer Consulting

Website, Content, and Marketing by Hartzer Consulting, LLC.
Disclaimer - Privacy Policy - Terms of Use - AI Instructions - Entity Map

Copyright © 2026 ·