Fecha de registro: 28 mar 2022


What You Need to Know about User-agent

User-agent: (name of the robot this rule applies to) Disallow: (insert directory here)

Basically the first line tells robots.txt which search engine bot you want the directory block to apply to. Replace the “(name of the robot this rule applies to)” with the name of the search engine bot you want to block. Seeing as Google is the most popular search engine right now I’ll make use it for an example.


User-agent: Googlebot Disallow: (insert directory here)

Now replace the (insert directory here) with whatever folder you want to block. For example I want to block Googlebot from accessing the image folder on my site because I hate wasting bandwidth on people who just pop in through Google Image Search. Since my image directory is placed in the root of my Wordpress installation I would just type in “/images” without the quotes. If your confused think of it this way. Google is already in the root directory when it visits my site ( The directory I want to block is located at so all I need to type in is /image.


So my final code that I would have in my robots.txt file to block Googlebot from indexing my image directory is:

User-agent: Googlebot Disallow: /images

I hope these tips helped you improve your sites effectiveness in countering the retardedness that is Googlebot in a way that will help you net more traffic from Search Engines. If you have any questions or concerns don’t hesitate to ask for help in the comments section below.

How Lists Can Generate Massive Traffic

Just remember that the list needs to provide overwhelming value. According to accounting homework help experts organize it accordingly and break it up into categories or sub-sections to make it easier for new and returning users to scan your page. It needs to look friendly enough to want to go through all the information, rather than just an intimidating block of blue text.

Share your experiences with the use of lists to generate traffic in the comments. Has any specific kind of list been more effective than others?

More resources:

How To Make and Submit A Sitemap

How Lists Can Generate Massive Traffic How To Make and Submit A Sitemap Review - Marko Novak’s Blog How to Prepare for Competitive Exams in Effective way


Más opciones