How To Add Custom Robots.Txt File In Blogger (Blogspot)?

For better performance of our blog we need to optimize it for Blogger (Blogspot) we have the option to customize the robots.txt file according to our needs. But before adding it to your blog firstly as a beginner we need to know about what is robots.txt file. So lets start the tutorial.

What is Robots.txt?

Robots.txt is a file which tells the search engine crawlers what page to crawl and what not to. Simply, you can exempt your blog demo pages, label pages, archive pages and other which you don't consider as important. Search engine crawlers always scan the robots.txt file before crawling any blog.
So lets start adding this great SEO improver to your blog.

Adding Robots.txt to Blogger (Blogspot) Blogs:

To add Custom Robots.txt file to your blog, follow the basic steps mentioned below:
  1. Go to your blogger blog.
  2. Navigate to Settings >> Search Preferences ›› 
  3. Crawlers and indexing ›› Custom robots.txt ›› Edit ›› Yes
  4. Now paste the below robots.txt file code in the box.
    User-agent: Mediapartners-Google
    Disallow:

    User-agent: *
    Disallow: /search
    Allow: /

    Sitemap: http://example.blogspot.com/feeds/posts/default?orderby=UPDATED
  5. Remember to change the highlighted url (example.blogspot.com) with your blog address.
  6. Click on Save Changes button.

You are all done.

How to Check Your Robots.txt File?

Simply add /robots.txt after your blog address and you will be shown your robots.txt file. Take a look at the below example


All set!
I hope you all easily added the custom robots.txt file in your blog. If you have any query regarding any of the blogspot tutorial, drop a comment below.

Comments

Post a Comment

Popular posts from this blog

How To Setup Freenom Domains (.Tk, .Ml, .Cf, .Ga, .Gq) As Blogger Custom Domain?

Image
Adding a custom domain to your blog brings more professionality and increase your rankings in search engines . Adding a custom domain to your blogger blog will change your blog address from yourblog.blogspot.com to yourblog.com, yourblog.tk, yourblog.net or whatever domain extension you registered. Today I am going to share a great tutorial on how you can register free .tk, .ga, .gq, .cf, .ml domains for your blog and use it as a custom domain name in blogger. This will surely build a trust toward your visitors and increase your visitors count too as people prefer to visit a custom domain blog instead of a sub-domain. So let's start the tutorial on using freenom free domain names as blogspot blog's custom domain. Also Check : Complete Guide to Setup WordPress Blog How to Register Free Freenom Domain : Just follow the below steps to register your .tk, .ml, .cf, .ga, .gq domain name for 1 year absolutely free of cost. After the completion, we will discuss on how to u
Read more

How To Insert Emoji, Special Characters And Symbols In Blogger?

Image
Nowadays its a isu terkini going to use emojis to share feelings. People use to add emojis in every particular message to express their feelings while typing that message. Sometimes, a blogger also realizes to express his/her feelings through emojis while writing a blog post. Blogger platform provides such a great option by default in Post-Editor. You can use special characters, emojis, and symbols directly from your Blogger Post-Editor. Not only that, you can also draw special symbols through your mouse and get the perfect match of that specific character. You can use the Blogger "Insert special character" tool to insert arrows (↑→), mathematical symbols (⺟∫), accented (éü) or non-Latin characters (禁𓁗) and even emoji (🐦✋). So, let's start learning how you can insert emojis and special characters in blogger.  Also Check:   Blogger Released Free SSL (HTTPS) for Custom Domains Why Use Emoji in Blog Posts? : Advantages You must be aware that emoji were used over
Read more

How To Change Blogger (Blogspot) Template?

Image
When I started Blogging, I do not have much knowledge about the blog design and layout. At that time, I use default blogger templates on my blog which is not that much attractive. When I learn how to do modifications in default blogger templates and also how you can apply a third party blogspot/blogger template or theme to your blog. This is a quite simple task and require just few mouse clicks. No matter whether you want to change a bakery website design template  or any other kind of templates, it’s easy to do so. So let's start how you can change your blogger theme/template easily. Changing Blogger (Blogspot) Template : To get any third party template, simply search on google @Blogger Templates and you will find various free sites for it. Download any template of your choice.  Now to change your template follow the given steps : First of all, Log in to your Blogger account. Click on the drop down sajian and choose   Template . Press   Backup/Restore   button
Read more