Do you know the search engine has the robots? The robots are not real robots, but they are such kind of robots. They can detect any action on our blog. They are responsible to show our blog on the search engine. This is the custom robots header tags setting article. This type of robots also called crawlers.
We can properly communicate with these robots by using some predefined tags. By this tag, they detect every action of a blog. That’s what exactly you are going to read in this post. In the blog, we have to set some setting by which our blog can exactly communicate with crawlers.
If you are looking for start a blog on blogger, you need know about this before. Let get started –
How to Set up Custom Robots Header Tags on Blogger?
If you are a Blogger user, then this setting is for blogger users. If you are looking for good organic traffic to your blog by which your blog get zenith. So, I am giving this knowledge to get more visibility on the search engine. Follow the following steps step by step and your blog visibility will increase.
Before starting this tutorial to set up a robot header tag on blogger, you must know what they are? This knowledge is important to get started.
Types of Robots header tags
In bloggers header tags option we can see the following robots and you have to deal with them. Let’s know about them.
all – If you set this tag, crawlers are not bound by any problem. They can easily crawl and index your content.
noindex – Some blogs are not for public notice. If you don’t share the URL of your personal blog with anybody, chances are people will come to it from search results. In some cases, you can use the noindex tag to prevent search engines from indexing the pages.
nofollow – Nofollow and dofollow tags are for outbound links. Dofollow is the default tag for all outbound links. That means search engines can sneak upon the pages you linked to. If you are not looking for search bots to look through your links, the nofollow tag will help you.
none – noindex and nofollow both tags show the same features in some condition. The crawlers will not index your pages and will not go through the links.
Noarchive – You have observed a cached label with most of the website links on SERPs. It shows the search engine has collected a copy of your site into their server to display in case it goes down. That said, the noarchive tag help to turn off cached version in search pages.
nosnippet – The group of the snippet in search results help people to find what is the webpage about. If you want to keep the content visible, you can turn this header tag on.
noodp – Open Directory Project or Dmoz is a directory of websites which is man-made. In sometime search engine collects the information from there also. If you want to turn off, you can turn it off this tag.
notranslate – If you want to disable the translation on your website / blog? Then by using notranslate tag, you turn off exact purpose.
noimageindex – If you give the permission to Google to index the images on your website then people will steal them and use it on their website. To prevent this, you can keep the images deindexed using the noimageindex tag.
unavailable_after – In Blogger, you get a field right to this tag. So, the webpage will be deindexed after this time.
As you can see there are 10 types of very important robots header tags. With the end now we come to the point of this article.
Setup Custom Robots Header Tags
As you know, we are talking about setting up robots tags on blogger. Follow the steps given below to proceed with this.
Step 1 – First go to blogger.com and sign in to your account. Select the blog in the list, where you want to modify with header robot tags.
Step 2 – Now go to Settings and then go to Search preference. In the setting, you have to find the Crawlers and Indexing option. You can easily find it by scrolling down the setting window.
Step 3 – As you can see in the image, you have to do same. Enable Custom robots.txt and Custom robots header tags.
Now below you can see three new tag options. Home page tags, Archives and Search page tags, and Post and Pages tags. Now we are going to make some changes to them.
Home page tags
Home page tags are used when you want to index your Home page in Google search. If you want to index your Home page, just enable all and noodp. It will allow crawlers to crawl and index your Home page in Google search.
Archives and Search page tags
Archives and search page tags are use when you want to index the URL generated after searching on the blog, you have to enable this option. Let see the example of the URL –
I have a blog that’s name is https://techraazz.blogspot.com/. I searched blog word on it by using the search bar. So the URL became like https://techraazz.blogspot.com/search?q=blog this.
So If you want to allow this URL to index, you can do it by enabling all options in the Archives and Search page tags. And if you don’t want to index it, leave it as it appears in the image.
Post and Pages tags
Now you have to enable this because without enabling it, your posts will not appear in the search results. Then how do your rank? To index your post and pages in search results you have to enable all and noodp options as shown in the image.
Step 4 – Just follow the same settings display in the image and hit Save changes button.
Note – We can set this up for the homepage, archive pages, and post pages also. Go ahead and set this setting first.
Custom robots header tags are so powerful! Blogger provides a facility of readymade custom robot header tag setup to use them, why may you not go for it?
And, do not select noindex checkbox unless as you about it. Its result will pull your website off from search engine result pages. If you are going through some problem then inform me by comment action below.