DangerForums - Seo, WebMaster, Affiliate and Internet Marketing Forum

Go Back   DangerForums - Seo, WebMaster, Affiliate and Internet Marketing Forum > Free Section > Seo Discussion
Seo Discussion Ask questions and give answers about anything on Search Engine Optimization (SEO).
Reply
 
LinkBack Thread Tools Display Modes
Old 09-23-2016, 05:13 PM   #1
Junior Member
 
Join Date: Mar 2016
Location: India
Posts: 18
Thanks: 0
Thanked 13 Times in 13 Posts
artijain1900 is an unknown quantity at this point
What is the use of robots.txt?

Hello Guys,


I would like to know that What is the use of robots.txt? tell me ..
artijain1900 is offline   Reply With Quote
The Following User Says Thank You to artijain1900 For This Useful Post:
Old 10-28-2016, 03:35 PM   #2
Junior Member
 
Join Date: Oct 2016
Posts: 23
Thanks: 0
Thanked 4 Times in 3 Posts
lilly is an unknown quantity at this point

Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called The Robots Exclusion Protocol. The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site.

Pen Drive With Logo
lilly is offline   Reply With Quote
Old 11-04-2016, 05:09 PM   #3
Junior Member
 
Join Date: Sep 2016
Posts: 28
Thanks: 0
Thanked 13 Times in 9 Posts
amreeksingh is an unknown quantity at this point

You might be surprised to hear that one small text file, known as robots.txt, could be the downfall of your website. If you get the file wrong you could end up telling search engine robots not to crawl your site, meaning your web pages won’t appear in the search results. Therefore, it’s important that you understand the purpose of a robots.txt file and learn how to check you’re using it correctly.

Luxury Tempo Traveller
amreeksingh is offline   Reply With Quote
Old 11-04-2016, 05:37 PM   #4
Member
 
Join Date: Oct 2016
Posts: 72
Thanks: 0
Thanked 21 Times in 21 Posts
RH-Calvin is an unknown quantity at this point

Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.
RH-Calvin is offline   Reply With Quote
The Following User Says Thank You to RH-Calvin For This Useful Post:
Old 05-09-2017, 12:43 PM   #5
Junior Member
 
Join Date: Dec 2016
Posts: 24
Thanks: 0
Thanked 12 Times in 11 Posts
esourceparts is an unknown quantity at this point

Robots.txt is a text file that is uploaded to a Web site's root directory and linked in the html code of the Web site.
esourceparts is offline   Reply With Quote
Old 08-22-2017, 03:22 PM   #6
Member
 
Join Date: Apr 2015
Location: India
Posts: 92
Thanks: 0
Thanked 47 Times in 47 Posts
jesica123 is an unknown quantity at this point

Quote:
Originally Posted by RH-Calvin View Post
Robots.txt is a text file that lists webpages which contain instructions for search engines robots. The file lists webpages that are allowed and disallowed from search engine crawling.

Yes, I completely agree with you.
jesica123 is offline   Reply With Quote
Old 11-17-2017, 02:59 PM   #7
Member
 
Join Date: Oct 2015
Location: New York
Posts: 109
Thanks: 0
Thanked 74 Times in 71 Posts
Richardolga is an unknown quantity at this point

Robots.txt plays an important role in seo. it gives instruction to bot to which areas of the website should not be processed or scanned
Richardolga is offline   Reply With Quote
The Following User Says Thank You to Richardolga For This Useful Post:
Old 12-12-2017, 08:52 AM   #8
Member
 
Join Date: May 2016
Location: India
Posts: 52
Thanks: 4
Thanked 30 Times in 26 Posts
rishabjoy is an unknown quantity at this point

Thanks for giving such information.
rishabjoy is offline   Reply With Quote
The Following User Says Thank You to rishabjoy For This Useful Post:
Reply

Bookmarks

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT +5.5. The time now is 04:15 AM.


DangerForum.com Copyright 2012 - DangerForum is an international registered Trademark. You may not use any of our trademarks, copyrights, content, or images without a written approval by Admin.
Search Engine Optimization by vBSEO