Guys,
Robots.txt is a Standard used by websites to communicate with web crawlers and other web robots.
But I couldn't clearly understand the use of robots.txt in SEO.
Can someone explain the use of robots.txt in SEO?
Thank You!
Printable View
Guys,
Robots.txt is a Standard used by websites to communicate with web crawlers and other web robots.
But I couldn't clearly understand the use of robots.txt in SEO.
Can someone explain the use of robots.txt in SEO?
Thank You!