.Google.com restricts robots.txt help to four industries, clarifying its standpoint on unsupported ordinances.Google merely assists four details robots.txt industries.Unsupported directives in robots.txt will certainly be actually ignored.Take into consideration bookkeeping your robots.txt data because of this improve.