.Google confines robots.txt assistance to 4 fields, clarifying its position on in need of support directives.Google.com simply supports 4 particular robots.txt fields.In need of support ordinances in robots.txt will definitely be actually disregarded.Look at auditing your robots.txt files due to this update.