You may add these webpages towards the file to get explicitly disregarded. Robots.txt files use anything called the Robots Exclusion Protocol. This Web-site will very easily generate the file for you personally with inputs of webpages to get excluded. Developers or website-owners often seem to think they're able to make https://rankingseotoolz.com/robots-txt-generator