Adding robots.txt to sites
You can use Brightspot to create and manage a robots.txt
file on a site. If you are publishing to multiple sites, you can add a robots.txt
file to each site.
Procedure. To add a robots.txt file to a site:
Using the dashboard, create a Raw HTML object. For details, see Creating any type of content.
In the Name field, enter a name for the file.
In the HTML field, enter the
robots.txt
directives.Toward the right of the widget, select |mi-more_horiz|> Advanced.
Create a new header called
Content-Type
with the valuetext/plain
.In the URLs widget, enter
robots.txt
as the URL. Specifying only the name placesrobots.txt
at the root of your site.To add
robots.txt
to other Brightspot sites, repeat the above steps.
. See also: