See other articles
Automation Jobs

Robots.txt change detection

This Automaton Job will create a Robots.txt Change Detection Insight

Messing around with the robots.txt file should only be done by people who know what they are doing, as the ramifications of making a mistake here can result in your site no longer showing in search results. 

This job utilises the domain on the Client settings (For business accounts your account domain) and will run a check each day to determine if there have been any changes. All you need to configure is how you want to get alerted, Email, Slack or Zapier.

Was this article helpful?
Nice one!

Thanks a lot for your feedback!
If you’d like a member of our support team to respond to you,

please send a message here
Please try again

Oops! Something went wrong while submitting the form.

Sorry about that. What did you find most unhelpful?

Nice one!

Thanks a lot for your feedback!
If you’d like a member of our support team to respond to you,

please send a message here
Please try again

Oops! Something went wrong while submitting the form.

See all categories

Automation Jobs

This Automaton Job will create a Robots.txt Change Detection Insight

Messing around with the robots.txt file should only be done by people who know what they are doing, as the ramifications of making a mistake here can result in your site no longer showing in search results. 

This job utilises the domain on the Client settings (For business accounts your account domain) and will run a check each day to determine if there have been any changes. All you need to configure is how you want to get alerted, Email, Slack or Zapier.