How do I know it's safe to turn on automatic replies?

The Policies page shows the last 30 days: how people used Herrald's drafts, and a free replay of what it would have sent with automatic replies on.

The replay sends nothing and costs nothing, so you can try your settings before anything goes out.