User-agent: AhrefsBot
Disallow: /

User-Agent: MJ12bot
Disallow: /

User-agent: SemrushBot
Disallow: /

User-Agent: *
disallow: /-/q/
disallow: /haku/
disallow: /sok/
disallow: /search/
disallow: /web/
disallow: /*/web/
crawl-delay: 5

Sitemap: https://vaalit.fi/sitemap.xml