User-agent: * # Private / non-content areas Disallow: /admin Disallow: /employer/ Disallow: /api/ Disallow: /oauth/ Disallow: /apply/ Disallow: /job-alerts/unsubscribe # The outbound apply redirect. Nothing here is indexable — it 302s # straight to a partner's site — and a crawler following it sends # bot traffic INTO that partner under our referral, which is the # delta that decides our acceptance rate with them. Measured # 2026-08-17: 27,933 of 27,995 /go/ requests were bots, i.e. we were # forwarding ~28K bot visits per 50K requests to partners. Disallow: /go/ # Seeker portal — private, auth-walled, and (unlike /search) it has # no outbound job links a crawler needs to follow, so disallowing # here costs nothing. Pages also serve noindex + X-Robots-Tag. Disallow: /portal Disallow: /account # NOT disallowed, deliberately: # • /search? — carries its own noindex,follow so the job # links on it still get crawled and discovered. # • ?returnTo=… — appended to every job link from a listing # page. Blocking it would block job discovery outright; the # duplicate is handled by the canonical tag on the job page, # which always points at the clean slug URL. Sitemap: https://localwork.com/sitemap.xml