User-agent: MJ12bot
Disallow: /


User-Agent: *
Disallow: /manage/
Disallow: /auctioneer/
Disallow: /auctioneer_live/
Disallow: /live_v2/
Disallow: /components
Disallow: /components/
Disallow: /components/catalogue_components.cfc