# www.robotstxt.org/ # Allow crawling of all content... User-Agent: * Disallow: /admin Disallow: /th/user Disallow: /en/user Disallow: /th/account/ Disallow: /en/account/ Disallow: /en/cart Disallow: /th/cart Disallow: /en/checkout Disallow: /th/checkout Disallow: /th/search/ Disallow: /en/search/ Disallow: */*.html.h* Disallow: /content/cds/th/ Disallow: /*.html$