# /robots.txt file for http://www.iatroudakis.gr/ User-agent: Biz360 spider User-agent: e-collector User-agent: http://www.almaden.ibm.com/cs/crawler User-agent: Infuz crawler User-agent: Jyxobot/1 User-agent: lmspider User-agent: MSIECrawler User-agent: OmniExplorer_Bot User-agent: RoboFox User-agent: RufusBot User-agent: vspider User-agent: larbin_2.6.3 Disallow: / # specific pages are disallowed to avoid duplicate titles when renaming User-agent: Googlebot Disallow: /ac/index.html Disallow: /cad/el/blog/index.php?s=* Disallow: /cad/el/blog/index.php?paged=[0-9]+&s=* Disallow: /cad/el/site/terms.html # this disallows old decad permalinks of /YYYY/MM/DD/ format #Disallow: /cad/el/blog/(19|20)[0-9]{2}/(0[1-9]|1[012])/(0[1-9]|[12][0-9]|3[01])/ Disallow: /cad/el/blog/[0-9]{4}/[0-9]{2}/[0-9]{2}/ Disallow: /cad/el/firm/scope/cadstandard.html Disallow: /cad/el/site/siteindex.html Disallow: /cad/en/site/siteindex.html Disallow: /cad/el/site/siteindexen.html Disallow: /cad/el/site/searchtips.html Disallow: /cad/en/site/searchtips.html User-agent: * Disallow: /images/ Disallow: /includes/ Disallow: /styles/ Disallow: /cad/el/clients/ Disallow: /cad/en/blog/ Disallow: /email-addresses/ Disallow: /cad/el/news/