User-agent: * Allow: /.well-known/amphtml/apikey.pub user-agent: AhrefsBot disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: IfatSearch disallow: / User-agent: Googlebot-News Disallow: /haaretz-labels* Disallow: /nyt* #allow: /meta/Tag/Israel%20news User-agent: * Disallow: */mypromotions Disallow: */misc/sitemap-page Disallow: */misc/article-print-page/* Disallow: */misc/iphone-blog-article/* Disallow: */misc/comment-page/* Disallow: */hasen/* Disallow: */captain/* Disallow: */9401/* Disallow: */nyt/* Disallow: */mobile/* Disallow: */news/international/* Disallow: /9039763/* Disallow: */misc/comment-page/* Disallow: */misc/adxtest1/* Disallow: */misc/search-results/* Disallow: */misc/search-results Disallow: */misc/all-today-s-headlines/* Disallow: */json/cmlink/* Disallow: */smadar* Disallow: /*2.12984* Disallow: /*2.169* Disallow: */papi* Disallow: *1.5460918* Disallow: */wires* Disallow: *1.7362185* Disallow: */polopoly_fs* Disallow: *cmlink/* Disallow: *dailybrief* Disallow: *mobileApp/* Disallow: /*misc/tabletapp* Disallow: */misc/haaretzcomsmartphoneapp* Disallow: */misc/iphone-article/* Disallow: /*ipAcl* Disallow: /*?expand=true Disallow: *=1.6* Disallow: */1.6* Sitemap: https://www.haaretz.com/sitemap.xml Sitemap: https://www.haaretz.com/news-sitemap-content.xml