Elements or Lower

Tue, 24 Mar 2009


FFS: BT Webwise (Phorm) should, without question, allow website owners to block them through robots.txt without having to also block either Google or Yahoo! — in other words, it should observe rules set for a “Phorm” user-agent or equivalent, even if the technology means that there’s no such user-agent in practice.