Google announced yesterday as part of its efforts to standardizing the robots exclusion protocol that it is open sourcing its robots.txt parser. That means how GoogleBot reads and listens to ...
An amusing moment in the XML standard — quite possibly the only snippet of the standard anyone’s likely to call amusing — is the bit early in the introduction that proclaims: It shall be easy to write ...