Saturday, June 8, 2013

How does Google crawler find pages?

How does Google crawler find pages?

Will Google crawler find a page that is not linked to? I.e. pages accessible by manually modifying the url, like http://www.site.com/node/1/[secret keyword]. Note that it is only secret in that there are no links to it; this "secret" path should't hold sensitive information.

No comments:

Post a Comment