Recent notions to enhance crawling abilities of many search engines have us believe that quite soon Google and other major players of the industry are going to find a way to slip through the form generated links to find more pages for their indexes. Which kind of forms will be crawlable and which will not is hard to say. We believe that forms that include one or two drop-down menus will be the first to surrender to the new techniques of page discovering. However webmasters should be assured that the protector of the “invisible” web world, known to many of us as robots.txt, will be setting the rules for all automated visitors before they start jumping over the <form> tags.

We would like to hear from our readers what they think about this, what problems or benefits of such changes they expect to have, or any other ideas they had in their heads as they read this post.

Trackback URI | Comments RSS