New:
Updated on 17 November, 2013
**
Red colored are the right answers:
Question
1: What will the following robots.txt file do?
•
User-agent: Googlebot
• Disallow:/*?
•
User-agent: scooter
• Disallow:
a. It will
allow Google to crawl any of the dynamically generated pages. It will
also allow the AltaVista scooter hot to access every page
Ans:
b. It...
