It's very simple to configure crawling rules in SP 2013 as it was in 2010. Lets have a quick walk through of it. Crawl rules are used to specfiy detailed logic to the crawler while content crawling. There are situations where we don't want to crawl a particular content or we want exceptional content to be crawled inside that. There are many option available. Prevent content on a site from being crawled. For example, if you created a content source to crawl http://www.ks.com , but you do not want the search system to crawl content from the subdirectory http://www.ks.com/downloads , create a crawl rule to exclude content from that subdirectory. Crawl content on a site that would be excluded otherwise. For example, if you excluded content from http://www.ks.com/downloads from being crawled, but you want content in the subdirectory http://www.ks.com/downloads/content to be crawled, create a crawl rule to include content from that subdi...