Skip to main content

Managing Crawl Rules in SharePoint 2013

It's very simple to configure crawling rules in SP 2013 as it was in 2010.
Lets have a quick walk through of it. Crawl rules are used to specfiy detailed logic to the crawler while content crawling. There are situations where we don't want to crawl a particular content or we want exceptional content to be crawled inside that. There are many option available.
  • Prevent content on a site from being crawled. For example, if you created a content source to crawl http://www.ks.com, but you do not want the search system to crawl content from the subdirectory http://www.ks.com/downloads, create a crawl rule to exclude content from that subdirectory.
  • Crawl content on a site that would be excluded otherwise. For example, if you excluded content from http://www.ks.com/downloads from being crawled, but you want content in the subdirectory http://www.ks.com/downloads/content to be crawled, create a crawl rule to include content from that subdirectory.
  • Specify authentication credentials. If a site to be crawled requires different credentials than those of the default content access account, create a crawl rule to specify the authentication credentials.
You can use wildcard(*) characters to include or exclude any content for crawl.Also, Crawl rules can be used to crawl content which is confidential or you may not want to crawl it or any oother account is required to crawl that with different credentials, you can specify all these in Crawl Rules.
How to create a new Crawl Rule:
  • Go to SharePoint Administration, make sure you are login with Search Admin Account.
  • Application Management section, click Manage Service Application.

  • On Manage Service application Page, click on Search Service Application. You will see the above Screen for Search Administration.
  • Click on Add New Crawl Rule.
  • Now as explained above you can specify what to include and what to exclude in this new crawl rule.
  • If you have selected " Include all items in this path" in Crawl Configuration, then only you can specify the authentication for this new Crawl Rule (in case if special authentication is required to implement the new rule).
Testing Crawl Rule
  1. On the Search Administration page, in the Crawling section, click Crawl Rules.
  2. On the Manage Crawl Rules page, in the Type a URL and click test to find out if it matches a rule box, type the URL that you want to test.
  3. Click Test. The result of the test appears below the Type a URL and click test to find out if it matches a rule box.
Happy SharePointing.......

Ref: MSDN Link

Labels

Labels:

Comments

Post a Comment

Popular posts from this blog

Visual Studio Build Issue : Build: 0 succeeded or up-to-date, 0 failed, 1 skipped

"Unable to build or clean the solution in Visual Studio (applicable to almost all versions), output window message is : Build: 0 succeeded or up-to-date, 0 failed, 1 skipped". If you are facing the above issue, you are at the right place. Perhaps following can help you. BTW, the above image is self explanatory, let me still brief if in case the image is not getting downloaded on your Internet connection. In VS menu, go to Tools -> Options. Select -> Projects and Solutions -> Build and Run. Uncheck - "Only build startup projects and dependencies on Run." Your problem shall be resolved. Thank you for visitng my blog.
Post a Comment
Read more

SharePoint log error "Cannot find site lookup info for request Uri http://"

There are many reasons for which you can have this error in your SharePoint server logs. One of the scenerio is explained below. Main Reason: One of the major reason for this error is; the SharePoint is not able to resolve the URL. There is something wrong with the alternate access mapping. Please make sure the alternate access mapping is configured properly. For more details on alternate access mapping in SharePoint, please visit: Alternate Access Mapping We had sharepoint 2016 and all website under that were https:// from the firewall. When we tried to load the web site, error occured with a Correlation Id. After checking the code I found the error message "Cannot find site lookup info for request Uri http://". I URL was able to authenticate the user but on page load the error occurs. My alternate access mapping was: https://mysite                                   ...
Post a Comment
Read more

SharePoint PowerShell to Manage Term Store / Add Terms using PowerShell

SharePoint PowerShell to Manage Term Store / Add Terms //get the term store $mysite = get-spsite “ http://yoursite:portnumber ” $taxonomySession = get-taxonomySession -site $mysite $termStore = $taxonomySession.TermStores[“Managed Metadata Service”] //now we will create the Term Store groups. Before we create any group we will check if the group already exists Example 1: if($termstore.groups["News Keys"] -eq $null) { $termstoregroup = $termstore.creategroup("News Keys");  $termstore.description = "News Group";  $termstore.addgroupmanager ("KS\spadmin"); $termstore.addcontributor ("ks\k.singh");$termStore.CommitAll();} This is not working as “ description ” is not an identified property. Example 2: if($termstore.groups["Main News Keys"] -eq $null) { echo "group is not there";  echo "group is there"; $termstoregroup = $termstore.creategroup("Main News Keys"); $terms...
Post a Comment
Read more