How crawl works in SharePoint || How indexing work || Basic Concept


Hey Friends,

Today I am here with some concept task . How a search work in SharePoint, but for a search to work SharePoint would first index the content sources.

So, How a crawl work to index the content from MOSS?

Main thing is that it can index, it can crawl anything stored in a server, in any format PDF, Zip, word, excel , txt, HTML, RTF, MS-Office etc. But to index the content other than office or Microsoft the index process is little more complicated but interesting. But the initial or the process is same for all. So let’s have a look on it.

1) When the scheduler for the crawl or index run, it will search for every place you have defined or what you called it a content source.

2) When it find a file in that, it will look on it extension. It will check in SharePoint SSP whether the type is defined to be indexed or not.

3) Now when the SharePoint confirms of file type it will look for a software/Ifilter to read this file. Ifilter is a software which will read a file. Every file need its own ifilter.

4) If SharePoint finds a ifilter for it. It will start opening this file and start scanning the file. It will remove certain words that are not required in search or not need to be indexed ex: 1 ,2 numerals etc.

5) After scanning the whole file it will index the content in index file with the pointer of name and location of the file.

6) Once a file is completed with full process. It will start for next file and with the same process as above.

Now to search or index any file of our use like PDF etc. we need to install the ifilter of every such types, which do not come by default. We can also put the images of such file type in SharePoint images file(12 hive) so that in search document come with their images. 🙂

Hope I was able to describe the content based on my knowledge and learning.

Feel free to Rate and provide feedback if you find post useful

Hope this help
Ashi

This entry was posted in MOSS 2007, SharePoint2010, SQLServerPedia. Bookmark the permalink.

19 Responses to How crawl works in SharePoint || How indexing work || Basic Concept

  1. Riti says:

    Very Nice content..

  2. Rajni says:

    Its really good article Ashish….Now I can tell whats happening in backend..

  3. ashishbanga says:

    Hi Rajni,

    Thanks for the compliment. You are surely welcome to Share facts, which can increase my knowledge.

  4. Pingback: How Search works in SharePoint || Basic Concept « AshishBanga

  5. Abhishek says:

    Awesome way of Explaining the content. Keep it up

  6. Pingback: How to find and install common IFilters||For Search||Crawl « AshishBanga

  7. Nick says:

    great ideas. have just found you here, and will bookmark to come back

  8. juvesiio says:

    You rеally make it seem so easy with уour presentation but I find this topic tо be rеally something that І think І woulԁ never
    understand. It ѕeems too complex and extremely broad foг mе.
    I’m lоoking forward foг your next post, І will try to get thе hang
    of it!

  9. Nafi mohammad says:

    really good it is very useful

  10. rajeev patidar says:

    very nice article……i will give 10/10. thank u somuch

  11. Sir Poon says:

    This is quite an over-simplification. It especially does not deal with the second (and so on) passes of the crawler as well as incremental and continuous crawls. You have just covered one tiny aspect which is essentially what an IFilter does. It would make your article a lot better if you talked about how the individual items are stored in the crawl database and what happens when the items are changed, unchanged, and moved. Also, the continuous crawling in 2013 is a big improvement because of how it staggers search threads.

    I hope this feedback is helpful!

  12. Gopi says:

    Good explanation bro

Leave a comment