Is there any search engine for scholarly materials that creates a ranking system based on citation instead of links?
Also, I know you've gone over the diagram of the internet with the tentacles a number of times, but I still don't get the "IN" and "OUT" parts of the diagram. what do those refer to?
Showing posts with label Week 10. Show all posts
Showing posts with label Week 10. Show all posts
Friday, November 14, 2008
Friday, November 7, 2008
Week 10 Reading notes
The readings covered the structure of web search services. Modern search engines use a sophisticated combination of crawling algorithms, parallelism, and filtering to crawl web pages. Indexing algorithms then collect significant terms on the web page, as well as additional information such as the frequency the term appears and its position. A query processing algorithm then returns documents from the index that contain all the search terms where possible. Search engines use strategies to make the results more accurate and to speed queries up.
Most search engines do not crawl the "deep web," that is, the temporary web pages that are produced as a result of searches on commercial websites, etc. There is many times more information in the deep web than on the surface web, but most browsers do not search it because it would take to much time to create searches of these sites then index them. Some search engines, such as BrightPlanet attempt to search the deep web with the belief that there are more quality results to be found there than on the surface web.
Most search engines do not crawl the "deep web," that is, the temporary web pages that are produced as a result of searches on commercial websites, etc. There is many times more information in the deep web than on the surface web, but most browsers do not search it because it would take to much time to create searches of these sites then index them. Some search engines, such as BrightPlanet attempt to search the deep web with the belief that there are more quality results to be found there than on the surface web.
Subscribe to:
Posts (Atom)
