Showing posts with label Week 10. Show all posts
Showing posts with label Week 10. Show all posts

Friday, November 14, 2008

Week 10 Muddiest point

Is there any search engine for scholarly materials that creates a ranking system based on citation instead of links?

Also, I know you've gone over the diagram of the internet with the tentacles a number of times, but I still don't get the "IN" and "OUT" parts of the diagram. what do those refer to?

Friday, November 7, 2008

Week 10 Reading notes

The readings covered the structure of web search services. Modern search engines use a sophisticated combination of crawling algorithms, parallelism, and filtering to crawl web pages. Indexing algorithms then collect significant terms on the web page, as well as additional information such as the frequency the term appears and its position. A query processing algorithm then returns documents from the index that contain all the search terms where possible. Search engines use strategies to make the results more accurate and to speed queries up.

Most search engines do not crawl the "deep web," that is, the temporary web pages that are produced as a result of searches on commercial websites, etc. There is many times more information in the deep web than on the surface web, but most browsers do not search it because it would take to much time to create searches of these sites then index them. Some search engines, such as BrightPlanet attempt to search the deep web with the belief that there are more quality results to be found there than on the surface web.