TODAY -

E-Pao! Education :: World Wide Web: A Digital Library

World Wide Web: A Digital Library
By: Sanasam Ranbir Singh *



In the span of a decade, the World Wide Web, in short WWW has grown from a small research project into a vast repository of information and a new medium of communication. Today, many organizations (Governmental, Non-Governmental), Institutions, Business organizations etc., use Web as their information media and Internet has become an indispensable part of day-to-day life. Unlike other great networks of the past century, - such as the electronic power grid, the telephone system, or the highway and rail system, - the Web does not have an engineered architecture. Rather, it is a virtual network of content and hyperlinks with over a billion interlinked “pages” created by the uncoordinated actions of tens of millions of individuals.

WWW can be viewed as a graph, in which each node represents the page and edges connecting the nodes are the hyperlinks. The topology of this graph determines Web’s connectivity and consequently how effectively can we locate information on it. But, its enormous size estimated at least 8x108 documents and rapidly growing poses a big challenge to search related pages for specific topic. Major search engine companies have often claimed that they can keep up with the size of the Web. But, due to its continuous changing of documents, links and rapidly growing nature make it impossible to catalogue all the vertices and edges. The estimated coverage of the web by some search engines is given in table below.

Search EngineCoverage (%)
HotBot57.5
AltaVista46.5
Northern Light32.9
Excite23.1
Infoseek16.5
Lycos4.41


Table 1: Estimated coverage of each search engine (average over 575 queries performed during 15 to 17 December 1997) [10].

Because of the decentralized nature of its growth, the Web has been widely believed to lack of structure and organization as a whole. Analysis of the Web’s network of hyperlinks have revealed an intricate structure that is providing to be valuable for organizing information, improving search methods and understanding the Web in a broader technological and serial context. HITS [2], SALSA[3] are some of the widely used hyperlink structure based algorithms and surprisingly found to provide good results. Many studies like PHITS[4], PageRank[1] etc. are farther studies on HITS. Several studies like spectral filtering[7], HyCon[6] find that combining content and link structure of the web provides better result. Our recent study, confidence based web search[6] finds to provide surprisingly good result by monitoring users’ web page access records. Precise classification of the web pages into categories is a key factor in web indexing that plays a major role to improve web search performance and provide quality pages. LSA (Latent semantic analysis), PLSA (probabilistic LSA), k-nearest neighbor etc. are some of the algorithms used to classify web pages.

A recent study [8] indicates that the Web contains a large, strongly connected core in which every page can reach every other by a path of hyperlinks. This core contains most of the prominent sites on the Web. The remaining pages can be characterized by their relation to the core: Upstream nodes can reach the core but cannot be reached from it, downstream nodes can be reach from the core but cannot reach it and “tendrils” contain nodes that can neither reach the core nor be reached from the core.

Searching for relevant pages of specific topic from this huge library poses a large degree of complexity due to its unstructured and dynamic in nature. Available search engines can be broadly classified into two such as content-based search engine and citation-based search engine based on the mechanisms used. Content-based search engines use only the document content and use them for key word matching operation. Users query topic is used as the keyword and find out the documents containing the keyword in the web. Some of the full text content-based search engines are Lycos (www.lycos.com), Alta Vista (www.altavista.digital.com), Excite (www. Excite.com), HotBot (www.hotbot.com), In-foseek (www.infoseek.com), Northern Light (www.nlsearch.com) etc. Several researches find that content-based search engines often provide poor quality results. Hyperlink structure based search engines use citations as well as content of the pages and provide better results than content-based search engines. Google (www.google.com), clever etc. are some of the hyperlink-based search engines.

There are many issues like extraction of the features from the pages, organizational structure of web, identifying community of pages, crawling the web, large-scale search engine and its architecture, web structure, personalized web search, page ranking methods, optimizing web structure, web indexing etc. which are required for better web mining. Due to good amount of resources for research in Web, many researchers are attracted into this area.

References:
[1] Sergey Brin, Lawrence Page. The anatomy of a large-Scale hypertextual Web search engine. In Proc. 7th Int. World Wide Web Conf., 1998.
[2] J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of ACM (JASM), 46, 1999.
[3] R. Lempel and S. Moran. The stochastic approach for link-structure analysis (SALSA) and the TKC effect. In 9th Int. WWW Conference, Amsterdam, Nrtherlands, May 2000.
[4] D. Cohn and H. Chang. Learning to probabilistically identify authoritative documents. Preprint, 2000.
[5] D. Mukhopadhyay, D. Giri, S. R. Singh. A Confidence Based Methodology to Deduce User Oriented Page Ranking in Searching the Web. Preprint, 2003.
[6] D. Mukhopadhyay, S. R. Singh. HyCon: A Hyperlink and Content based Topic Search Technique. Preprint, 2003.
[7] S. Chakrabarti, B. Dom, R. Kumar, P. Raghavan, S. Rajagopalam, A. Tomkins. Spectral filtering for resource discovery. Preprint, 1998.
[8] Jon Kleinberg, Steve Lawrence. The structure of the Web. In Science Vol. 294, 30 November 2001.
[9] S. Deerwester et. al. Indexing by latent semantic analysis. Journal of the Society for Information Sc. 1990.
[10] Stave Lawrence and C. Lee Gilis. Searching the World Wide Web. Science, Vol.280, 3 April 1998. www.science.com.


Sanasam Ranbir Singh is a scholar at the Dept. Of Comp. Sc. & Engg. Haldia Institute Of Technology, West Bengal, India

* Comments posted by users in this discussion thread and other parts of this site are opinions of the individuals posting them (whose user ID is displayed alongside) and not the views of e-pao.net. We strongly recommend that users exercise responsibility, sensitivity and caution over language while writing your opinions which will be seen and read by other users. Please read a complete Guideline on using comments on this website.




LATEST IN E-PAO.NET
  • Manipur Statehood Day @ 1st MR : Gallery
  • Violence in Manipur 2023-2025 : Timeline
  • Mahakumbh : Not just a religious gathering
  • Nepal with largest pictorial health warnings
  • Is war profitable market for arms manufacturer
  • Our CM & party resurrected BJP in Delhi
  • Assamese Play 'Comfort Women'
  • Reading into the resignation reality
  • No stormy session for now
  • Tarao Harvesting Fest @Chandel #6 : Gallery
  • Talheibi, Ningchui, Loyalakpa : eMing
  • 'Vande Bharat' Dream
  • NSS Orientation Programme at MU
  • The influence of the Golden Triangle
  • The Power of Poppy - 68 :: Poem
  • Prasanna Vithanage at Guwahati Film Fest
  • Md Alimuddin, celebrated Sagol Kangjei player
  • Condemnation of Armed Football Match
  • Webinar: KM3NeT Mediterranean experiment
  • Redefining Cancer care: People-centered
  • How thought leadership can propel your career
  • The Science of Success : Attitude #3
  • Guwahati Asian Film Fest : Day 1
  • Of guns and football
  • Armed men playing football, taunting Govt
  • 76th Republic Day @ Kangla #3 : Gallery
  • Epom Amadei Ithak - A theatrical revisit
  • Economy of the dynamic global landscape
  • Is the Bhagavad Gita relevant today ?
  • Healthy hair in Winter
  • Guwahati Asian Film Festival (GAFF) 2025
  • From the battlefields to Delhi
  • Speculations on replacement of Chief Minister
  • 12th Legislative Assembly #2 : Gallery
  • Education & its disjuncture in Manipur
  • HUN-Thadou Cultural Fest 2025 : Theme
  • Coo :: Poem
  • Agartala Coach : India U-19 Women Cricket
  • The story of the village of hope
  • Career choice in wetlands
  • CM in Delhi to meet Shah
  • After failed plastic ban bid, on brickfields
  • New catfish species discovered in Chakpi
  • Love, Unsure :: Poem
  • Manipur's border battles: Deeper conflict
  • A world without leprosy
  • Origin of corruption & possible remedies
  • The question of life
  • 'Sereki' unveils Majuli-themed campaign
  • Posers over summons to Delhi
  • Addiction-free campaign
  • Mera Chaorel Houba @Kangla #5 : Gallery
  • Manipur : Champions Jr Natl Sepaktakraw
  • Effective Unified Command approach
  • Saurashtrian Tamils
  • Accepting the change :: Poem
  • From Kumbh to heaven direct
  • Edge of the seat suspense
  • Wetlands revival efforts reaping fruit
  • Natambakta : Play by JNMDA #4 : Gallery
  • EIIFF 2025 unveils Festival Memento
  • Climate change & plant diseases
  • Shija Hospital- AHPI Healthcare Award
  • Budget 2025: A big gift for middle-class
  • The Science of Success : Attitude #2
  • Cakeology 2025: India's largest cake expo
  • Need to stick to a consistent narrative
  • Leniency on tobacco ban aiding demographic
  • 76th Republic Day @ Kangla #2 : Gallery
  • Pheiroijam Christina - 21st Miss North East
  • Manipur: Gold at 28th Jr National Sepaktakraw
  • Clarion call for redeeming our rightful future
  • The Power of Poppy - 67 :: Poem
  • Clean energy for sustainability
  • Union Budget: Industrialists from NE speaks
  • Balaram Sougaijamba: General of Manipur
  • Nikhil Okram crowned 14th Mister North East
  • Chadong village: Rising from waters with hope
  • Financial literacy for common man
  • Obituary: (L) Pu Thangkholen Sitlhou
  • Nail care in Winters
  • State of war since 2023: No winner, only losers
  • Talks on new district row
  • Radio E-pao: 1000+ songs from Manipur
  • Maibi Jagoi @ Kwak Tanba : Gallery
  • February Calendar for Year 2025 : Tools
  • Ballad of Letting Go :: Poem
  • 2nd Eikhoigi Imphal International Film Fest
  • Deeper exploration of term 'Hill-Valley Divide'
  • Children's Book to adopt 'Look East Policy'
  • Pony registration & conservation
  • Endless suffering of internally displaced child
  • 21st Ningtham Kumhei Fest #2 : Gallery
  • Thiyam Suryamukhi conferred Padma Shri
  • Isolate Kuki Militants by facilitating safe return
  • Sports Meet held at Rongdai Village
  • Eco-Apocalypse: Prevent collapse with Green
  • Grand Finale : 21st Mega Miss North East
  • Time to give more teeth to ST demand
  • 5 years of ILP; what about NRC demand ?
  • Remembering Md Ladu, celebrated polo player
  • The Lament of Love's Deceit :: Poem
  • Need for inculcating value based education
  • Royte - Times Young Entrepreneur Award
  • Glass Child Syndrome ! 'Sibling rivalry'
  • 6 Films for NE Section at GAFF 2025
  • Pony registration & conservation
  • Impartial anti-extortion cell need of the hour
  • 76th Republic Day @ Kangla #1 : Gallery
  • Conservation Strategies of Pethia manipurensis
  • Remembers 13 Brave Indian Soldiers
  • Workshop: Intl Year of Quantum Science
  • Governor's role and discretionary powers
  • Physics workshop for educators at Agartala
  • Who wins Delhi - Daru or Dharma
  • War on Drugs: A war Manipur cannot loses
  • NE turning into transnational drug hub
  • Essence of Gaan-Ngai #2
  • Manipur's dystopian reality
  • The day Light reached the hills
  • 2nd Eikhoigi Imphal Intl Film Fest 2025
  • Why is depreciation of rupee not stopping ?
  • An introduction to Rabies (Hydrophobia) #5
  • Thoithoiba Yelhou Yangkok Artist #2 : Gallery
  • Republic Day Titbits
  • NIT Manipur: Best Design Award @VLSI Design
  • The Power of Poppy - 66 :: Poem
  • Grand Finale: 14th Mega Mister North East
  • Application : FILMART, Hong Kong
  • The Science of Success : Attitude #1
  • 21st Ningtham Kumhei Fest #1 : Gallery
  • Demographic for balkanisation of Manipur
  • Training on Mushroom Cultivation at Nambol
  • Jugeshwor Kshetrimayum receives GELA 2025
  • Construction Committee of Meetei Yumpham
  • Call against misuse of social media
  • Positive & negative aspects of social media
  • In Search of Peace in Manipur
  • Embracing the Shadows :: Poem
  • Dr Manmohan Singh will live on
  • Rise in the price of medicines
  • Respecting the dead- Denying is a disgrace
  • Winter skin care tips for oily skin
  • Illegal immigrants :: Of FMR & border fencing
  • JD-U row exposes national parties' apathy
  • State Gaan-Ngai @Sagolband #2 : Gallery
  • On 'Only BJP can save Manipur'
  • Frontline health workers dispelling darkness
  • 14th East Himalayan Trade Fair
  • Life is plastic
  • Killers on the road : 834 lives lost
  • Call to action to save State's wetlands
  • Essence of Gaan-Ngai #1
  • The Taste of Dreams wins @Red Intl Film Fest
  • Science: 3rd eye for Meitei-Kuki reconciliation
  • Northeast flies high in direct selling
  • Mastering focus amidst distractions
  • An introduction to Rabies (Hydrophobia) #4
  • Indo-Naga Talks (From 2012) :: Timeline
  • BJP : Tepid response from the hills
  • BABINA Hospital sets example in healthcare
  • Nitya Ras @Nongmeibung #1 : Gallery
  • Agonizing reality of our country's veteran elites
  • Historicising the colonial narratives
  • NSS Team Departs for National Integration
  • HUN-Thadou Cultural Festival 2025
  • Time to recreate Naga Peoples Convention 2.0
  • Career in nutrition
  • Need to give more meaning to War on Drugs
  • Time for real action not empty rhetoric
  • Foundation: Manipur Press Club #2 : Gallery
  • "Aronba Wari" :: Shumang Leela Synopsis
  • Tripura's livelihoods challenges
  • Archaeological Exhibition @ Kangla : Gallery
  • Gaan-Ngai @Chaopok village #1 : Gallery
  • Manipur needs to affirm her tribal roots
  • Madras/Chennai- 1989 till 2024 : Gallery
  • Investigate "arms recoveries" in Mizoram
  • Training on Mushroom Cultivation
  • NE Direct Selling Conference & Expo
  • Response of Delhi in last 20 months
  • Regulated entry after FMR scrap, border
  • Mutua Bahadur : Preserving Manipuri culture
  • Competitive Altruism: Resolving ethnic conflict
  • Pithe Puli Utsav at Agartala
  • Building the best version of yourself
  • Guwahati Asian Film Festival 2025
  • Tips to keep your lips soft & smooth in winter
  • Subsidised flight tickets for all
  • MCPCR alert on child trafficking fear
  • Imoinu Erat Thouni @ Wangkhei : Gallery
  • Gaan-Ngai celebrating Culture in Delhi NCR
  • The Weeping Gods of Manipur :: Poem
  • Disarming Kuki-Zo armed groups under SoO
  • Why nurses deserve more recognition, pay
  • The hidden truths of our social media lives
  • MMTU stand bang on target: Recapping May 3
  • Enhancing aerial options to ease travel woes
  • 2nd Emoinu Fish Festival #1 : Gallery
  • Sustainable development - climate action #1
  • RIST Talk- 62 : Artificial Intelligence (AI)
  • "Technically a BJP MLA will rule Nagaland"
  • Makar Sankranti : vibrant customs & traditions
  • Why gold is a strong hedge but ...
  • Delhi date on January 17
  • Onus of addressing tribal issues on new Guv?
  • Nupilal Ningshing Lamjel #2 : Gallery
  • Licypriya Kangujam: Nat'l Youth Day Award
  • Barak Festival advocates Peace, Progress
  • 'Yu', not fully liberalised
  • Article 355 equals Governor's Rule ?
  • Calls to vote with conscience
  • Zingtun academy leading by example
  • State Gaan-Ngai @Sagolband #1 : Gallery
  • Is Kuki-Zo community pushing Nagas to edge?
  • Will drive to find-treat-prevent TB continue ?
  • Smart Cities, dustier roads ?
  • ST of NE & Dalits of mainland India
  • That May :: Poem
  • Understanding Red, Yellow, Green
  • Cong posers on Govt aid to SoO group
  • Culturals @Tri-Nation Football #1 : Gallery
  • Gaan-Ngai festival of Kabui/Rongmei
  • Hingminashi Eikhoi : Call for unity in diversity
  • Gangtok, Sikkim (1983 till 1988) : Gallery
  • Misna Chanu aids to Jiribam IDPs : Gallery
  • Mega Protest Rally, end AFSPA #2: Gallery
  • Ningol Chakkouba @ Delhi #3 : Gallery
  • AIR Radio Imphal Station - Live streaming
  • Nupi Lal Memorial @Pune #2 : Gallery
  • The historical account of Kabaw Valley #3
  • Featured Front Page Photo 2024 #6: Gallery
  • E-Pao.net : 25th Anniv & 2025 Wishes
  • Protest @Delhi - Murder of Meiteis #2: Gallery
  • "Connections", art exhibitt @ DC : Gallery
  • Observance of Thang-Ta Day #1 : Gallery
  • Nupi Lal Memorial @Pune #1 : Gallery
  • Meitei Mayek Tamba : Online Classroom #5
  • Indigenous People Cultural Fest #1 : Gallery
  • Maibi Jagoi @ Mera Houchongba: Gallery
  • Ta Ta TabuHtoN :: Seireng
  • Downloadable Manipuri Calendar :: 2025
  • GHOST of PEACE :: Download Booklet