TODAY -

E-Pao! Education :: World Wide Web: A Digital Library

World Wide Web: A Digital Library
By: Sanasam Ranbir Singh *



In the span of a decade, the World Wide Web, in short WWW has grown from a small research project into a vast repository of information and a new medium of communication. Today, many organizations (Governmental, Non-Governmental), Institutions, Business organizations etc., use Web as their information media and Internet has become an indispensable part of day-to-day life. Unlike other great networks of the past century, - such as the electronic power grid, the telephone system, or the highway and rail system, - the Web does not have an engineered architecture. Rather, it is a virtual network of content and hyperlinks with over a billion interlinked “pages” created by the uncoordinated actions of tens of millions of individuals.

WWW can be viewed as a graph, in which each node represents the page and edges connecting the nodes are the hyperlinks. The topology of this graph determines Web’s connectivity and consequently how effectively can we locate information on it. But, its enormous size estimated at least 8x108 documents and rapidly growing poses a big challenge to search related pages for specific topic. Major search engine companies have often claimed that they can keep up with the size of the Web. But, due to its continuous changing of documents, links and rapidly growing nature make it impossible to catalogue all the vertices and edges. The estimated coverage of the web by some search engines is given in table below.

Search EngineCoverage (%)
HotBot57.5
AltaVista46.5
Northern Light32.9
Excite23.1
Infoseek16.5
Lycos4.41


Table 1: Estimated coverage of each search engine (average over 575 queries performed during 15 to 17 December 1997) [10].

Because of the decentralized nature of its growth, the Web has been widely believed to lack of structure and organization as a whole. Analysis of the Web’s network of hyperlinks have revealed an intricate structure that is providing to be valuable for organizing information, improving search methods and understanding the Web in a broader technological and serial context. HITS [2], SALSA[3] are some of the widely used hyperlink structure based algorithms and surprisingly found to provide good results. Many studies like PHITS[4], PageRank[1] etc. are farther studies on HITS. Several studies like spectral filtering[7], HyCon[6] find that combining content and link structure of the web provides better result. Our recent study, confidence based web search[6] finds to provide surprisingly good result by monitoring users’ web page access records. Precise classification of the web pages into categories is a key factor in web indexing that plays a major role to improve web search performance and provide quality pages. LSA (Latent semantic analysis), PLSA (probabilistic LSA), k-nearest neighbor etc. are some of the algorithms used to classify web pages.

A recent study [8] indicates that the Web contains a large, strongly connected core in which every page can reach every other by a path of hyperlinks. This core contains most of the prominent sites on the Web. The remaining pages can be characterized by their relation to the core: Upstream nodes can reach the core but cannot be reached from it, downstream nodes can be reach from the core but cannot reach it and “tendrils” contain nodes that can neither reach the core nor be reached from the core.

Searching for relevant pages of specific topic from this huge library poses a large degree of complexity due to its unstructured and dynamic in nature. Available search engines can be broadly classified into two such as content-based search engine and citation-based search engine based on the mechanisms used. Content-based search engines use only the document content and use them for key word matching operation. Users query topic is used as the keyword and find out the documents containing the keyword in the web. Some of the full text content-based search engines are Lycos (www.lycos.com), Alta Vista (www.altavista.digital.com), Excite (www. Excite.com), HotBot (www.hotbot.com), In-foseek (www.infoseek.com), Northern Light (www.nlsearch.com) etc. Several researches find that content-based search engines often provide poor quality results. Hyperlink structure based search engines use citations as well as content of the pages and provide better results than content-based search engines. Google (www.google.com), clever etc. are some of the hyperlink-based search engines.

There are many issues like extraction of the features from the pages, organizational structure of web, identifying community of pages, crawling the web, large-scale search engine and its architecture, web structure, personalized web search, page ranking methods, optimizing web structure, web indexing etc. which are required for better web mining. Due to good amount of resources for research in Web, many researchers are attracted into this area.

References:
[1] Sergey Brin, Lawrence Page. The anatomy of a large-Scale hypertextual Web search engine. In Proc. 7th Int. World Wide Web Conf., 1998.
[2] J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of ACM (JASM), 46, 1999.
[3] R. Lempel and S. Moran. The stochastic approach for link-structure analysis (SALSA) and the TKC effect. In 9th Int. WWW Conference, Amsterdam, Nrtherlands, May 2000.
[4] D. Cohn and H. Chang. Learning to probabilistically identify authoritative documents. Preprint, 2000.
[5] D. Mukhopadhyay, D. Giri, S. R. Singh. A Confidence Based Methodology to Deduce User Oriented Page Ranking in Searching the Web. Preprint, 2003.
[6] D. Mukhopadhyay, S. R. Singh. HyCon: A Hyperlink and Content based Topic Search Technique. Preprint, 2003.
[7] S. Chakrabarti, B. Dom, R. Kumar, P. Raghavan, S. Rajagopalam, A. Tomkins. Spectral filtering for resource discovery. Preprint, 1998.
[8] Jon Kleinberg, Steve Lawrence. The structure of the Web. In Science Vol. 294, 30 November 2001.
[9] S. Deerwester et. al. Indexing by latent semantic analysis. Journal of the Society for Information Sc. 1990.
[10] Stave Lawrence and C. Lee Gilis. Searching the World Wide Web. Science, Vol.280, 3 April 1998. www.science.com.


Sanasam Ranbir Singh is a scholar at the Dept. Of Comp. Sc. & Engg. Haldia Institute Of Technology, West Bengal, India

* Comments posted by users in this discussion thread and other parts of this site are opinions of the individuals posting them (whose user ID is displayed alongside) and not the views of e-pao.net. We strongly recommend that users exercise responsibility, sensitivity and caution over language while writing your opinions which will be seen and read by other users. Please read a complete Guideline on using comments on this website.




LATEST IN E-PAO.NET
  • 'No NRC Update No Census' Rally : Gallery
  • Violence in Manipur 2023-2026 : Timeline
  • Price of a vote: How debt drives election
  • Guns N' Roses return to India 2026
  • Why are six Nagas still missing ?
  • Seminar on "Media for Communal Harmony"
  • Parties should have cockroach wing
  • Education :: Poem
  • Leaving border villages to their own fate
  • Yaoshang Mei Loukhatpa #3 : Gallery
  • Ibempishak, Moingpha, Thansomi : Eming
  • Showcasing Manipur @Switzerland : Gallery
  • Criticism Without an Alternative is Not Enough
  • Arambam Somorendra: A Visionary
  • A Little Bird and My Net :: Poem
  • Meritorious Award distributed at Singjamei
  • 'Experience LPU- Day of Lifetime Inspiration'
  • Increasingly seen as being partisan
  • The Lament of a Silent Tree
  • Behavior, Psychology & Society
  • 1st Peaceful Coexistence Award 2026
  • Snakebite: A Public Health Emergency
  • Events- Kuki militant & Naga village volunteer
  • A spiral of violence and turmoil :: Poem
  • HSLC Compartmental Exam 2026
  • World Environment @Lamdeng #1 : Gallery
  • India Isn't Becoming a Superpower
  • World Environment Day @ MU
  • World Environment Day @ Moirang College
  • CM @ World Environment Day
  • World Environment Day - For nature
  • Where there is no vision, the people perish
  • Mosquitoes returning in March
  • Fractured Forever :: Poem
  • Waking up to yet another killings
  • Ahingee Laan : Dance-drama #2 : Gallery
  • Tree Plantation @Taobungkhok : Gallery
  • Violation of SoO can lead to termination
  • Application of AI in livestock production
  • Mass Cleanliness Drive @MU
  • Anupam Andhar: Beauty of darkness
  • Feeling the heat? It might be ageing you faster
  • Missing since May 13, 2026
  • Abdul Hafiz graveyard at Imphal War Cemetery
  • Homecoming : Exhibition at Washington DC
  • Why NSCN-IM & ZUF must preserve Naga
  • The Funeral of Kindness :: Poem
  • Dignified menstruation for gender equality
  • World Environment Day 2026
  • Welcomes New DGP
  • Coming together of the indigenes
  • Martyrs' Day @ Cheiraoching #3 : Gallery
  • Showcasing product from IDPs at Switzerland
  • The abduction & 'murder' of 6 Naga civilians
  • Why keep returning to Regional Politics ?
  • One missed coffee & a full existential crisis
  • Trekking, Camping banned in Nongmaiching
  • Avocados Cultivation Programme at Pangin
  • Guwahati Open PWR 200 concluded
  • Focus on flip flop stand of the UNC
  • The King Who Came from the Sky: Pakhangpa
  • SoO : An assault on native people of Manipur
  • Manipur - Example of Underdevelopment
  • Cries in Agony :: Poem
  • 'CCpur & Kpi Road no longer safe'
  • Home Ground: Meghalaya Future of Tourism
  • Burnout healthcare staff & patient safety
  • Fate of hostages : Flip of the coin ?
  • Chakan Gang-Ngai 2026 : Ooba Video
  • Unfinished requiem- Linthoingambi & Hemanjit
  • "Ningol Van" Launched at Taobungkhok
  • Calm reflection vis a vis brute violence : Poem
  • Foundation Days of States/UT
  • World No Tobacco Day 2026
  • Breast Cancer Awareness in Guwahati
  • Licensed to create mayhem ?
  • How to Break Manipur w/o Breaking Any Laws
  • 17th Manipur State Film Awards (MSFA), 2025
  • World We Make, World That Makes Us : Poem
  • Counting Right, Voting Right: What SIR means
  • Calls on Indonesia to ratify tobacco treaty
  • Honourable exit for Ashutosh & Kailun
  • Police Museum at 1st Manipur Rifles
  • Eid-Ul-Zuha @Sangaiyumpham : Gallery
  • June Calendar for Year 2026 : Tools
  • 16th Manipur State Film Awards (MSFA), 2024
  • KIM's proposed rally must be called off
  • International Menstrual Hygiene Day
  • Plants : The force that engineered Earth
  • AC: How does it affect the skin ?
  • Onslaughts at Ukhrul district
  • Lhangpat Mei @Keishamthong #2: Gallery
  • Anthem of Switland :: Poem
  • CM visits Makhan Naga Village
  • Manipur University needs fresh air
  • False Narrative on Killing of Thadou Christian
  • Summer Coaching Camp 2026 @NSU
  • Tribute to Pu Mangvung Paokholun Haokip
  • Incursion from across the border
  • Radio E-pao: 5 new songs updated
  • Manipuri Community in Assam Calls for Vision
  • School dropouts & never-enrolled children
  • M. Tech at Assam University
  • Under One Sky or Leased ? :: Poem
  • When AI speaks in tribal languages
  • 'The Unbecoming' makes Northeast debut
  • After crossing the three year mark
  • Cheirao-chingkaba on Cheiraoba #2: Gallery
  • Anoi Group Art Exhibition 2026 : Download
  • Exploring Hyderabad's Museums #1
  • Maharaja Garib Niwaz : Manipuri civilisation #4
  • IEC Campaign at Willong Khullen
  • World Emergency Medicine Day 2026
  • Liver & GI super-speciality clinic
  • Adding more muscle to State Police
  • Rally at New Checkon- May 25 : Gallery
  • Hritwika Majumder at Miss Grand India 2026
  • How social media fuels division & ethnic tension
  • Saving Manipur's vanishing paddy & wetland
  • Helpline for Thadou people
  • 477 new Manipur Police Vehicles
  • NDPP-NPF merger accepted by ECI
  • Seeking to pitch Nagas against Meiteis
  • 63rd Mr. Manipur #3 : Gallery
  • Why CJP resonates with Manipur's youth
  • A moral, humanitarian reflection on violence
  • Financial assistance to IDPs
  • Legally binding treaty for older persons
  • Zoonotic Disease : Link animal & human
  • Jealous of Meloni
  • Making the bodies disappear !
  • Yaoshang - Cooking Competition : Gallery
  • Manipur State Award for Literature 2024
  • Manipur's unresolved Political Journey
  • 'Kuki is not an ethnic name'
  • Miyawaki Plantation Experiment at Langol
  • A Ploy to Keep the Chasm Wide Open : Poem
  • 45th Water India Expo 2026
  • Beating of the Retreat #1: Gallery
  • Martyred Rev Dr Vumthang Sitlhou
  • When Ima Weeps in Silence :: Poem
  • International Eld's Deer Day
  • Sticking to a consistent narrative
  • Arms recovered from Lamdeng: Gallery
  • Exploring Kolkata: College Street #1
  • Wetland grabbing, hydropower, & ecologies
  • Condoles Demise of Khangembam Kuleswar
  • Upgradation of Imp-Jiri road: Poor planning
  • IEC Campaign at Phaibung, Senapati
  • In a mess for over 3 years now
  • The King Who Built a Golden Bridge : Kyampa
  • Mother's Day at Pukhao : Gallery
  • Manipur in India Constitutional Transition #3
  • Satyajit Ray's universal language
  • Decoding MLR & LR Act, 1960 & Article 371C
  • National Endangered Species Day 2026
  • India-New Zealand step into a new eco league
  • Posers over fate of abducted 6 Naga men
  • Sit-in protest @Kanglatongbi [May 18]: Gallery
  • Why communities must abandon hostility
  • Apatani's Next Top Model @Arunachal
  • The Fog of Uncertainty :: Poem
  • IEC Campaign at Song Song, Senapati
  • Supports TIM Proposal for Thadou-Naga
  • NE's Largest Psychiatric Hospital
  • Triangular clash underway in Manipur
  • Lamjen @ Thangjing Haraoba #1: Gallery
  • From Sympathy to Supremacy :: Poem
  • History repeats itself
  • Church Teams to visit Kangpokpi & Senapati
  • Workshop on Analytical Chromatography
  • Criminal Neglect, Terror Shielding
  • Summer make-up tricks to beat the heat
  • Pulling the strings to block the highways
  • Manipur Art Festival 2025 #3: Gallery
  • Manipur fermented food & scientific recognition
  • Seminar : Development of NE Region
  • Cheiraoba Chak Katpa #2: Gallery
  • Maharaja Garib Niwaz : Manipuri civilisation #3
  • Yumjao Lairembi Haraoba #1 : Gallery
  • Manipur in India Constitutional Transition #2
  • Sit-in protest @Kanglatongbi [May 14]: Gallery
  • Int'l Triathlon Yengkhom Suraj felicitated
  • Colonial Knowledge Production in NE #22
  • Condemns Killing of Thadou Church Leaders
  • Candlelight Vigil @ Bangalore #2 : Gallery
  • Maharaja Garib Niwaz : Manipuri civilisation #2
  • The Green Foundation recognised as a SIRO
  • Waithou Rally condemn civilian killing: Gallery
  • Chahi Taret Khuntakpa
  • HSLC Exam 2026 : Full Result
  • HSLC Exam 2026 : Pass % : Govt Schools
  • HSLC Exam 2026 : Pass % : Aided Schools
  • HSLC Exam 2026 : Pass % : Private Schools
  • HSLC Exam 2026 : Withheld-students
  • HSLC Exam 2026 : Compartmental candidates
  • HSLC Exam 2026 : Statistical Abstract
  • HSLC Exam 2026 : Important Information
  • Chandel District Head Quarters : Gallery
  • Indigenous Leaders Call for Global Recognition
  • Subika Art Exhibition @Washington : Gallery
  • Vegetables @ Waithou Keithel #2 : Gallery
  • Conflict, Displacement in Manipur (2023-2026)
  • Tronglaobi: 2 children laid to rest : Gallery
  • Martyrs' Day @ Cheiraoching #2 : Gallery
  • Featured Front Page Photo 2026 #2: Gallery
  • Free Online access to 'Asangba Nongjabi
  • Candlelight vigil: Killing at TM Kasom : Gallery
  • Fractured sovereignty : Proxy war
  • Mama, I love you- Then the world went silent
  • Khongjom Day @ Khebaching : Gallery
  • Final Merit List : Manipur Civil Services 2022
  • HSE : Pushpa K, H Keniya, P Taibangnganba
  • Yohen Longjam : HSE 2026 : Science Topper
  • Sarangthem Ayingbi : HSE 2026 : Arts Topper
  • Thoihenba Thongam : HSE 2026: Commerce
  • HSE 2026: Science Full Result
  • HSE 2026: Arts Full Result
  • HSE 2026: Commerce Full Result
  • HSE 2026: Pass % - Govt / Non Govt
  • HSE 2026: Pass % - District Institutes
  • HSE 2026: Subject-wise Pass %
  • HSE 2026: Candidates securing Highest Mark
  • HSE 2026: Science Topper List
  • HSE 2026: Arts Topper List
  • HSE 2026: Commerce Topper List
  • The great Manipur betrayal
  • Most Heinous Murder: Derailing Normalisation
  • Martyrs' Day @ Cheiraoching #1 : Gallery
  • Killing of 2 children @ Tronglaobi : Gallery
  • Yaoshang Thabal Chongba #2: Gallery
  • Boong: India's 1st BAFTA in children's cinema
  • PUCL Tribunal report: A shadow of partiality #3
  • PUCL Tribunal report: A shadow of partiality #2
  • PUCL Tribunal report: A shadow of partiality #1