TODAY -

E-Pao! Education :: World Wide Web: A Digital Library

World Wide Web: A Digital Library
By: Sanasam Ranbir Singh *



In the span of a decade, the World Wide Web, in short WWW has grown from a small research project into a vast repository of information and a new medium of communication. Today, many organizations (Governmental, Non-Governmental), Institutions, Business organizations etc., use Web as their information media and Internet has become an indispensable part of day-to-day life. Unlike other great networks of the past century, - such as the electronic power grid, the telephone system, or the highway and rail system, - the Web does not have an engineered architecture. Rather, it is a virtual network of content and hyperlinks with over a billion interlinked “pages” created by the uncoordinated actions of tens of millions of individuals.

WWW can be viewed as a graph, in which each node represents the page and edges connecting the nodes are the hyperlinks. The topology of this graph determines Web’s connectivity and consequently how effectively can we locate information on it. But, its enormous size estimated at least 8x108 documents and rapidly growing poses a big challenge to search related pages for specific topic. Major search engine companies have often claimed that they can keep up with the size of the Web. But, due to its continuous changing of documents, links and rapidly growing nature make it impossible to catalogue all the vertices and edges. The estimated coverage of the web by some search engines is given in table below.

Search EngineCoverage (%)
HotBot57.5
AltaVista46.5
Northern Light32.9
Excite23.1
Infoseek16.5
Lycos4.41


Table 1: Estimated coverage of each search engine (average over 575 queries performed during 15 to 17 December 1997) [10].

Because of the decentralized nature of its growth, the Web has been widely believed to lack of structure and organization as a whole. Analysis of the Web’s network of hyperlinks have revealed an intricate structure that is providing to be valuable for organizing information, improving search methods and understanding the Web in a broader technological and serial context. HITS [2], SALSA[3] are some of the widely used hyperlink structure based algorithms and surprisingly found to provide good results. Many studies like PHITS[4], PageRank[1] etc. are farther studies on HITS. Several studies like spectral filtering[7], HyCon[6] find that combining content and link structure of the web provides better result. Our recent study, confidence based web search[6] finds to provide surprisingly good result by monitoring users’ web page access records. Precise classification of the web pages into categories is a key factor in web indexing that plays a major role to improve web search performance and provide quality pages. LSA (Latent semantic analysis), PLSA (probabilistic LSA), k-nearest neighbor etc. are some of the algorithms used to classify web pages.

A recent study [8] indicates that the Web contains a large, strongly connected core in which every page can reach every other by a path of hyperlinks. This core contains most of the prominent sites on the Web. The remaining pages can be characterized by their relation to the core: Upstream nodes can reach the core but cannot be reached from it, downstream nodes can be reach from the core but cannot reach it and “tendrils” contain nodes that can neither reach the core nor be reached from the core.

Searching for relevant pages of specific topic from this huge library poses a large degree of complexity due to its unstructured and dynamic in nature. Available search engines can be broadly classified into two such as content-based search engine and citation-based search engine based on the mechanisms used. Content-based search engines use only the document content and use them for key word matching operation. Users query topic is used as the keyword and find out the documents containing the keyword in the web. Some of the full text content-based search engines are Lycos (www.lycos.com), Alta Vista (www.altavista.digital.com), Excite (www. Excite.com), HotBot (www.hotbot.com), In-foseek (www.infoseek.com), Northern Light (www.nlsearch.com) etc. Several researches find that content-based search engines often provide poor quality results. Hyperlink structure based search engines use citations as well as content of the pages and provide better results than content-based search engines. Google (www.google.com), clever etc. are some of the hyperlink-based search engines.

There are many issues like extraction of the features from the pages, organizational structure of web, identifying community of pages, crawling the web, large-scale search engine and its architecture, web structure, personalized web search, page ranking methods, optimizing web structure, web indexing etc. which are required for better web mining. Due to good amount of resources for research in Web, many researchers are attracted into this area.

References:
[1] Sergey Brin, Lawrence Page. The anatomy of a large-Scale hypertextual Web search engine. In Proc. 7th Int. World Wide Web Conf., 1998.
[2] J. Kleinberg. Authoritative sources in a hyperlinked environment. Journal of ACM (JASM), 46, 1999.
[3] R. Lempel and S. Moran. The stochastic approach for link-structure analysis (SALSA) and the TKC effect. In 9th Int. WWW Conference, Amsterdam, Nrtherlands, May 2000.
[4] D. Cohn and H. Chang. Learning to probabilistically identify authoritative documents. Preprint, 2000.
[5] D. Mukhopadhyay, D. Giri, S. R. Singh. A Confidence Based Methodology to Deduce User Oriented Page Ranking in Searching the Web. Preprint, 2003.
[6] D. Mukhopadhyay, S. R. Singh. HyCon: A Hyperlink and Content based Topic Search Technique. Preprint, 2003.
[7] S. Chakrabarti, B. Dom, R. Kumar, P. Raghavan, S. Rajagopalam, A. Tomkins. Spectral filtering for resource discovery. Preprint, 1998.
[8] Jon Kleinberg, Steve Lawrence. The structure of the Web. In Science Vol. 294, 30 November 2001.
[9] S. Deerwester et. al. Indexing by latent semantic analysis. Journal of the Society for Information Sc. 1990.
[10] Stave Lawrence and C. Lee Gilis. Searching the World Wide Web. Science, Vol.280, 3 April 1998. www.science.com.


Sanasam Ranbir Singh is a scholar at the Dept. Of Comp. Sc. & Engg. Haldia Institute Of Technology, West Bengal, India

* Comments posted by users in this discussion thread and other parts of this site are opinions of the individuals posting them (whose user ID is displayed alongside) and not the views of e-pao.net. We strongly recommend that users exercise responsibility, sensitivity and caution over language while writing your opinions which will be seen and read by other users. Please read a complete Guideline on using comments on this website.




LATEST IN E-PAO.NET
  • Descent of Radha-Krishna #35: Download
  • Violence in Manipur 2023-2024 : Timeline
  • Gastronomy tourism in Manipur : Gallery
  • Triathlon : Manipur bag 6 medals (3 gold)
  • Illegal immigrants/fugitives from Myanmar
  • Eid-ul-Adha: Embracing sacrifice
  • A solution to Meitei-Kuki-Zo conflict
  • The Power of Poppy - 35 :: Poem
  • Scientist of Manipur: R K Brojen Singh
  • Brief sketch on General Balaram Sougaijamba
  • Non-violent for peaceful, mutual co-existence
  • Homeless person ..alcoholism & defeated TB
  • Cancer on rise among young adults
  • Defending, fighting for Idea of Manipur
  • From partiality to complicity
  • Bike Rally - Sekmai to Kangla : Gallery
  • 'Modi must announce finality of Naga pacts'
  • Gliding over Brahmaputra
  • Question leaks cause stress among student
  • Home remedies for prickly heat
  • After IIT, AIIMS it is now IIM
  • Stealing spotlight from Manipur crisis
  • Tarpon chaklen katpa @ Andro #2 : Gallery
  • Strongly condemns violence in Jiribam
  • Lessons from outcome of LS election
  • Tumcho releases "Goodness of God"
  • Right diagnostic for antimicrobial resistance
  • 12th June is World Day against Child Labour
  • Hands of geo-politics ?
  • The row over NEET-2014
  • 2nd Annual Art Exhibition #1 : Gallery
  • Chilli Chicken: Film Spotlighting NE in B'lore
  • Committee of Narcotics Anonymous - Imphal
  • The Power of Meditation
  • Oceans as a career choice
  • Getting more and more audacious
  • A test of leadership
  • Education Fair @Imphal #2 : Gallery
  • Gifting two seats to Cong
  • Voters empowered democracy
  • Postcards from Meghalaya premieres
  • Milk : Essential nutrient for a healthy body
  • Failing in competitive exam not end of world
  • Delhi : A mere spectator
  • Abandoning Jiribam
  • Birth Centenary of Jananeta Irabat, 1996 : #5
  • Ima Keithel flood- May 30 #2 : Gallery
  • Mainstream in Shoes of Alternative
  • Protect the medicines that protect us
  • Lets take action for our land & our future
  • Democracy and independent media
  • Agenda at work to shut Western Gate
  • Keeping Manipur on the boil
  • Descent of Radha-Krishna #34: Download
  • The Enigmatic Journey of 'Laikhutshangbi'
  • Individual and the Social
  • An Ardent Appeal to All Concerns
  • Condemnation of Attack & Govt Inaction
  • The Power of Poppy - 34 :: Poem
  • Scientist of Manipur: Laishram Shanta
  • Alien fishes spotted in Manipur's rivers
  • Training on mushroom at Langthabal
  • Digital avatars or deepfakes ?
  • 7th June is the World Food Safety Day
  • How to prepare for UPSC after 10th ?
  • The Jiri violence
  • Beginning of a new vote culture ?
  • Bimol Akoijam (Cong) wins Inner PC : Gallery
  • BJP, NPF & other NDA pay heavy price
  • Nature is one of greatest blessings of God
  • Plantation drive in Tripura, Assam & Manipur
  • Summer beauty
  • Environment conservation & over-exploitation
  • Is Modi cut out for leading a coalition ?
  • 'Ishanou' Selection @ Cannes #2: Gallery
  • Scholarship for Johnstone Hr Sec students
  • 1st foundation day of Interfaith Forum
  • World Environment Day: Our land, our future
  • Indonesia stronger anti-tobacco measures
  • Navigating a fragile Myanmar: India's policy
  • New breed entering electoral politics
  • The road to formation of new govt
  • International Dance Day #1 : Gallery
  • Matchbox marketing mantra
  • Stop harming nature :: Poem
  • Saving for oneself & the Nation
  • Model United Nations (MUN) conducted
  • Tobacco: Threat to health & environment
  • Candidate from ruling party biting the dust
  • The verdict
  • Birth Centenary of Jananeta Irabat, 1996 : #4
  • Imphal valley districts flooded #3 : Gallery
  • Navigating Remal amidst Manipur conflict
  • We are #GenerationRestoration
  • Intl Day of Innocent Children Victims
  • Apparel Industry Skills & Innovation CoE
  • What's in a cyclone's name ?
  • Ongoing clash, the floods, the losses
  • Exit poll predictions
  • Descent of Radha-Krishna #33: Download
  • Evading flood & rethinking urbanization
  • Manipur Flood: Health Advisory
  • Onus on civil bodies to ensure NNPG unity
  • Rats also cause flood
  • Benefits of JEE Main mock tests
  • People have spoken, now the results
  • The fury of Remal
  • Ima Keithel flood- May 30 #1 : Gallery
  • The flood in our Stars
  • The Power of Poppy - 33 :: Poem
  • 'Group of people misrepresented themselves'
  • EV industry and career options
  • Scientist of Manipur: Chandrakant Aribam
  • Candy flavoured traps to hook next Gen
  • Commemorate Naga Plesbicite Day 1951 #2
  • Tobacco affects health & environment too
  • Jio extend validity for Customer in Manipur
  • Students must learn about AI irrespective
  • As vote count day approaches : Floods
  • Imphal valley districts flooded #2 : Gallery
  • Flooded : Sacrifice of Yairipok's Maiden
  • World No Tobacco Day 2024
  • Chandam Rishikanta wins NPC Nat'l C'ship
  • Flood: Helpline numbers for emergency
  • Battling body odour ?
  • Floods : Not entirely natural phenomena
  • PM Modi's purpose
  • Imphal valley districts flooded #1 : Gallery
  • June Calendar for Year 2024 : Tools
  • Flood: Control Rooms & Helpline numbers
  • Economic impact of ongoing conflict
  • Army Recruitment Rally for Manipur
  • Cut deficit, boom likely
  • Are Gods angry ? Wake up call for Manipur
  • Beating of the Retreat #2 : Gallery
  • We did Overcome: Mayhem of Month of May
  • Training on mushroom at Potshagbam
  • Famous female Mathematicians in India
  • Disinformation campaign thengnare
  • Human trafficking puts humanity to shame
  • Sky opens up in all its fury
  • Licypriya meets Italy PM & Pope Francis
  • HSLC (Class X) 2024 : Full Result
  • HSLC 2024 : Important Info & Grading System
  • HSLC 2024 : Pass % : Private Schools
  • HSLC 2024 : Pass % : Aided Schools
  • HSLC 2024 : Pass % : Govt Schools
  • HSLC 2024 : Statistical Abstract
  • HSLC 2024 : Comparative Statement
  • Combined Defence Services Exam 2024
  • Good show in Class X exams
  • Downplaying the crisis
  • Birth Centenary of Jananeta Irabat, 1996 : #3
  • Reviving Lamphelpat : Conservation : Gallery
  • Commemorate Naga Plesbicite Day 1951 #1
  • "ST status for Meetei" at Hojai
  • The Power of Poppy - 32 :: Poem
  • Insights from CUET-UG Counselling
  • International Day for Biological Diversity
  • Unseen force at work: Time to unravel it
  • Sheikh Hasina's revelation
  • The Vanishing Meitei Tribe
  • Building career in defence & strategic study
  • Why example of model code of conduct ?
  • Ownership of responsibility
  • Will pressure mount on key players in NE
  • How to save your foot after an accident
  • Children Camp @JNMDA Imphal #3 : Gallery
  • Education Fair @Imphal #1 : Gallery
  • Project Associate @ CSE, Assam Univ
  • Understanding schizophrenia
  • Advancement in Multi Objective Optimization
  • When will women in voter list increase ?
  • Making 2 plus 2 is equal to 5
  • Changing face of drug menace
  • Scientist of Manipur: Jayanta Manoharmayum
  • 25 yrs since Atal Vajpayee visit to RIMS
  • 4 Lakhs donated to support (L) Maipak Family
  • Clarification: Guwahati Meet on Humanitarian
  • Start UPSC prep after 12th for success
  • Tips to avoid melting makeup in summer
  • Giving a big solid push to ST demand
  • Time to come clean
  • Sajibu Cheiraoba: 1 occasion, 2 narratives #3
  • Khongjom Day @Khebaching #2 : Gallery
  • A year of hostilities
  • Licypriya Kangujam to travel to Italy
  • Declining moral standards in public life
  • Healthy democracy with independent media
  • Why endangered species matter to us
  • Significant Guwahati meeting : 1st visible step
  • The Pallel story
  • Aftermath of ferocious hailstorm #2 : Gallery
  • Ukhrul: Climate change grip on water supply
  • Commemoration of World Eld's Deer Day
  • Indo-Naga Talks (From 2012) :: Timeline
  • "ST status for Meetei" at Hiyanglam
  • Dance of democracy, a miracle in making !
  • Learn to look 10/20/30 years hence
  • The zero FIR, zero lesson
  • 'Ishanou' Selection @ Cannes #1: Gallery
  • MOU signed: MTI-HUB & KIIT-TBI & SAbF
  • Lament of the Mourning Choir :: Poem
  • "ST status for Meetei" at Wabagai
  • RSS-BJP fracas
  • Trials for Canoe Slalom World Cup
  • Poser from a villager says it all Kamjong
  • The cover-up effort
  • Birth Centenary of Jananeta Irabat, 1996 : #2
  • Manipuri women in the arena of politics
  • "ST status for Meetei" at Assam
  • Aimee Baruah at red carpet of Cannes
  • National Defence Academy Exam 2024
  • How digital media changed communications
  • Manipur stands scandalised
  • All eyes on UP battle
  • Descent of Radha-Krishna #32: Download
  • Riots to a shrine- Ram Mandir of Ayodhya
  • Handle with care. F.R.I.E.N.D.S inside!
  • The Power of Poppy - 31 :: Poem
  • Celebrate the journey !
  • Career counselling : A life guidance tool
  • Scientist of Manipur: Amom Ruhikanta
  • Preserving Thang-Ta :: Rare Photos
  • Regarding Human Rights Situation in Manipur
  • Malemnganbi Laishram : Science Topper
  • Featured Front Page Photo 2024 #2: Gallery
  • Thokchom Sheityajit : Arts Topper
  • Aiena Naorem : Commerce Topper
  • AISSE 2024 Exam Result- RKM Imphal
  • Gold, new world currency !
  • Milk for hair and skin
  • Of illegal immigrants & the larger picture
  • The missive from Kamjong
  • Hr Secondary Exam 2024 : Science Topper
  • HSE 2024 : Subject Pass Percentage
  • HSE 2024 : District Pass Percentage
  • HSE 2024 : Candidates with Highest Marks
  • Hr Secondary Exam 2024: Science Full Result
  • Hr Secondary Exam 2024: Arts Full Result
  • Hr Secondary Exam 2024: Commerce Result
  • Hr Secondary Exam 2024 : Arts Topper
  • Hr Secondary Exam 2024 : Commerce Topper
  • World Bamboo Congress @Taiwan : Gallery
  • Aftermath of ferocious hailstorm #1 : Gallery
  • Radio E-pao: Manipuri Film OST (130+ song)
  • Cheirao-chingkaba @ Chinga : Gallery
  • Nupi Landa Thaunaphabishing : Full Book
  • A ferocious hailstorm @Imphal : Gallery
  • '365 Days of Chin-Kuki Aggression' : Gallery
  • Athoubasingi Numit #2 : Gallery
  • National Science Teacher workshop
  • Sajibu Cheiraoba Chak Katpa #2 : Gallery
  • Scientists of Manipur : Ngangkham Nimai
  • Kenedy Khuman (Singer) : Gallery
  • GHOST of PEACE :: Download Booklet
  • List of Kings of Manipur: 33 - 1984 AD