Problems associated with current search system : Solutions

While surfing the web , 50 % of results to our queries are irrelevant. Why is it so? Because still the searches are not based on the context of the query but on the keyword. There is still so much to be done in this field.To curb this problem of unwanted results all the search engines are working on their algorithm.
Secondly , users need to know some basics of web before using it.Like, how it works? How queries are processed? So that the user may get the most accurate results.

After researching thoroughly about this problem I came across W3C's rcommendation of SEMANTIC WEB , OWL and RDF . This seems to be a solution.

SEMANTIC WEB   means "WEB with a MEANING".It provides a common platform that allows data to be shared & reused across various applications.It is able to describe things in a way that computers can understand.Semantic web describes things and properties of things.
It can be well understood after learning about RDF and ontology.

RDF(Resource description framework) 

• It is a framework for describing web resources like title, author etc. of the webpage.
• It is designed to be read and understood by computers.
• RDF is not to be displayed to users.
• It is written in XML.
• It is a part of W3C's semantic web activity.
• It is a W3C recommendation.

RDF & Semantic web : As RDF is a part of semantic web activity, it can work wonders together.The vision is where Web info has exact meaning, it can be understood as well as processed by computers.Also computers can integrate info from web.

RDF rules :

1.  RDF uses web identifiers (URI:Uniform Resource Identifiers) to identify resources.
2.  RDF describes resources with properties & property.

ONTOLOGY  On semantic web , vocabularies define the concepts and relationships(terms) used to represent and define an area of concern. Ontology is structural framework for organizing information and is used in artificial intelligence, semantic web , system engineering etc. It is a model for describing the world that consists of a set of types , properties and relationship types.

Example :

                

Here, the labeled  dots represent the 'things' and links between the things are 'relationships'.This is known as a class.The way things are related with each other in a class ,makes it easier to navigate or access the data altogether.Thus, using ontology in web structures will make it easy for the users to access relevant information without any specific knowledge of internet.


PROTEGE  It is a tool used to create classes using ontology web language(OWL).


OWL  is based on ontology where classes are formed and is designed to be interpreted by computers just like RDF or semantic web. It is easy to conclude that OWL is also a W3C recommendation under semantic web vision. It is a language for processing web. Its notable features are -

• W3C recommendation in 2004
• Designed to be interpreted by computers.
• Not to be read by people.
• written in XML.
• 3 sub-languages : 
• OWL Lite
• OWL DL (includes OWL Lite)
• OWL FULL ( includes OWL DL)

OWL is different from RDF :  OWL & RDF are much of the same thing , but OWL is a stronger language with greater machine interpret ability than RDF.

These are not very fast growing technologies , because they were developed by people with academic background in logic and artificial intelligence.But the fact is that these technologies are worth learning.Websites developed after considering these technologies have the possibility to be ranked better.

Friends , please let me know if this article is educative to you.Your feedback will help me bring required topics to you with a better explanation.

Search Engine Optimization: How search engines work?

Search Engine Optimization: How search engines work?: Search Engine or I nformation R etrieval (IR) System is an automated program responsible for searching the user's query through web. I...

How search engines work?

Search Engine or Information Retrieval (IR) System is an automated program responsible for searching the user's query through web. IR system holds a broader view for a developer than that for a consumer.


Here I aim to discuss the search engine optimization techniques but with a simple understanding of the working of a search engine.This seems to be a techy task.Isn't it? But the good news is that it is not!!
Working of search engine takes few simple steps which we are going to discuss in this article.See, here I want to make it clear that this piece of information is certainly going to help you rank up your site but only when you implement it properly.So, read it and don't be afraid of the competition.


A Search Engine is an Automated software which is popularly known as 'spider' or 'bot'. These spiders crawl the web and search for the documents according to your query. They match queries against indexes they create. IR system comprise of 4 essential modules :
                 
                               
                                    1. Document processor.
                                    2. Query processor.
                                    3. Search and matching function.
                                    4. Ranking capability.


Step 1 : DOCUMENT PROCESSOR


             The search engine prepares , processes and inputs the documents ,pages or sites that users search against.
This means that when you submit your site to google or any other search engine , the software is going to read your pages , select keywords for your site fro your pages and creates an index.
                 index = words in a document + pointers to their location within the document.
This index is also called as inverted file.
Every search engine has an algorithm of its own to generate keywords.But the factors that help in deciding of keywords will be discussed in fourth step , i.e. ranking capability.


Step 2 : QUERY PROCESSING


             The search engine reads the query of consumer and maps it against the inverted files that have the query terms as keywords.


Step 3 : SEARCH & MATCHING FUNCTION

            This is the most important part to be read carefully because it deals with the attributes of your site that decide its rank.
Matching - Searching the inverted file for documents which meet query requirements is called matching.


Tip 1 - your document must score well in matching with users query.


Now , the question arises that what document features make a good match to query ? 
So here are some features that are certainly going to help.
1. Term frequency -  The term occurring frequently in your document is going to grab the search engine's  attraction towards picking up keywords from your document.
2. Location of terms - Many search engines give preference to words found in the title or lead paragraph or in metadata of a document.
3. Link analysis - It is based on how well connected each page is.
4. Popularity - Google and several other search engines add popularity to link analysis to help determine the relevance or value of pages.
5. Length -  In a choice between two documents containing the same query terms , the document that contains a proportionally higher occurrence of the term relative to length of document is assumed more likely to be relevant.
6.Date of Publication - some search engines assume that the more recent the information , more likely that it will be useful or relevant to the user.Therefore , they present results beginning with the most recent to the less current.
7. Proximity of query terms -  When terms in a query occur near each other within a document , it is more likely that the document is relevant to the query than if the terms occur at greater distance.
8. Proper nouns - Famous proper nouns tend to get more priority in indexing.


Tip 2 - Implement the above 8 points in your document.


Step 4 : RANKING CAPABILITY


Here comes the best part of learning the search engine's working.How does search engines rank your pages? Well! as said earlier, all search engines have their own algorithms to rank websites but something is common to all which can help in tactfully designing your website and rank it well(no doubt, by all fair means!).Take care of few things that are following - 


1. The title of page should give useful information about the subject of page.
2. Words that are mentioned towards beginning of a document are given more weight.
3. Words that are repeated frequently also gain weight.
4. Description and title tags are important.
5. Documents linked to other documents on web gain attraction of search engine.
6. Take care of frequency as well as positioning of keywords.More the frequency, better is the weight.Occurrence of keywords in headers, title, metadata are helpful.
7. Use keywords that are appropriate to your subject.
8. Make sure that your keywords appear in the top paragraphs of actual text on your webpage.
9. words that appear in <h1> , <h2> , <h3> etc. are given more weight by some search engines.


Tip 3 - "description" meta tag is considered to be the most important and most likely to be indexed. So use it wisely.


Tip 4 - In "keyword" meta tag , list a few synonyms for keywords or foreign transitions of keywords.


I sincerely hope that this information must have helped you out in learning the process of ranking of sites by search engine.Just follow the tips and the points that I have provided here. It will help.
Do not worry about other sites on the same topic because it has to be someone on the top and 99% chances that it can be you.

Tweet