Searchengine Marketing 101

Search Engine Marketing

2007-01-01T07:10:00.000-08:00

In internet marketing, search engine marketing, or SEM, is a set of marketing methods to increase the visibility of a website in search engine results pages (SERPs). The three main methods of SEM are:

Search engine optimization attempts to improve rankings for relevant keywords in search results by improving a web site's structure and content

Pay per click advertising uses sponsored search engine listings to drive traffic to a web site. The advertiser bids for search terms, and the search engine ranks ads based on a competitive auction as well as other factors.

Paid inclusion can provide a guarantee that the website is included in the search engine's natural listings. However, as of 2006 the leading search engine, Google, does not offer this service.

Search Engine Optimizing

Search engine optimization or SEO aims to index and improve rankings for the webpages which are most relevant to the keywords searched for according to the algorithm of each search engine. The relevant pages are returned in search engine results pages (SERPS). It is important to remember that genuine search engine optimizers are basically marketers who keep their target market in mind as much as the search engine algorithms (a lot of which is known purely empirically). Therefore, while we call this process search engine optimization, good marketers will note that their focus is to optimize their web page for the search engine user, who is their target audience. For instance, at one time it was believed that keyword density was an important ranking factor, but today that view is not generally held among SEO professionals. Today, many SEOs recommend writing copy for visitors first, because the web site cannot achieve its marketing objectives with "unnatural" sounding text, laden with keywords.

In order to further fine tune the pages and keep them user and search engine friendly, the architecture of the website, including its internal link structure, navigation etc., are also suitably modified for human beings and search spiders to navigate through whole website pages. Search spiders then can scan all necessary data about the whole site and store it in the search engines' data base. A good navigation systems has other benefits also, such as helping to improve user experience.

Both the number of inbound links to the site as well as the 'quality' of the links heavily influence the rankings of a site in the search engine. The definition of a 'quality' link is evolving in response to people's attempt to artificially influence the search engine results by obtaining large numbers of 'irrelevant' links to their sites. Search engine algorithms are evolutionary and strive to develop every day in an attempt to provide the most relevant and useful pages to the users and strike out the websites that trick them to attain higher positions for a while.

These processes are known as Organic or Algorithmic Search Engine Optimization (SEO) of websites. Search engine optimization takes considerable time and, as such, many sites make use of Pay-per-Click (PPC) to market their website without having to wait for the results of Organic SEO. However, organic search results can get viewed and clicked on frequently, so a dual strategy of SEO and PPC can provide more exposure than either strategy alone.

Pay Per Click

Advertising with search engines is known by different names. It is also called sponsored search and search engine advertising. The most popular programs are offered by Google, Yahoo!, and Microsoft. Some offer PPC, where the advertiser is only charged when a user clicks on the ad, also known as Cost Per Click (CPC). Others use a Cost Per Impression (CPM) model where advertisers are charged for impressions. Ads can take many forms, including text, banner ads, video ads, map ads, and even audio ads.

Advertising based on a keyword search

Advertising based on a keyword search could take place through a search engine such as google.com, or a search engine partner site, such as shopping.com. For example, Google offers a service called AdWords, which allows companies, for a small fee, to have a link to their website featured when a user searches a specific keyword which the company specified.

Advertising based on content context

Many search engines (e.g. Google, Ask.com, Yahoo! Search) have partner websites with specific content. The websites agree to let the search engines place content-specific advertising on their website, in return for a fee. The search engine then finds companies interested in advertising on websites with their desired content. For example, an online dog food retailer might have their advertisement placed on a site about dogs.

Both of these advertising formats allow advertisers to target specific users with certain interests. Generally these advertisements are paid for based on either a pay per click campaign or an impression based campaign.

Paid Inclusion

Search engines use computer programs called spiders or web crawlers to automatically discover websites and catalog their content. As this process can take some time and requires a website to be linked to from another website (to allow the crawler to find it), most search engines except for Google provide another channel to be included in search rankings via paying. This is different from pay per click advertising because the inclusion is guaranteed but not placement.

Paid Inclusion

2007-01-01T07:07:00.000-08:00

Paid inclusion is a search engine marketing product where the search engine company charges fees related to inclusion of websites in their search index. Paid inclusion products are provided by most search engine companies, the most notable exception being Google.

The fee structure is both a filter against superfluous submissions and a revenue generator. Typically, the fee covers an annual subscription for one webpage, which will automatically be catalogued on a regular basis. A per-click fee may also apply. Each search engine is different. Some sites allow only paid inclusion, although these have had little success. More frequently, many search engines, like Yahoo!, mix paid inclusion (per-page and per-click fee) with results from web crawling. Others, like Google (and a little recently, Ask.com), do not let webmasters pay to be in their search engine listing (advertisements are shown separately and labeled as such).

Some detractors of paid inclusion allege that it causes searches to return results based more on the economic standing of the interests of a web site, and less on the relevancy of that site to end-users.

Often the line between pay per click advertising and paid inclusion is debatable. Some have lobbied for any paid listings to be labeled as an advertisement, while defenders insist they are not actually ads since the webmasters do not control the content of the listing, its ranking, or even whether it is shown to any users. Another advantage of paid inclusion is that it allows site owners to specify particular schedules for crawling pages. In the general case, one has no control as to when their page will be crawled or added to a search engine index. Paid inclusion proves to be particularly useful for cases where pages are dynamically generated and frequently modified.

Paid inclusion is a search engine marketing method in itself, but also a tool of search engine optimization, since experts and firms can test out different approaches to improving ranking, and see the results often within a couple of days, instead of waiting weeks or months. Knowledge gained this way can be used to optimize other web pages, without paying the search engine company.

Pay Per Click (PPC)

2007-01-01T06:51:00.000-08:00

Pay per click (PPC) is an advertising technique used on websites, advertising networks, and search engines.

Advertisers bid on "keywords" that they believe their target market (people they think would be interested in their offer) would type in the search bar when they are looking for their type of product or service. For example, if an advertiser sells red widgets, he/she would bid on the keyword "red widgets", hoping a user would type those words in the search bar, see their ad, click on it and buy. These ads are called "sponsored links" or "sponsored ads" and appear next to and sometimes above the natural or organic results on the page. The advertiser pays only when the user clicks on the ad.

While many companies exist in this space, Google AdWords and Yahoo! Search Marketing, which was formerly Overture, are the largest network operators as of 2006. In the spring of 2006, MSN started beta testing their own PPC service, MSN adCenter. Depending on the search engine, minimum prices per click start at US$0.01 (up to US$0.50). Very popular search terms can cost much more on popular engines. Abuse of the pay per click model can result in click fraud.

PPC engines can be categorized in "Keyword", "Product", "Service" engines. However, a number of companies may fall in two or more categories. More models are continually evolving. Currently, pay per click programs do not generate any revenue solely from traffic for sites that display the ads. Revenue is generated only when a user clicks on the ad itself.

Keyword PPCs

Advertisers using these bid on "keywords", which can be words or phrases, and can include product model numbers. When a user searches for a particular word or phrase, the list of advertiser links appears in order of the amount bid. Keywords, also referred to as search terms, are the very heart of pay per click advertising. The terms are guarded as highly valued trade secrets by the advertisers, and many firms offer software or services to help advertisers develop keyword strategies.

As of 2005, notable PPC Keyword search engines include: Google AdWords, Yahoo! Search Marketing (formerly Overture Services), Microsoft adCenter, LookSmart, Miva (formerly FindWhat), Ask (formerly Ask Jeeves), 7Search, Kanoodle, and Baidu.

Product PPCs

"Product" engines let advertisers provide "feeds" of their product databases and when users search for a product, the links to the different advertisers for that particular product appear, giving more prominence to advertisers who pay more, but letting the user sort by price to see the lowest priced product and then click on it to buy. These engines are also called Product comparison engines or Price comparison engines.

Noteworthy PPC Product search engines are: BizRate.com, Shopzilla.com, NexTag, PriceGrabber.com, and Shopping.com.

Service PPCs

"Service" engines let advertisers provide feeds of their service databases and when users search for a service offering links to advertisers for that particular service appear, giving prominence to advertisers who pay more, but letting users sort their results by price or other methods. Some Product PPCs have expanded into the service space while other service engines operate in specific verticals.

Noteworthy PPC services include NexTag, SideStep, and TripAdvisor.

Pay per call

Similar to pay per click, pay per call is a business model for ad listings in search engines and directories that allows publishers to charge local advertisers on a per-call basis for each lead (call) they generate. The term "pay per call" is sometimes confused with "click to call". Click-to-call, along with call tracking, is a technology that enables the “pay-per-call” business model.

Pay-per-call is not just restricted to local advertisers. Many of the pay-per-call search engines allows advertisers with a national presence to create ads with local telephone numbers.

According to the Kelsey Group, the pay-per-phone-call market is expected to reach US$3.7 billion by 2010.

Why Searchengine Optimizing?

2007-01-01T06:38:00.000-08:00

There is a considerable sized body of practitioners of SEO who see search engines as just another visitor to a site, and try to make the site as accessible to those visitors as to any other who would come to the pages. They often see the white hat/black hat dichotomy mentioned above as a false dilemma. The focus of their work is not primarily to rank the highest for certain terms in search engines, but rather to help site owners fulfill the business objectives of their sites. Indeed, ranking well for a few terms among the many possibilities does not guarantee more sales. A successful Internet marketing campaign may drive organic search results to pages, but it also may involve the use of paid advertising on search engines and other pages, building high quality web pages to engage and persuade, addressing technical issues that may keep search engines from crawling and indexing those sites, setting up analytics programs to enable site owners to measure their successes, and making sites accessible and usable.

SEOs may work in-house for an organization, or as consultants, and search engine optimization may be only part of their daily functions. Often their education of how search engines function comes from interacting and discussing the topics on forums, through blogs, at popular conferences and seminars, and by experimentation on their own sites. There are few college courses that cover online marketing from an ecommerce perspective that can keep up with the changes that the web sees on a daily basis.

SEO, as a marketing strategy, can often generate a good return. However, as the search engines are not paid for the traffic they send from organic search, the algorithms used can and do change, there are no guarantees of success, either in the short or long term. Due to this lack of guarantees and certainty, SEO is often compared to traditional Public Relations (PR), with PPC advertising closer to traditional advertising. Increased visitors is analogous to increased foot traffic in retail advertising. Increased traffic may be detrimental to success if the site is not prepared to handle the traffic or visitors are generally dissatisfied with what they find. In either case increased traffic does not guarantee increased sales or success.

While endeavoring to meet the guidelines posted by search engines can help build a solid foundation for success on the web, such efforts are only a start. SEO is potentially more effective when combined with a larger marketing campaign strategy. Despite SEO potential to respond to the latest changes in market trends, SEO alone is reactively following market trends instead of pro-actively leading market trends. Many see search engine marketing as a larger umbrella under which search engine optimization fits, but it's possible that many who focused primarily on SEO in the past are incorporating more and more marketing ideas into their efforts, including public relations strategy and implementation, online display media buying, web site transition SEO, web trends data analysis, HTML E-mail campaigns, and business blog consulting making SEO firms more like an ad agency.

In addition, whilst SEO can be considered a marketing tactic unto itself, it's often considered (in the view of industry experts) to be a single part of a greater whole.[citation needed] Marketing through other methods, such as viral, pay-per-click, new media marketing and other related means is by no means irrelevant, and indeed, can be crucial to maintaining a strong search engine rank.[citation needed] The part of SEO that simply insures content relevancy and attracts inbound link activity may be enhanced through broad target marketing methods such as print, broadcast and out-of-home advertising as well.

White Hat and Black Hat SEO

2007-01-01T05:30:00.000-08:00

White Hat SEO

An SEO tactic, technique or method is considered "White hat" if it conforms to the search engines' guidelines and/or involves no deception. As the search engine guidelines are not written as a series of rules or commandments, this is an important distinction to note. White Hat SEO is not just about following guidelines, but is about ensuring that the content a search engine indexes and subsequently ranks is the same content a user will see.

White Hat advice is generally summed up as creating content for users, not for search engines, and then make that content easily accessible to their spiders, rather than game the system. In many ways, white hat SEO is very similar to web development that promotes accessibility, although the two are not identical.

Black Hat SEO

"Black hat" SEO are methods to try to improve rankings that are disapproved of by the search engines and/or involve deception. This can range from text that is "hidden", either as text colored similar to the background or in an invisible or left of visible div, or by redirecting users from a page that is built for search engines to one that is more human friendly. As a general rule, a method that sends a user to a page that was different to the page the search engined ranked is Black hat. One well known example is Cloaking, the practice of serving one version of a page to search engine spiders/bots and another version to human visitors.

Search engines can and do penalize sites they discover using black hat methods, either by reducing their rankings or eliminating their listings from their databases altogether. Such penalties can be applied either automatically by the search engines' algorithms, or by a manual review of a site.

One infamous example was the February 2006 Google removal of both BMW Germany and Ricoh Germany for use of deceptive practices. However, both companies quickly apologized, fixed the offending pages, and were restored to Google's list.

SEO and Searchengine Partnership

2007-01-01T05:27:00.000-08:00

The first mentions of Search Engine Optimization do not appear on Usenet until 1997, a few years after the launch of the first Internet search engines. The operators of search engines recognized quickly that some people from the webmaster community were making efforts to rank well in their search engines, and even manipulating the page rankings in search results. In some early search engines, such as Infoseek, ranking first was as easy as grabbing the source code of the top-ranked page, placing it on your website, and submitting a URL to instantly index and rank that page.

Due to the high value and targeting of search results, there is potential for an adversarial relationship between search engines and SEOs. In 2005, an annual conference named AirWeb was created to discuss bridging the gap and minimizing the sometimes damaging effects of aggressive web content providers.

Some more aggressive site owners and SEOs generate automated sites or employ techniques that eventually get domains banned from the search engines. Many search engine optimization companies, which sell services, employ long-term, low-risk strategies, and most SEO firms that do employ high-risk strategies do so on their own affiliate, lead-generation, or content sites, instead of risking client websites.

Some SEO companies employ aggressive techniques that get their client websites banned from the search results. The Wall Street Journal profiled a company that allegedly used high-risk techniques and failed to disclose those risks to its clients. Wired reported the same company sued a blogger for mentioning that they were banned. Google's Matt Cutts later confirmed that Google did in fact ban Traffic Power and some of its clients.

Some search engines have also reached out to the SEO industry, and are frequent sponsors and guests at SEO conferences and seminars. In fact, with the advent of paid inclusion, some search engines now have a vested interest in the health of the optimization community. All of the main search engines provide information/guidelines to help with site optimization: Google's, Yahoo!'s, MSN's and Ask.com's. Google has a Sitemaps program to help webmasters learn if Google is having any problems indexing their website and also provides data on Google traffic to the website. Yahoo! has Site Explorer that provides a way to submit your URLs for free (like MSN/Google), determine how many pages are in the Yahoo! index and drill down on inlinks to deep pages. Yahoo! has an Ambassador Program and Google has a program for qualifying Google Advertising Professionals.

Getting into search engines' databases

2007-01-01T05:12:00.000-08:00

Today's major search engines, by and large, do not require any extra effort to submit to, as they are capable of finding pages via links on other sites.

However, Google and Yahoo offer submission programs, such as Google Sitemaps, for which an XML type feed can be created and submitted. Generally, however, a simple link from a site already indexed will get the search engines to visit a new site and begin spidering its contents. It can take a few days or even weeks from the acquisition of a link from such a site for all the main search engine spiders to begin indexing a new site, and there is usually not much that can be done to speed up this process.

Once the search engine finds a new site, it uses a crawler program to retrieve and index the pages on the site. Pages can only be found when linked to with visible hyperlinks. For instance, some search engines are starting to read links created by Flash (for example, Google).

Search engine crawlers may look at a number of different factors when crawling a site, and many pages from a site may not be indexed by the search engines until they gain more PageRank, links or traffic. Distance of pages from the root directory of a site may also be a factor in whether or not pages get crawled, as well as other importance metrics. Cho et al.[17] described some standards for those decisions as to which pages are visited and sent by a crawler to be included in a search engine's index.

A few search engines, such as Yahoo!, operate paid submission services that guarantee crawling for either a set fee or CPC. Such programs usually guarantee inclusion in the database, but does not guarantee specific ranking within the search results.

SEO Basics (II)

2007-01-01T05:09:00.000-08:00

Google was started by two PhD students at Stanford University, Sergey Brin and Larry Page, and brought a new concept to evaluating web pages. This concept, called PageRank, has been important to the Google algorithm from the start. PageRank is an algorithm that weights a page's importance based upon the incoming links. PageRank estimates the likelihood that a given page will be reached by a web user who randomly surfed the web, and followed links from one page to another. In effect, this means that some links are more valuable than others, as a higher PageRank page is more likely to be reached by the random surfer.

The PageRank algorithm proved very effective, and Google began to be perceived as serving the most relevant search results. On the back of strong word of mouth from programmers, Google quickly became the most popular and successful search engine. PageRank measured an off-site factor, Google felt it would be more difficult to manipulate than on-page factors.

Despite being difficult to game, webmasters had already developed link building tools and schemes to influence the Inktomi search engine, and these methods proved similarly applicable to gaining PageRank. Many sites focused on exchanging, buying, and selling links, often on a massive scale. This has spawned an online industry, that survives to this day, focused upon selling links designed to improve PageRank and link popularity, and not to drive human site visitors, with links from higher PageRank pages selling for the most money.

A proxy for the PageRank metric is still displayed in the Google Toolbar, though the displayed value is rounded to be an integer, and the toolbar is believed to be updated less frequently and independently of the value used internally by Google. In 2002 a Google spokesperson stated that PageRank is only one of more than 100 algorithms used in ranking pages, and that while the toolbar PageRank is interesting for users and webmasters, "the value to search engine optimization professionals is limited" because the value is only an approximation. Many experienced SEOs recommend ignoring the displayed PageRank.

Google — and other search engines — have, over the years, developed a wider range of off-site factors they use in their algorithms. The Internet was reaching a vast population of non-technical users who were often unable to use advanced querying techniques to reach the information they were seeking and the sheer volume and complexity of the indexed data was vastly different from that of the early days. Combined with increases in processing power, search engines have begun to develop predictive, semantic, linguistic and heuristic algorithms. Around the same time as the work that led to Google, IBM had begun work on the Clever Project, and Jon Kleinberg was developing the HITS algorithm.

As a search engine may use hundreds of factors in ranking the listings on its SERPs; the factors themselves and the weight each carries can change continually, and algorithms can differ widely, with a web page that ranks #1 in a particular search engine possibly ranking #200 in another search engine, or even on the same search engine a few days later.

Google, Yahoo, Microsoft and Ask.com do not disclose the algorithms they use to rank pages. Some SEOs have carried out controlled experiments to gauge the effects of different approaches to search optimization. Based on these experiments, often shared through online forums and blogs, professional SEOs attempt to form a consensus on what methods work best, although consensus is rarely, if ever, actually reached.

SEOs widely agree that the signals that influence a page's rankings include:

1. Keywords in the title tag.
2. Keywords in links pointing to the page.
3. Keywords appearing in visible text.
4. Link popularity (PageRank for Google) of the page.

There are many other signals that may affect a page's ranking, indicated in a number of patents held by various search engines, such as historical data.

SEO Basics (I)

2007-01-01T04:53:00.000-08:00

Webmasters and content providers began optimizing sites for search engines in the mid-1990s, as the first search engines were cataloging the early Web. Initially, all a webmaster needed to do was submit a site to the various engines which would run spiders, programs that "crawled" a page and stored the collected data in a database.

The process involves a search engine spider downloading a page and storing it on the search engine's own server, where a second program, known as an indexer, extracts various information about the page, such as the words it contains and where these are located, as well as any weight for specific words, as well as any and all links the page contains, which are then placed into a scheduler for crawling at a later date.

At first, search engines were supplied with information about pages by the webmasters themselves. Early versions of search algorithms relied on webmaster-provided information such as the keyword meta tag, or index files in engines like ALIWEB. Meta-tags provided a guide to each page's content. But indexing pages based upon meta data was found to be less than reliable, mostly because webmasters abused meta tags by including keywords that had nothing to do with the content of their pages, to artificially increase page impressions for their Website and increase their Ad Revenue. Cost Per Impression was at the time the common means of monetizing content websites. Inaccurate, incomplete, and inconsistent meta data in meta tags caused pages to rank for irrelevant searches, and fail to rank for relevant searches. Search engines responded by developing more complex ranking algorithms, taking into account additional factors including:

Text within the title tag
Domain name
URL directories and file names
HTML tags: headings, emphasized and strongly emphasized text
Term frequency, both in the document and globally, often misunderstood and mistakenly referred to as Keyword density
Keyword proximity
Keyword adjacency
Keyword sequence
Alt attributes for images
Text within NOFRAMES tags
Web content development

Today the only major search engine which says it considers meta keywords in its ranking algorithms is Yahoo, though most experts feel that even there the attention paid to meta keywords is minimal. Most SEO-experts however claim that the "description" tag is far more important.

Web content providers also manipulated a number of attributes within the HTML source of a page in an attempt to rank well in search engines.

By relying extensively on factors that were still within the webmasters' exclusive control, search engines continued to suffer from abuse and ranking manipulation. In order to provide better results to their users, search engines had to adapt to ensure their SERPs showed the most relevant search results, rather than useless pages stuffed with numerous keywords by unscrupulous webmasters using a bait-and-switch lure to display unrelated web pages. This led to the rise of a new kind of search engine.

Search Engine Optimization (SEO)

2007-01-01T04:50:00.000-08:00

Search engine optimization (SEO) as a subset of search engine marketing seeks to improve the number and quality of visitors to a web site from "natural" ("organic" or "algorithmic") search results. The quality of visitor traffic can be measured by how often a visitor using a specific keyword leads to a desired conversion action, such as making a purchase or requesting further information. In effect, SEO is marketing by appealing first to machine algorithms to increase search engine relevance and secondly to human visitors. The term SEO can also refer to "search engine optimizers", an industry of consultants who carry out optimization projects on behalf of clients.

Search engine optimization is available as a stand-alone service or as a part of a larger marketing campaign. Because SEO often requires making changes to the source code of a site, it is often most effective when incorporated into the initial development and design of a site, leading to the use of the term "Search Engine Friendly" to describe designs, menus, Content management systems and shopping carts that can be optimized easily and effectively.

A range of strategies and techniques are employed in SEO, including changes to a site's code (referred to as "on page factors") and getting links from other sites (referred to as "off page factors"). These techniques include two broad categories: techniques that search engines recommend as part of good design, and those techniques that search engines do not approve of and attempt to minimize the effect of, referred to as spamdexing. Some industry commentators classify these methods, and the practitioners who utilize them, as either "white hat SEO", or "black hat SEO". Other SEOs reject the black and white hat dichotomy as an over-simplification.

SEM an Ethic

2007-01-01T04:08:00.000-08:00

Many forms of search engine optimization only amount to ensuring compliance to search engines' guidelines for inclusion and removing any technical barriers that might keep the website from reaching a proper ranking. However, other methods of search engine optimization such as keyword spamming are often viewed as "gaming the system" and considered unethical. See the article on search engine optimization for details.

Displaying advertisements or sponsored results in an area visually separated from the algorithmically determined results is generally considered ethical. However, some search engines allow the ranking of a website to be influenced with a payment and provide little or no indication to the end-user that this has happened. Since the search engines give the impression or claim that the rankings reflect the relevance or popularity of the websites, this is often seen unfair or deceptive.

Search engine advertising products that don't guarantee a specific ranking or an amount of visibility are seen as unethical by some search engine marketers. The product might provide an unspecified "boost" or the final ranking or visibility might be a result of an auction.

Paid inclusion has not caused much concern. However, it has been suggested that search engines should improve the speed they pick up new websites and that paid inclusion services thus create a conflict of interest that discourages improving service levels across the board.