Showing posts with label Search Engine Optimization. Show all posts
Showing posts with label Search Engine Optimization. Show all posts

Monday, February 18, 2008

Make the Most of SEO Competitive Research : Evaluating the Competition

Why bother about your competitors? Well, a stupid question, I know. You can’t possibly think that you can enter a new niche and get on top without looking into what has been done before you. When done properly, competitor analysis will answer your most important strategic planning questions:

  • Is it worth trying to enter this niche? Will I be able to overdo my competitors? How fast? Will long and hard victory be worth the effort? What’s my expected ROI?
  • What should I do to succeed in this niche? What shouldn’t I?
  • Who are my perspective readers/customers? What are they used to? What do they like?
  • Well, and many more, but I will stop here for now not to miss the point.

Step 1. Evaluating your overall competition.

You can either do it ‘at home’ using Google search and Excel or try paid tools returning complete competitor’s report. I usually perform all possible ways of analysis because I (1) cannot fully rely on reports compiled by someone else (be it an automatic tool or another person); (2) do not feel I have the full understanding of a niche unless I spend long hours on searching Google and compiling data into tables (yep, preferably multiple ones, and then combining tables into one table; but that’s just me, you can safely get along with a single solid report).

The idea is simple: you throw all your keywords into a spreadsheet and add the following information:

  1. Google daily/monthly estimated reach (I was using data provided by Aaron’s keyword research tool);
  2. Overall number of results in Google (broad match);
  3. The site ranked #1 for each term;
  4. Number of results for [intitle:keyword];
  5. Number of results for [inanchor:keyword];
  6. Number of results for both [intitle:”keyword” and inanchor:”keyword”] (hat tip to Ciaran) - this is your exact competition, i.e. those who use SEO (optimized titles and incoming links anchor text).


To save time you can get this information via SEOMoz keyword difficulty tool (it will also provide you with lots of other useful information: average PageRank of the top 10 sites, how many root URLs can be found in top 10 results, etc). Naturally, the best combination is when #1 is high, #2 is low (not necessarily) and #4, #5 and #6 are the lowest possible - the cases framed in green:



Step 2. Finding your direct competitors

After you compiled your targeted keyword list, you can sort by ‘#1 in G‘ column and see the sites that is most often ranked high in Google for your chosen keywords:



Be sure to explore your most successful competitor’s on-site optimization: titles, H1 and H2 tags, internal site architecture, etc. I have singled out two approaches that help me to perform this kind of analysis:

  1. Don’t be too skeptical. Unfortunately most often experienced SEOs analyzing onpage optimization think they can do much better. This thought can bring you to wrongful conclusions.
  2. Learn from their mistakes. (I know, this somehow interferes with the first one, so the most important is balancing between the two.) We all know how to do it right. So analyzing what a competitor did well doesn’t help a lot. The art of seeing mistakes and at the same time being able to keep from underestimating (see #1) always brings to the right solution in the end.

And now a few tools that can also prove helpful:

1. Google Adwords Keyword Tool (free) is useful for comparing Google advertisers’ competition data and your own findings and also for differentiating commercial terms from non-commercial ones. Keywords enjoying high advertisers‘ competition are most likely targeting potential customers (while more informative [and hence less competitive] phrases usually attract people who are collecting information rather than are really willing to buy). A good way to overcome high competition while sticking to more commercial phrases is to turn (moderately) commercial phrases into long tail (e.g. per our table: ‘Tennessee fsbo‘ into ‘townsend Tennessee fsbo‘).

2. Compete.com (paid with a few trial searches) also provides some helpful type of analysis that can help you to evaluate your competition:

  • “Keyword Share” shows the percentage of total referrals a site receives from a particular keyword compared to its other referrals (= this keyword referrals/other keywords referrals).
  • “Keyword Engagement” shows the average time visitors tend to spend on the site after being referred by this keyword.
  • “Keyword Effectiveness” all people referred by this term/total time spent on the site.

While these metrics represented by Compete.com look really promising and useful, I mostly use them for self-education and out of curiosity - just because I am more used to ‘old school’ method of looking into my referrals and learn people’s actual behavior in practice. However this can still be very useful for learning the competitors’ referrals and visitors’ [probable] behavior.

Next time I will look into most effective ways of analyzing competitor’s link building strategies. So stay tuned!


Source: http://www.searchenginejournal.com/make-the-most-of-seo-competitive-research-evaluating-the-competiton/6386/

Saturday, February 16, 2008

The Great Nofollow Link Debate of '08

Three years ago Google introduced the rel="nofollow" tag to the Web. A benign title to anyone who has never run a blog and experienced the headache, "Preventing comment spam" promised future bloggers comment spam would be greatly devalued by this simple tag. The reason being, this little bugger would effectively kill the SEO value of any link "protected by it."

The new nofollow tag quickly became known as a "link condom," and experts at conferences across the world started hailing it for its simple yet powerful purpose. One of the people involved in the comment spam fighting problem within Google was an unknown engineer named Matt Cutts, now Google's famous, unofficial chief Web spam fighter. (Ironically, Google thinks "spamfighter" should be one word, yet when you search the Matt Cutts-related results still outrank spamfighter.com -- ah the power of the SEO (define) community is strong).

Matt's "next little ditty" came out in September 2005 on his personal blog post that sentenced link sellers to eternal damnation. He laid out a compelling argument that buying links solely for PageRank value was polluting the Web. Publishers started using nofollow tags to show Google selling links wouldn't be based on the SEO value of the publisher's site to the buyer's site.

The Nofollow Evolution

While the paid links debate raged on, the nofollow attribute was quietly becoming used for more than just blocking outbound links. Before we go there, let's check in during early 2007 when Sebastian "X" asked if we really need this attribute after all. Sebastian succinctly highlighted the apparent shortcomings of the tag, and expressed the frustration felt by many this tag was worthless when it came to stopping blog spam. Beyond that, there was confusion as to its real purpose, he said.

Not surprisingly, the "link condom" attribute -- much like the occasional cheap or damaged contraceptive device -- doesn't always work. Some feel Google still follows links and, in some cases, might not even strip the "juice" out based on the trust of the landing domain, still assigning value based on the anchor text.

Tests I've tried have been statistically inconclusive so far. I've noticed nofollow links at Wikipedia are scraped, dropping the attribute but keeping the link. (No names in order to protect the innocent.)

Spammers were still spamming, links were still being sold, and at least one war in the Middle East was still going on. Sebastian hinted at a better use for the tag -- specifically to instruct spiders (define) not to crawl printer friendly version of pages. Turns out a new revolution led SEOs to turn their nofollow focus inward.

The Nofollow Revolution

Eric Lander started an interesting debate about nofollow use triggering search engine algorithms (define) to detect spammy sites. This theory has almost no legs to stand on. SEOs, though, certainly haven't forgotten about this little tag.

SEOs have been secretive about their use of nofollow. (I may in fact be hunted down for this post.) SEOs know nofollow lessens "PageRank dilution" that occurs between internal pages of a site. The idea, in a nutshell: if search engine ranking algorithms devalue administrative pages (privacy policy, TOS, contact us), no SEO value should be delivered from external links.

Often a home page gathers many inbound links. Focusing the links on the most important secondary and deeper site pages benefits internal pages with a relatively low number of inbound links.

Some people find this practice effective. I've tested it and I'm not completely sold yet. One commenter on Lander's post (who happens to work with me) took apparent offense at the idea the nofollow could not be used to help "craft the flow of Internal PageRank."

Bottom line: The rel="nofollow" attribute is here to stay, and a few more years of testing and a few dozen search engine algorithms updates from now, it will likely have far different value than it holds today. An interesting tag started on a simple enough mission to rid the world of spammers has evolved into a tool to be used wisely and tested consistently. Please join us for discussion on this topic in the Search Engine Watch Forums.

Frank Watson Fires Back

Frank Watson: The initial intention of the nofollow tag was good -- but the option was that bloggers could use the tag as they saw fit. The problem now is that Google is forcing people to use the tag.

As Michael Gray pointed out, "Google is not the government." Google isn't even the Internet police. Yet the fact that Google is the source of the largest part of Web traffic forces people to follow their edicts.

Google may cause greater government intervention on the Web. Given Google's dominant share of Web searches and traffic, governments around the world may view this as a form of monopoly and start regulating Google, as they review the purchase of DoubleClick.

Will there be an antitrust case eventually brought by someone who lost his source of income by a change Google makes to their algorithm? Let's wait and see.


Source: http://searchenginewatch.com/showPage.html?page=3628452

Friday, February 15, 2008

Multi-National Search Marketing: Effective Strategies for Global Marketers

Yesterday, Chris Sherman from Search Marketing Now presented another webinar jammed packed with useful information. This session entitled ‘Multi-National Search Marketing: Effective Strategies for Global Marketers‘ was sponsored by iProspect and moderated by Claire Schoen.

Chris was a perfect speaker due to his experience covering search and search engines since 1994. He is the author of several books, including ‘Google Power’.

Chris started out the presentation by outlining that he’ll cover why we might want to go global, what types of campaigns work best and how to do it.

The first slide discussed the fact that a lot of people perceive that Google has taken over the earth. Yes, Google is dominant and if you are running a search marketing campaign, you understand that Google’s reach can give you that global coverage. Chris said we may ask ourselves why should we should bother going multinational since Google has a global reach. But, Chris believes there are other opportunities out there.

The market share and what the reality really is.....

comScore does a monthly report on worldwide search share. Google does have the dominant share - about 63% - that’s just under 2/3 of all the market share worldwide. Despite the all the media about the Yahoo/Microsoft merge, the reality is that Yahoo worldwide, they are number one in terms of the number of people who visit them. In terms of search - they are number 2. If you aren’t using Yahoo, you could be missing out on certain benefits - particularly worldwide.

The number 3 player is Baidu.com - they are the dominant player in China. Over time as the Internet expands in China, Chris believes those numbers for Baidu will go in the double digits very quickly.

There is a tie for number 4 - Microsoft sites and NHN Corp. Finally, the other 90+ search engines have a 13% market share. If you actually start drilling down you’ll find some of these players are dominant in certain regions.

Key Players (source comScore)

  • Google totally dominates North America and most of Europe.
  • Yahoo is dominant in Asia, except for:
    • China (Baidu 61%, Google 20%)
    • South Korea (Naver 74%, Google 4%)
    • Russia (RIndex 57%, Google 23%)
Why Go Global

Almost 1/6 of the population is out there searching and doing about 61 billion searches per month. If you drill down, 75% of all searches are outside North America. To Chris, that is the most compelling reason you want to consider doing a multinational search marketing campaign.

To Translate or Not

Chris posed the big question…‘do we have to go through the details of translating?’

  • Depends on your goals. You can have a strictly English campaign and it will work best for global brands and products with the same name in all cultures.
  • An alternative is to mix campaigns that mix and match English and target market language (keywords, ads, creative landing pages, etc). Takes a bit of experimenting to discover what works best with this mixed approach.
Key: Search Behavior

  • Varies from country to country.
  • Chris discussed how people use different search terms, have different eye tracking, and result scanning patterns, different click through styles. Studies have proven the differences between North American searchers and others - like those from China.
  • This means you will likely need to do translation, search optimization and cultural optimization. You need to make your content appealing to the search engines and the searchers through their various needs that they are expressing through their search behaviour.
PPC or SEO or Both

  • Chris counseled us that if we are going multinational, we will have to commit a reasonable amount of resources to ensure the campaign is successful. Even before we being, we should consider whether a paid search or natural search campaign is more likely to be effective in a given market.
  • Sherman feels that in larger markets - you are probably o.k. to do either - or both if you have the resources.
  • However, for smaller markets, you should consider each individually. (In smaller countries where you could be targeting the millions or hundreds of thousand of people - you need to carefully consider who is the market leader in those countries).
Targeting Your Markets
  • Use your marketing department to carefully weigh the probability of ranking with both country size and internet reach. Remember that Internet reach varies greatly (example, China is under 20% while other countries have much greater Internet reach - but with a smaller population).
  • Do you have sales and logistics resources in a market? May not need them and may be able to successfully do it all online, but if you can’t you need to have the resources in place.
  • Are we able to handle shipping, different currencies, duties and taxes?
  • What about support? Do our support people speak the language? People may want to call or send an email. Do we have the people in place to handle this?

All of these things will impact whether the search marketing campaign can be successful.

Process

  • First thing is to find good translators
    • Must know local idioms (need to understand the local dialect, terms etc).
    • Must be able to translate unique or technical terms for your product, service or brand
  • Translate text, images and navigation. A lot of people overlook translating images and navigation - you need to make the user experience rock solid.
  • Crucial - Make sure SEO is involved from the beginning. Don’t want to do SEO as an afterthought - get them involved right from beginning so that you’ll end up with a more effective website and the SEO specialists can help you avoid potentially costly mistakes.
Optimized Translated Content
  • Chris warned us that English content that’s optimized does not automatically become search friendly when translated. Translation is an art and may alter the content in such as way that it doesn’t rank well at all in your target market.
  • Similarly, you can’t simply translate English PPC ads and landing pages.
  • Tip: Translate your keyword list first, before any other content. Get a good sense of those critical keywords that you are hoping to capture with the searchers.
The Long Tail Varies
  • The long tail means targeting less common keywords or phrases - that long tail exists in all other languages but it is not the same in all other languages.
  • Romance language searches tend to use fewer, more common words.
  • English & Dutch/German searchers tend to use more terms and less common terms. Right now, long tail will probably be more effective in those languages.
  • Paradox? In the UK - nine keywords account for 5% of all searches.
What About Duplicate Content
  • Chris said he is often questioned about duplicate content in multinational campaigns. If you have the same language content on multiple servers in different countries, you may be subject to duplicate content penalties. Be aware, but don’t necessarily be alarmed. They may only be trying to find the main source of your content, regardless of where you are located in the world. However, if you are finding that search engines are getting confused, you may need to do some work changing content, or putting it into other formats etc. Really boils down to your individual situation.
  • Content translated into different languages and hosted in different countries is not duplicate content to search engines (at least today…) May change but today isn’t a concern.
The Right Domain

What should the right domain be - a dot.com or a country specific domain?

  • Boils down to your intent. If possible, go for both - especially for companies trying to target regions with regional pride, you will want to go for country specific domain.
  • For example, IBM has one global website, with subdomains for individual countries.
  • Sony, by contrast has local domains in all countries.
  • Be careful of those ‘choose your country’ top level pages! If you have a dot.com and are going to redirect to another country - don’t make those pages search engine hostile! You want the search engine to be able to find the country specific domains. Make sure navigation on homepage - no matter what you do with it -better not block the crawlers from finding the content on all the different websites you create.
IP Address COnsiderations

IP Address gives the physical location of where the server is based.

  • Chris said he has found that when search engines are ranking content, they will look at the IP address to decide whether it should give more weight in country specific results to sites with local IP addresses.
  • Challenge: legal or residency requirements in some countries. In some cases, you may need to prove you have some legal presence in that country before you can get a local IP address.
  • Google’s webmaster tools allow you to specify country, and Microsoft says this capability is coming.
Crucial - Localized Links
  • Localized links are crucial when you are going into a multinational campaign. It is not enough to translate and set up a site in a different country.
  • As with any site, it needs links pointing to it to rank well in search engines.
  • And most of these links need to come from local authority sites, not from the mother ship or out of country sites.
Multi Country PPC
  • Can be the most cost effective way to have multinational reach.
  • Geotargeting can be very precise.
  • Translate both ads and landing pages.
  • Use PPC as a research tool to help identify most effective keywords in a specific language/country.
Global Brands in Multiple Countries

  • For global brands in multiple countries, Chris suggested we trust the offline brand experts here.
  • Some cultures like and accept global brands (ex. China) - others prefer homegrown, localized brands.
  • Especially important - emphasizing brand attributes in a culturally appropriate way. You have to be sensitive to that and don’t neglect images!
Consider Smaller Markets

  • PDF report ‘Global Search Report 2007′ by einternet is available online and has a wealth of information.
  • Ex. China is on track to become the number one in terms of searches on the Internet but they have a low penetration of the population. Conversely, Denmark has 70% penetration and there is another search engine beyond Google that is popular. Report is full of good information that can help companies choose smaller markets.
Conclusion
  • Chris concluded by stating that multinational search marketing offers a very appealing way to reach more customers, but it is not for everybody.
  • Success requires deep, localized knowledge of markets. If you don’t have that knowledge, you need to reach out to a partner that has that knowledge.
  • Campaigns must be optimized and tailored for both language and culture. Not enough just to take optimized content, translate, and expect it to work in another country. Have to tailor that information for the language and culture you are trying to target.

After this very informative presentation, there were a few minutes for questions.

How would we find out about legal residency requirements? - If you are trying to establish a site in a specific country, the hosts in that country will spell out what is require. For example, in Australia you need an Australia Business Number. Go directly to a particular host based in a country and find out the requirements that are necessary to actually register a site there.

How do you find translating services in a specific country? You can go on the web and find translation services, the key there is to get a translation service that can also work with an optimizer. The best thing to do is seek out a local SEM firm or a global SEM firm and see what they can do because they are probably going to have the contacts to do this type of work. Do not rely on automated translation systems - these are rough only and will backfire in an overall search marketing campaign.

Directories? They are emerging as a good resource and they are gradually becoming better at accommodating advertising needs. Directories are very good if you have the time and resources to find the good ones. They can give you very good reach for not a lot of cost/effort.


Source: http://www.10e20.com/blog/2008/02/13/multi-national-search-marketing-effective-strategies-for-global-marketers/

24 Metasearch Engines for Centralized & Efficient Searching

Metasearch engines have risen up the web through the years and continue to grow in numbers, even in the current Google dominated search world.

Companies who create their own versions of metasearch engines must have given up on trying to compete with Google and the other top search engines, and instead take advantage of the API’s and technologies available via the big three or four search technologies, integrating that data into one interface with a unique spin on ranking or listings formats.

Here at the Journal, we’ve been featuring some of these metasearch engines; especially the new ones. But we won’t be able to cover them all (although we try).

So the best we could do is come up with a list of these metasearch engines, made up of metasearch startups and others have been around for quite some time now.

It is not however a comprehensive list, as we know that there are still more out there. If you know of other metasearch engines, please feel free to add them in the comment. We will continuously update the list as we receive more comments.

Wikipedia entry defines a meta-search engine as a search engine that sends user requests to several other search engines and/or databases and aggregates the results into a single list or displays them according to their source.

  1. MetaCrawler - Uses innovative metasearch technology to search the Internet’s top search engines, including Google, Yahoo! Search, MSN Search, Ask Jeeves, About, MIVA, LookSmart and more. Search refinement available.
  2. Dogpile -Puts the power [of] all the leading search engines together in one search box to deliver the best combined results. Toolbar download available.
  3. Mamma - “The mother of all search engines”,
  4. IxQuick - “The world’s most powerful metasearch engine”, includes universal power search, global search and search refinement. Toolbar download available.
  5. kartOO - A visual meta search engine that instead of showing up traditional search results pages, displays a graphical map of search results. Honestly, I don’t get the point.
  6. Ithaki - Search various search engines and ranks results based on an internal ranking system.
  7. Seekz - A parallel web search engine that queries many of the Internet’s top search engines and displays results in groups with the most relevant website appearing first. Removes duplicate results as well.
  8. iBoogie - Puts documents with similar content or with related topics into the same group. Each group is assigned a label based on the content of the documents.
  9. Zuula - Provides search unaltered search results from various search engines giving users the chance to check them first before going to results from individual search engines. And it even remembers which search engine you have been to so you can easily switch back and forth. Sponsored links are separated.
  10. inCrawler - A metasearch engine and a web directory in one. Works like your traditional search portal where categories are displayed upfront just below the search toolbox.
  11. WindSeek - Pulls results from many of the major search engines simultaneously with lightning speed and accuracy.
  12. Seek2Day - Gathers results from 17 different major search engines and in a very quick way decides which information is most relevant to the user. The results are then presented in a comprehensive format.
  13. ez2Find - a Global meta search engine that searches AlltheWeb, Teoma, Google, Yahoo!, AltaVista, Wisenut, ODP, and MSN, parse the results, remove the duplicates, include links to relevant directory categories (directory results from the Open Directory) and to clustered results. Calculate result relevance by an algorithm that count the number of time the link was found in the search engines and its position on them.
  14. Vroosh - VROOSH.com is a metasearch engine that also acts as a metacrawler utilizing fast parallel technology for speed and accuracy. Metasearch using Keywords in any language, use Advanced Search to search in a specific Country or metacrawler for MP3,and FTP sites.
  15. qkSearch - calls itself a 3-in-1 meta search engine by providing clustering search, split search and blended search (not functional yet).
  16. TurboScout - search 21 search engines without retyping the search engine name. To limit your search into one search engine, all you have to do is enter your keyword and click on the name of the specific engine.
  17. FinQoo - the next generation meta search engine that lets you search, share and share summarize. It doesn’t have an about page yet though, so I’m wondering whose responsible for it. The Philippine flag right up the search box, probably made by some Filipino tech guys.
  18. Polymeta - an intelligent and advanced meta search and clustering engine that enables organizations and individuals to simultaneously search diverse information resources on the web with a common interface. Search results are merged, ranked and presented in relevance order. Uses a natural language processing and information retrieval algorithms in its query analysis and search result refinement.
  19. Unabot - Unabot is all-in-one meta search site that allows the user to choose from hundreds of different search engines, directories, and indices to query.
  20. vPinPoint - is a parallel search engine that searches Google, Yahoo, MSN and Ask.
  21. Draze - crawls various search engines and let users compare search results.
  22. SearchSalad - Search Salad brings together results from the top search engines and also from the major review sites all in one place giving you the ability to see the top results from the major sites all at once. This combined with Search Salad’s customised search environment means that you see the best of what the web can offer in terms of search.
  23. Clusty - Clusty queries several top search engines, combines the results, and generates an ordered list based on comparative ranking. This “metasearch” approach helps raise the best results to the top and push search engine spam to the bottom.
  24. AllPlus - searches four major search engines namely, Google, Yahoo, Live and Ask.

Source: http://www.searchenginejournal.com/24-metasearch-engines-for-centralized-efficient-searching/6375/

Paid and organic search trends

One of the most powerful Hitwise tools is our paid and organic search data. We’ve been analyzing this and have come up with some interesting trends for the travel and retail industries. Before I get into the analysis; a quick note on the methodology. This paid search data represents a weighted average of the proportion of upstream traffic from paid search to twenty leading sites in our Travel and Shopping & Classifieds categories – i.e. it illustrates the percentage of each industry’s traffic come from paid search. The chart below illustrates the proportion of upstream traffic that these two industries receive from paid search over the 15 months to last December.


So what does the data say? The first thing that jumps out that is that the travel industry is more reliant on paid search than the retail industry. The retail industry actually receives more traffic overall from paid search, but this is simply because it receives more visits full stop. Proportionally, travel websites receive on average 50% more traffic from paid search than Shopping and Classifieds sites.

The second interesting conclusion relates to peaks and troughs in paid search traffic, which I’ve summarized in the table below. As you can see from the chart, the level of paid search activity in both industries is anything but consistent during the year. Naturally, traffic to sites in our Shopping and Classifieds category peaks during November and December, and this is also the period when search traffic in general to the category peaks. However, paid search activity peaks slightly earlier – the two biggest months are November and December – implying that retailers rely more on paid search during the pre-Christmas browsing / research period than during the peak purchasing weeks in December. On the other hand, paid search activity is at its lowest in the summer months, which coincides with the quietest period for the retail sector.


The travel industry experiences two peaks in traffic. Its busiest period is after Christmas, when people flock online to book their summer holidays, while there is a second peak during the summer months as people visits sites for information, check-in facilities and last minute travel. What the paid and organic search data reveals for this sector is very interesting. Search drives most traffic overall during the summer months, but this peak is primarily driven by organic (or natural) search. The peak for paid search happens during the Autumn as people return to work after the summer, and their thoughts again turn to the prospect of warmer climates.

So, although the travel and retail industries experience peaks and troughs in paid search at different times, there is actually a common theme. Paid search activity peaks during the key ‘research’ period in the buying cycle – i.e. in the months before the surge in visits and purchases. This would imply that paid search is more effective if used earlier in the purchasing cycle.

The other question we wanted to answer in this analysis was: is paid search becoming more or less important? As the chart below illustrates, the answer to this question depends on which industry you’re talking about. The travel sector received significantly more traffic from paid search in the last three months of 2007 than in 2006. This is driven by two factors: a growth in the amount of traffic that the category receives from search overall, and the fact than an increasing proportion of this search traffic (40% in December 2007) comes from paid search.


As you can see from the chart, the opposite is true for retailers. The amount of traffic that sites in our Shopping and Classifieds category receive from paid search decreased during the final quarter of last year. The interesting thing about this trend is that there was actually an increase in traffic from search to the sector during December, implying that retailers are switching from paid to organic search strategies. 29% of search traffic to our selection of 20 top retailers was paid in December 2007, down from 31% in 2006.


Source: http://weblogs.hitwise.com/robin-goad/2008/02/paid_and_organic_search_trends.html


Wednesday, February 13, 2008

What is your robots.txt file telling your competitors about you?

Have you ever thought about your robots.txt file, beyond how the various crawlers interact with it? Chances are that if you have one, you probably haven’t looked at it in since the day you created it. Well, it is time you take a fresh look at it and see how it looks not just to a bot’s eyes, but look at it through the eyes of a competitor.

You would be surprised at the number of sites and companies who use their robots.txt file as a way to keep bots out of certain directories on their site, but not considering the fact they have just pretty much handed the keys to those private areas over to their competitors. How? Because many people create their robots.txt file thinking that if the bots aren’t indexing those pages, no one will find it… but when you include those directories in your robots.txt file, you are telling real people exactly where those directories are. And surprisingly, many of those “secret” directories allow competitors to access it without requiring any kind of authentication or password.

Another thing people often give away in their robots.txt file is what they are working on adding to the site, even if they haven’t officially announced it yet. And of course, since webmasters are thinking future SEO value even in pre-launch, the directory names are always very telling because they are often keyword rich. One client was able to launch an entire section to their site because they noticed their competitor was doing something very similar when the directory popped up in the competitor’s robots.txt file but before they had either announced it or officially added it to the site. And like any good businessperson, my client beat them to the punch and launched it first. If only that competitor hadn’t jumped the gun by robots.txt-ing it, my client would have been none the wiser until launch day.

When you are working on something that you plan to launch in the future - especially launch with a splash to get publicity on it, don’t put it in your robots.txt file… all you need is a competitor to come along and see your robots.txt entry to discover what you are working on (and worse yet, if you end up having that directory open so they can spy on all your work-in-progress) and then launch their own copy of it first. Ideally, it should be completely password protected or done on a test domain that isn’t connected to your site.

Don’t want to worry about what your competitors are seeing in your robots.txt file? Carefully look at it and see what it is revealing. Do you have a super secret directory listed on there? Remove it from the robots.txt file, password protect those pages and add the no robots meta tag on those pages for good measure.

Are you working on something new for the site but haven’t announced or launched it yet? Again, password protect it or move it to a completely different unassociated domain you can lock down with robots.txt (since hopefully your competitor won’t know about that site). Or the best solution is to simply leave it offline except for brief testing periods pre-launch. This means if you want to check how it is working online, you upload it for only the amount of time you need to see it, and then delete it off the server.

Play it smart with your robots.txt file so you don’t inadvertantly hand your competitors the keys to your site or give them the edge up by alerting them to what you are working on. And for fun, check out some of your competitor’s robots.txt files… you can usually find something interesting on at least one or two of them.


Source: http://www.jenniferslegg.com/2008/02/12/what-is-your-robotstxt-file-telling-your-competitors-about-you/#more-56

9 Tips for Creating a Site Map for Visitors and Spiders

Not every site needs a site map, they can certainly be a good idea. Site maps provide a dual purpose: They provide search engine spiders easy access to all of your site pages and they provide site visitors easy access to all of your site pages. The difference is that search engines and visitors access your site map differently and therefore there are different methods that need to be applied to creating site map(s) that are friendly for both engines and search spiders.

Small sites typically don't need a site map so long as all pages are linked in the main navigation. Once you get into main and sub-navigation menu's then site maps are helpful in allowing search engines and visitors to quickly find anything they are looking for within just a couple of clicks. A single site map can be used for both purposes or multiple site maps can be created. Here we'll address creating site maps for spiders and humans separately.

Site Map For Spiders

.xml file: An .xml document should be added to your site's root directory containing links to all site pages. This .xml file should then be referenced should be compiled and placed into a proper .xml document which should be uploaded into the root directory.

Robots.txt file: With your .xml site map file in place you must then make it accessible to search spiders. Reference the site map in your robots.txt file by adding a line for sitemap: URL (example: sitemap: http://www.polepositionmarketing.com/sitemap.xml)

Keep current: Be sure that your .xml file is updated and uploaded frequently, or at least as often as pages are added or removed from your site. Large sites should implement an automated site map update monthly or even weekly or daily.

Site Map For Visitors

Navigation links: A site map designed for human visitors is just like any other website page. Link to the site map page should be included in the primary navigation or the site's global footer. Visitors should be able to find this link without too much searching.

Additional page links: Site map should also be linked from various pages within the site such as Help pages and your custom 404-redirect page. This helps point visitors to the site map as a quick and easy means to find what they need.

Overview: It's helpful to provide a short overview paragraph at the top of your site map page. This can be a nice introduction should someone land on this page directly from a search engine or elsewhere.

Heading and layout: The layout of the site map should present a clear visual hierarchal structure or your website. Both headings and sub-headings should be used above properly grouped links.

Text links & descriptions: Site map should primarily use textual links and page should not be cluttered with images or other distractions. It is also a good idea to provide an additional short description (provided there is room) for each link that allows the visitor to better understand where each link will take them.

Keep current: Be sure that your site map is updated and uploaded frequently, or at least as often as pages are added or removed from your site.

As I said above, not every site needs a site map. But those that do should be sure that the site map(s) they create are actually benefiting them. And the best way to do that is to make sure your site maps provide maximum usability for visitors and search engine spiders.


Source: http://www.searchengineguide.com/stoney-degeyter/9-tips-for-creating-a-site-map-for-visit.php

Six Steps to Conversion Health

Are you planning a site re-design? Is your landing page not converting well enough? Hopefully you've got the basics covered, and your landing page has a search function, contact information and a strong marketing message. But what else can you do to improve your conversion rate?

Once a visitor lands on your website, the clock starts ticking and you have only a few seconds to convince them to stay there, let alone make a purchase. At first glance, a user should know that they are in the right place and that their transactions will be secure. Sound daunting? With only a few easy changes, you can convert more visitors. Consider these six points as you assess the strengths and weaknesses of your current site and plan your re-design.

1. Custom Landing Pages - Add a Personal Touch:

Does your landing page have a navigation bar or feature multiple product lines and promotions? If so, you are committing conversion suicide. You must convince the visitor that the landing page is just for them. Avoid using home pages or all-inclusive multipurpose landing pages. Create specific landing pages for every ad and paid search term. When you land a visitor on your home page, they may stay longer and check out more of your pages, but chances are they won't make a purchase. Instead, consider taking your visitors to a custom landing page. They'll stay on your site a shorter amount of time, but they'll convert about three times more often. And whatever you do, do not include a navigation bar on your landing pages - it's completely unrelated to your sale and can dramatically lower your conversion rate.

Custom landing pages are so important for pay-per-click advertising because you are creating consistency from keyword to ad to landing page. Many campaigns fall short of their goals due to an overly general landing page which does not meet the customer's expectations of relevancy. Just make sure you include some branding elements that will help consumers understand who you are and what you offer.

2. Images - Size Matters:

Product image size is actually one of the most important conversion factors on your landing page. The bigger and more detailed a product image is, the more inclined the consumer is to make a purchase. Make sure the picture is clear and full-color to contribute to the professional appearance of your landing page. In addition to product images, pictures of people can also increase conversion rates.

3. Confidence Messaging - Counter the Fear Factor:

Retailers must gain trust from shoppers. A large percentage of consumers won't buy online because they're absolutely terrified of giving out their credit card information. They've heard stories on the news about identity theft and with increasing spyware and phishing threats, consumers are rightfully concerned. Smart marketers counter customer fears by placing third-party endorsements such as "VeriSign secured" or "BizRate.com customer certified" on their landing pages to give visitors confidence to buy.

5. Registration Forms - Don't Scare Them Away:

More information is not always better. When you scrunch too much copy onto one landing page, you make your visitor's eyes hurt and they are more likely to leave. Keep your font size over 10 point type and try just one column of copy. Few visitors will scroll down, so your marketing message should be short and sweet and above the fold. Your goal is to not confuse your visitors, so place your conversion activity in a clear and prominent location. Overall, the design should be clear, uncluttered and easy to read. Don't try to jazz things up with flashing buttons, overly bright colors or artsy fonts.

6. Newsletter Subscriptions - Keep Them Coming Back for More:

Not only are visitors worried about their privacy, they're also a little "work averse". So keep your registration forms short. Limit your page to six or seven fields and don't require too much personal information like Phone numbers. Include e-mail privacy information so the visitor knows that you won't share their information with other marketers.

It's also important to have the reg form on the landing page above the fold so the user doesn't have to click to convert (remember, they may be concerned that a program will download if they click).

Another tip is to not require registration for free downloads like white papers. Instead, on the thank-you page, offer a sign-up for further updates and offers.

Test it.

Conversions don't always happen right away. Keep your visitors coming back by having an easy e-mail newsletter sign-up on your landing page. You're also more likely to keep your customers converting when you build a relationship with them by sending various offers, news and discounts directly to their in-box.


Source: http://www.google.com/support/conversionuniversity/bin/answer.py?answer=77127&hl=en

Tuesday, February 12, 2008

What is Good Content? A Working Definition and Some General Principles

This is quite an interesting question because many blogging experts have talked about the importance of great content and how it trumps other factors when it comes to growing one’s website.

I’m pretty sure you’ve all heard the adage ‘Content is King’ repeated so very often.

Good content is a necessary foundation for most successful blogs. High quality content makes it easier for someone to recommend it to friends or other potential readers. Content makes blog marketing a whole lot easier because it naturally supports the push or pull process involved in promoting a website.

Every successful blogger recommends the same thing: Create great content and learn how to market it. The whole crux of the matter lies with the notion of good content: What exactly is it? And if it’s so important, how do you create ‘good content’?

Let’s examine this idea of content quality in this article. For all its lauded benefits, I’ve not yet seen a working definition for it. Can we crack the content code and determine some general rules or guidelines for its development?

After some thought, I’ve made a list of three general principles on content quality, alongside a definition of what I consider to be good content.

Principle #1: Content Quality is Subjective


I’ve talked about content development in a previous article but I’ll say this again: Content quality is subjective because it is inevitably tied to the knowledge or experience of both the content creator and reader.

When someone feels that an article is excellent, it is not so much because of the content quality itself but rather, his/her own knowledge levels and receptivity to ideas. For someone more experienced, the same article might seem amateurish.

This subjectivity of content consumption is one of the main reasons why I think that content dissemination and distribution channels are sometimes more important than the actual content quality. The more visitors you can get to view your articles, the more they will begin to resonate with the right people and spread on their own.

Recognize that there are many uncontrollable variable factors at play here. Every person that reads your blog has his/her own built-in filters. Some are looking for a very specific solution while others want general overviews for beginners. Their overall receptivity is also influenced by what they already know about the topic.

Don’t feel bad when nobody comments on or links to an article you thought was quite excellent. Nor should you be disappointed when others criticize your content because their opinions only offer a selective assessment on the value of your work.

Principle #2: Content Quality is Comparatively Determined


Apart from content relativity, the value of an article is also comparatively determined. Your article will inevitably be juxtaposed with others on the same topic. The strength of another article will make yours less attractive as a citation source, unless you offer something distinctly different and unique.

Similarly, the weakness of other articles will make your content a more attractive and valuable resource. There is also a contextual determinism when it comes to advice given by experts. The strategies they recommend are often hypothetical or observations based on specific blogs in specific niches/situations.

These techniques and advice can sometimes be unsuitable for your blog niche, unless you learn how to implement them in a way which takes into account your audience expectations and the flow of information within your industry.

For some niches like entertainment/celebrity gossip, there is far more benefit in providing news reportage through short blog posts, than there is writing baits to attract social media audiences. This is because social media traffic is quite easily dwarfed by the massive number of search engine visitors.

Principle #3: There Are Guidelines to Determine Content Quality

Even though content quality is subjective and comparatively determined, one can still create content that is perceived to be of high quality. One way to do so is to study the popular articles of other bloggers, especially the ones in the same niche. These articles provide one with a rough measure of possible content popularity.

In my opinion, good content usually has the following characteristics:

  1. Thought-provoking. The article should present new ideas or offer a critical and new look at ideas or assumptions commonly held by others.
  2. Highly entertaining. An entertaining piece of content can come not only in the form of written text but videos or pictures. Humor is especially powerful when applied on current events or industry happenings.
  3. Important News. Breaking news are considered important because changes usually impact most people in the same industry or niche. Be the first to cover and explain news and people will naturally talk about your blog.
  4. Comprehensive. If your article is comprehensive enough, it may outshine others on the same topic. Bloggers love referencing articles which are comprehensive because it gives their readers a good starting point.
  5. Well Researched. Well researched articles with multiple links to related discussion on this topic are especially valuable because it allows you to insert yourself within an ongoing conversation in the blogosphere. Extensive research also denotes value because this signifies an investment of time.
  6. Unique. The less you repeat what other bloggers say, the more you’ll stand out. If your article examines a topic that’s rarely breached, it is likely that you’ll be regarded as an authority within the field as more people write about it.

Creating a Goal-Oriented Definition of ‘Good Content’


Content is consumed by users in many ways and it is difficult to measure how they value your articles, apart from the usual citation links, comments or emails. Instead of defining ‘good content’ according to reader feedback, why not define it according to the content creator’s perspective?

When we talk about ‘good content’ consider how it impacts your blog and brand. Here’s a working definition: Good content refers to content which succeeds in achieving the objectives that the content creator has set for it.

For example, if you want to network with others in the same niche, a good piece of content should link out and reference as many bloggers as possible. If you are a linkbaiter purely looking to get some incoming links for a webpage, good content would be content which achieves that purpose of acquiring links.

Successful content is no longer measured by the opinions of yourself or your audience but rather, to what extend did it fulfill end goals.

Content determined by purpose is strategic. It serves an objective and strives to achieve a specific result. Before you write a blog post, you should clearly examine your intentions. What exactly do you want to achieve with this specific article? Each blog post must have a defined purpose. Frame the content to suit that specific goal.

And then after the post is published, promote it in a way which accentuates that goal. For instance, if you’re purely looking for opinions, send it to some friends via StumbleUpon or email and get them to let you know what they think about it.

If you’re out for some heavy social media traffic, push it out to some influencers and request they disseminate it to the appropriate channel. After the marketing process is finished, look at your post and record its results. How many links did you get? How many people commented on it? Did you manage to get it cited by a popular blogger?

These results will give you a rough indication of ‘good content’, i.e. content with a track record of achieving objectives. This goal orientated approach to content development may sound a little mechanical but I think its a fairly straightforward method to assuage the quality of your work.


Source: http://www.doshdosh.com/what-is-good-content/

High Performance SEO Requires Fast Load Times

Many large companies assume that site speed isn't very important to the overall user experience. This is normally a result of the site's operational departments setting goals in terms of what they think is a reasonable range. This range can often be well over two to four seconds.

This may not sound like much, but if you add other network issues on top of this time, it can create a horrible user experience. For example, if you have a visitor from a small country on a poor dial-up connection you could see a load time of several minutes, in an extreme case.

More often, you won't see the several minutes load time -- or even hear about it -- because the user on dial-up won't come back. You'll be lucky if they take the time to tell you the problem they had with your site.

These considerations are taken into account by most major search engines. If you look at short tail or tier head keywords, such as news, cars, real estate, and others, you'll find these generic terms searched for in massive quantities and high frequencies.

If we assume any one of these keywords receives 100,000 searches per day with an average CTR (define) of 75 percent, you would need to return this page at an average of 250 milliseconds to be able to handle the load for optimal speed and efficiency. If you return at a rate over 1000 milliseconds, your speed will be to slow to deliver a reasonable experience.

It would be unwise to assume this form of measurement isn't taken when search engines perform their quality score (define) in relations to your PPC (define) campaigns. It would be unwise for them to list a slow site in the top listings.

You can see what your average site speed is through the Google Webmaster Tools interface. If you're still skeptical about search engines looking at this data, carefully think about why a search engine would store this data.

It would be illogical to store data you're not going to use in your calculations. It's rare to see a slow Web site ranking for a competitive term, no matter how much link popularity and unique content can be found.

Many operations departments find search engine bots to be a nuisance. Instead of making the site fast enough to handle these issues, they'll introduce an application called mod throttle. This application can be loaded in apache and will spit back server error messages, typically within the 500 range, saying the server is unavailable.

While the users will never see this message, don't kid yourself. If you give this message to the search engine, bots or spiders (define) will assume it's the message you're sending to your users. They won't manually check every site to be sure it's responding quickly and accurately.

Here are some other helpful tweaks in order to keep your site fast and clean.

Consider using a caching service like Akamai or install hardware to make sure your pages are stored in memory.

Decrease the size of the images you see on the pages. The more images you have -- and the larger they are -- the slower your site will respond.

Many people still don't have broadband connections. Others use comparatively slow WiFi. Still others access the Internet on their mobile phones. These users will likely experience slower site load time.

Another great Google-inspired trick: Use more white space in your design in order to load less in terms of visual affects. Or, if you're green and in favor of consuming less energy, use more black space, as Blackle does.

In writing code for your site, decrease the white space by eliminating excess spaces. Excess spaces between your coding are simply unneeded tabs and spaces. That reduces the number of bytes off the total size of the page, speeding load time.

There are also companies that specialize in monitoring sites and sending you alerts when the speed changes dramatically. These services are great for making sure you're returning appropriate levels of performance around the world.


Source: http://searchenginewatch.com/showPage.html?page=3628404

Five Situations Where You SHOULD Use NoFollow for Linking

Yesterday Eric brought up the NoFollow attribute and his theory about it setting off red flags at search engines for them to look deeper into a site’s SEO practices, theory being if someone is savvy enough to use NoFollow to harness the flow of linkjuice through their site by ‘nofollowing’ links to internal pages, what else are they savvy about?

Well, arguments aside (there are 30 comments on that post) I thought I’d take a look at situations where a NoFollow should be used for linking out, besides for paid links as suggested by Google.

First and foremost, your search marketing efforts build the incoming links and link juice which help lend authority and ranking to your site. Think of linkjuice as your juice, your property, and sometimes there is nothing wrong with sharing that property with the right people, and letting the ‘wrong people’ go thirsty.

Use NoFollow when linking out to ScanAlert’s HackerSafe, Better Business Bureau or Verisign.

Ok, I’ll say it. If I’m going to pay HackerSafe for the rights to use their button on my site, I’m not going to send them any link juice. Why not? They have enough link juice to go around and they have been known to use that link juice to power questionable linking tactics.

Giving HackerSafe linkjuice is like selling paid links in the bizarro world. “I pay YOU to put your link on my site!”

If you feel paying HackerSafe to put their button on your site increases trust in your site and conversions, that’s fine. But leave it at that. Protect your linkjuice, HackerSafe won’t miss it… according to Yahoo they already have over 95 million incoming links.

The same goes with the Better Business Bureau and other *trust* oriented badges which you have to pay for to place on your site.

Use NoFollow when linking out to you Feedburner RSS feed

Someone at Feedburner may take this the wrong way and I hope they do not because they are an incredible company and part of the Google family, but linking out organically to Feedburner does not only give them some of your juice, but it also could lead to duplicate content issues.

Your blog feed is your lifeline, but it also copies the text of your blog. Furthermore, I can’t count the amount of times I’ve searched for something or a blog in Google and found a blog’s Feedburner feed listed before the blog itself.

If you’re worried about duplicate content and your blog’s rankings, you may want to look into using a NoFollow on your Feedburner link.

Use NoFollow when linking out to questionable sites or content

While blogging, on occasion I tend to cover some spam sites or questionable marketing or link farm sites which I feel should be linked to, but in this case I want to put a condom on this link to make sure that I’m not passing PageRank and that there is no link association between my site and theirs. In this instance, I use a NoFollow. You may want to also.

Also, keep this in mind for linking out to your competition ;)

Use NoFollow when linking to internal pages that don’t need PageRank

This is kind of old school (like 12 months old school) but Matt Cutts and many others recommend using NoFollow when linking to a site’s Privacy Policy, Contact Us page, Login page, Register page and secure pages.

I recommend not using NoFollow on your About Us page because About Us is one of the most important pages on your site and usually lists local relevant info like your address or phone number. Plus, you’re more likely to use industry jargon to describe your company via an About Us page which should pick up some very targeted users via searches for these keyterms. And NEVER NoFollow an FAQ page.

Use NoFollow when linking to the same page many times from one page.

This is my own theory so please bear with me.

If I have a site and its FAQ page has numerous links to internal pages like About Us or specific service pages, such as more than one link to each page, I feel it would it make sense to NoFollow the second and third link so it does not look like that site is trying to unload multiple internal links to the same internal page in an effort to make that internal page rank higher (under outdated link popularity schools of thought) under an internal authority page like FAQ.

In the past, I’ve seen internal rankings increase when we take the multiple links out, and decrease with multiple links using different anchor text (ie. Click Here, More Information, Blue Widgets).

But in this case, I’d think using NoFollow would make the FAQ page look like it is only directing one link to an internal page while also addressing those link popularity driven usability standards which say we should include multiple links to one page from one page. Make sense?


Source: http://www.searchenginejournal.com/five-situations-where-you-should-use-nofollow-for-linking/6361/

Monday, February 11, 2008

The SEO Success Pyramid

John Wooden, the greatest basketball coach ever, never talked to his teams about winning. He talked to them about preparation and about the process of becoming a great team.

Wooden’s philosophy on coaching (and life) is summed up in the “Pyramid of Success,” which beats the tail off all that Self-Help Guru junk you see peddled in books, on blogs, on daytime chat shows, and on late night TV. I was lucky to hear Coach Wooden speak about the Pyramid of Success while I was a student at Pepperdine University; to this day, it’s one of the best speeches I’ve ever heard. (Seriously, if you don’t know what his Pyramid of Success is, visit CoachJohnWooden.com.)

What’s all this have to do with SEO and online marketing? Well, the best SEOs don’t talk to their clients about rankings; they talk about the process of making great web sites that earn traffic and convert visitors into customers. They talk about the process of creating great content that attracts links like bees to honey.

I would never compare myself to John Wooden, but I do like teaching others about online marketing. So, with that in mind, and inspired by the great coach, here is the….

SEO Success Pyramid


What’s It All Mean?

Commitment:

Every successful project I’ve ever worked on has involved a client whose team is enthusiastic and engaged. Whether you’re big or small, one uninterested department or person can sabotage everything.

Planning:

Success in any pursuit begins with setting goals and developing a plan to achieve them — detailing the strategies and tactics you’ll use, the people and resources needed, and so forth. Search marketing is no different.

Product/Service:

Although you can fool some people into buying crap for a while, real long-term success involves a product or service that people want or need. There’s no substitute for quality.

Education/Information:

You’re a business owner; you don’t need to become an SEO expert. But you’ll succeed faster if you have access to great information. And as fast as the search marketing industry changes, ongoing access to intelligent information is critical.

Patience:

True, there are exceptions every now and then, but for the vast majority of companies big or small, search marketing is a process that takes time to implement correctly. There are no short cuts, no quick fixes. Success almost always takes many months, if not a year or more.

Design & Usability:

Yes, there are some ugly sites that make lots of money; but there are more that don’t. Your best bet is to have a web site that’s attractive and easy to use. Get out of your customers’ way and let them do what they came to your site to do.

Keyword Research:

If you target the wrong keywords, you’re doomed to fail. You’ve heard that a million times, I hope. More than that, you also need to know what to do with your keywords.

Analytics:

How will you know you’re successful if you have no way of measuring what you’ve done? Measure, analyze, adjust strategies and tactics as needed.

Tools:

Having access to appropriate SEO tools can give you an advantage over the competition. Of course, more important than the tools is knowing how to interpret the data they provide.

Crawlability:

A search engine cannot index pages that its spider cannot crawl. Be careful with the Flash movies, the complicated DHTML and javascript, the robots.txt file, etc.

Content:

This can take many forms: a blog, articles, videos, a FAQ page, or even user-generated content like product/service reviews. When you get this one right, you’ll have an easier time getting…

Links:

Your great content isn’t going to rank well without links, preferably from relevant, quality sites. I brain-dumped (almost) everything I know about links early last year.

Social/Local Findability:

Let me explain this since I might be inventing a new term. Social Media Marketing and Local Search are musts. The size and scope of your company may dictate which you emphasize more, but neither should be ignored. Local SEO is a must for most small businesses, but social media can work, too. Bigger companies that target an audience more than a location will find social media offers a lot of opportunities. In either case, the goal is findability. You want customers to be able to find you as easily as possible.

Reputation Management:

It’s imperative to know what people are saying about your company. This isn’t just for Big Business, either: An old client of mine runs the only roller skating rink in our area, yet is probably losing business because they have a couple negative reviews on a certain Local Search site. Given the growing influence of user reviews, knowing how to manage your reputation is a must.

Trust:

In my first post of 2007, I said trust is the No. 1 factor, and nothing has changed since then. Trusted domains are powerful domains. When you have trust, from users and search engines, you’re on the way to search marketing success.

As you climb the pyramid, you’ll find buzz/word-of-mouth marketing or maybe community helping you along. To a large degree, these are two sides of the same coin. It’s the people factor, the human element that often separates the winners and losers in search marketing. Get people talking positively about you, whether it be one-to-one conversation among friends or in the larger setting of an online community, and you’ll climb the pyramid that much faster.


Source: http://www.smallbusinesssem.com/the-seo-success-pyramid/971/

Search Behavior Patterns

A search engine on an organization’s website or intranet is often built to support an overly narrow model of user behavior, which goes something like this:


  • User types in a search
  • Search engine gives back matching results
  • User reads the results and picks the best one

Simple. Better still, it asks very little of the user interface—only that it provide some way to submit a search, and some list in response.

However, such simple models overlook the fact that humans are complex, convoluted, capricious, mutable, moody, multifaceted beings with broadly differing backgrounds, competencies, and frames of reference. (1) In practice, this can make the requirements for search interfaces quite a bit more complicated.

The good news is that while users vary widely in the ways they search, their behaviors follow a limited number of identifiable patterns. By examining the factors that cause variability in user behavior and considering personas that illustrate those variations, we can identify common search behavior patterns and the interface affordances that support them.

Factors that affect user behavior


Search behavior is the result of interplay among several independent factors the user brings to the search operation, six of which are described below. Designers have no more control over these than they have over the color of the user’s hair.

1. Domain expertise

User behavior has a lot do to with a user’s familiarity with the subject on which he or she is searching. When searching outside a domain of expertise, people will be less certain where to start, use less precise language, and have more difficulty evaluating search results. By contrast, experts in a field generally know what verbiage will work best, and so generally get better results, from which they’re better able to discern the most useful documents. (2)

2. Search experience

Users who have a better understanding of the breadth of a search engine’s capabilities have more ways to go about finding information. If you know how to use Boolean operators, exact strings, filtering controls, and have proven strategies for exploiting search, then you have a much richer toolset at your disposal. But search experience also isn’t an absolute requirement for success. We have seen that users who are short on technical know-how but rich in domain knowledge can often get by. On the other hand, technophiles can have great difficulty finding information in an unfamiliar body of knowledge.

3. Cognitive style

User behavior is also influenced by the way users assimilate new information. Researchers like Nigel Ford and his colleagues have proposed a number of schemas to describe cognitive style, but for the purposes of search it makes sense to think of it as a spectrum ranging from global to analytical thinking.


  • Global thinkers first try to build a broad level of understanding across related topics.
  • Analytical thinkers dive right into a single topic and research it thoroughly to resolve a specific problem.

Most people lie somewhere between these extremes, sporadically using either cognitive style but tending more often toward one. (3)

4. Goal type

Search goals will vary from one query to the next, and may be broadly classified into three categories as outlined by Andrei Broder in his article “A Taxonomy of Web Search:”


  • Navigational searches are efforts to reach a particular location, such as an intranet’s timesheet application.
  • Informational searches seek out any documents relating to a topic, like a description of employee benefits.
  • Transactional searches occur when the user primarily wants to accomplish something online, like changing her benefits elections.

5. Mode of seeking

The extent to which users understand what they are trying to find determines their mode of seeking. The level of understanding can range from known items, where people know exactly what they need and how to describe it, to much more exploratory searches, where they have only a loose concept what they want to find. (4) Furthermore, as Marcia Bates pointed out in her oft-cited 1989 paper “The Design of Browsing and Berrypicking Techniques for the Online Search Interface,” information needs are often unstable and may evolve as a user learns more about a subject area.

6. Situational idiosyncrasies

To add a final layer of unpredictability, search behavior can vary for the same user with the same task, due to idiosyncrasies in external pressures, working context, temperament, or mood. For example, a user who is nearing a tight deadline is likely to behave very differently than a user who is just leisurely exploring the same topic out of general interest. People can also approach search tasks differently simply if they’ve had a bad day, feel tired, stand to make money, or feel especially engaged in a topic.

Personas


Grounding abstract ideas in concrete personas can help bring all of these factors to life. Personas are descriptions of typical users that illustrate key attributes that are relevant to the design of a website or online system. An understanding of the motives underlying user actions, like those detailed above, provides a great starting point for authoring personas.

For instance, the hypothetical people described below each illustrate different areas of domain knowledge, and represent a spectrum of search experiences and cognitive styles. They will be used to relate the factors above to the common search behavior patterns that follow.


  • Andrea is a technical wiz who is completely comfortable with search engines. She is a project manager for a mainframe manufacturing division of her company. Her cognitive style tends to be analytical.
  • Dmitry has moderate technical know-how. He works in the benefits administration division of his company’s HR department. He learns new information globally about as often as he does analytically.
  • Kazue is generally uncomfortable with technology, but is a recognized expert in her field of instructional design. She tends to be a global thinker who prizes an understanding of the big picture.

Patterns of Behavior


Despite the large number of variables tugging user actions this way and that, they translate into a relatively small number of common patterns of behavior. In my work, I’ve observed six broad patterns, described below with recommendations for accommodating each.

1. Alternating between search and browse

When searching, users will often select a result that is closest to the topic they have in mind even if it isn’t a precise match. They’ll then follow the links on that page to find their target information. A global thinker like Kazue might do this if she were exploring an information goal outside of her domain expertise. Unable to formulate the search phrase precisely right, she would need to trust the results returned by the engine. Finding that they’re promising but not quite right, she may switch to browsing before returning to the results page.

In effect, searching and browsing can function as a single behavior, with many people moving fluidly between both. These users see no distinction between the two, since both work in support of a single information seeking task. This means that improving the quality of a site’s navigation will necessarily also make searches more successful.

Design recommendations:


  • Support robust cross-linking on each page, so that when users reach pages that are near matches they can easily get to the best matches.
  • Include conventional hierarchical cues like breadcrumb trails and contextual navigation, as well as nonhierarchical, associative links among topically related pages. (4)
  • Don’t let pages come to a dead end, without any links to other resources on the site.

If Kazue is able to easily cross-link among related pages, this hybridized searching/browsing behavior will be more effective.

2. Minimizing the results set

Users sometimes measure the success of a query primarily by the number of results it returns. If they feel the number is too large, they add more terms in an effort to bring back a more manageable set. Given her understanding of how search engines determine relevance, you’d expect Andrea to do this if she needed to quickly locate a known item within her domain expertise, like “mainframe manufacturing.”

Design recommendations:


  • Allow users to filter the search results by categories, so they can reduce the number of results while making them more topical.
  • Include a numeric count of the total number of results returned for the query and the total number for each category.
  • Use “and” as the default operator rather than “or,” so the number of results narrows instead of growing as the user adds more terms.
  • Don’t confound this behavior by truncating the total results set at a round number like 100 or 500; this makes it difficult for users like Andrea to gauge the quality of her query.

3. Surveying quickly

Some users scan through the results quickly, and if none of the titles strike them as an ideal match, they may proceed several pages deep into the results set. I’ve seen these users go to the fifth or sixth page of results without hesitation, then go back to the initial results to look more carefully or submit another query.

For instance, Dmitry could do this to hedge his strategy if his task isn’t fully defined. Hopeful that something will just pop out at him, he may do a quick scan of the first few pages, then fall back to another strategy if that doesn’t work out.

Design recommendations:


  • Ensure that result titles are comprehensible at a glance, including application files like PDFs and Word documents, which often return cryptic file names by default.
  • Highlight the terms that match the words originally submitted to help people scan the titles and descriptions more easily.
  • Allow users to change the number of results shown per page to avoid navigating through too many paginated results.

These changes will allow Dmitry to evaluate pages more efficiently and successfully.

4. Making immediate judgments

Other users look only at the first few results before deciding whether the query was successful or not. Finding nothing, these users may then resubmit the query or give up on search altogether.

Andrea, the analytical thinker, would be discriminating about a result’s relevance to a narrowly defined informational goal. Confident in her expertise, she would also be quick to conclude that search is flawed if it cannot return a good match in the first few listings. This behavior requires that the best match be returned as close to the top of the list as possible.

Design recommendations:


  • Optimize results for the most commonly submitted queries. Working from the search logs, try out each of the top queries and evaluate the quality of the top results returned, then optimize the content of those pages to improve their ranking.
  • When pages cannot be further optimized, include a manually generated “Best Bets” sidebar to force those matches to appear at the top. This gives the page a second chance to hit the specific target in Andrea’s mind.

5. Agonizing over the query

Sometimes users have difficulty translating the concept they want to find into a specific search phrase. They will often rewrite the query several times before submitting it, and then focus on revising it further if the results are not as they had expected them to be.

Less experienced users like Kazue are more likely to show this behavior, especially if the task isn’t well defined and lies conceptually outside of her domain. Kazue may also be inclined to phrase the query generally enough to satisfy her global cognitive style, but fret over how general is too general.

Design recommendations:


  • Consider providing tools that assist in formulating the query, such as suggestion functions that present searches similar to the one the user is typing.
  • Consider including lists of popular searches or automated storage of the user’s previous queries, saved to a profile or cookie.

Anytime that Kazue can select a query from a list rather than originating it from scratch, she will be able to search much more efficiently.

6. Pogosticking

Some users click several results in rapid succession, quickly sampling each before settling on a best candidate to meet their needs. Jared Spool has described this as “pogosticking”—bouncing up and down between choices of uncertain relative value. This is the kind of behavior that Dmitry might resort to if the quick surveying behavior described for him above didn’t yield anything. Assuming that his temperament is fairly tolerant and he isn’t pressed for time, Dmitry may decide that he cannot determine the usefulness of pages without looking at them. These users need support for three primary tasks: assessing result listings, comparing result pages, and tracking work.

Design recommendations:


  • Again, provide comprehensible titles and descriptions on the results page, as well as highlighted search terms.
  • Pages can be even more effectively compared if highlighting can be extended to the display of the results page itself (as is possible with Yahoo! and Google toolbars).
  • Allow users the option to open results in a new browser window to assist comparison. Sites like Ask and Easy Search Live are experimenting with page previews.
  • Be sure to include a visited link color on the results page. This is absolutely essential for Dmitry to keep track of the pages he has already tried and rejected as he jumps to each of the matches from the hub listing page.

Conclusion


Search behavior varies with domain expertise and technical knowledge, cognitive style, goal, and mode of seeking. All of these factors will interact in complex ways to influence a user’s actions. Even then, behaviors will vary depending upon whether at that moment the user is under pressure, in a good mood, or any number of other idiosyncrasies.

The point is that the designer cannot select the behavior that a user will follow when conducting a search. This may invite the impression that the design must be overly broad, providing any conceivable function regardless of the likelihood it will be used, because we cannot predict whether it will be needed. Fortunately, users’ actual behaviors do fall into generally describable patterns, each of which has dependencies upon specific affordances of the interface. This is how designers can better cater to what appears to be chaos: make available those capabilities that best support the range of known behavior patterns for your target personas.


Source: http://www.boxesandarrows.com/view/search-behavior