<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
		>
<channel>
	<title>Comments on: Adaptive Multivariate Testing &#8211; Does It Work?</title>
	<atom:link href="http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/feed/" rel="self" type="application/rss+xml" />
	<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/</link>
	<description>Pear Analytics - home of the free SEO analysis tool and website analyzer</description>
	<lastBuildDate>Fri, 10 Feb 2012 09:21:36 +0000</lastBuildDate>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
	<generator>http://wordpress.org/?v=3.2.1</generator>
<xhtml:meta xmlns:xhtml="http://www.w3.org/1999/xhtml" name="robots" content="noindex" />
	<item>
		<title>By: Salley Dottery</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-2814</link>
		<dc:creator>Salley Dottery</dc:creator>
		<pubDate>Sat, 05 Jun 2010 15:55:43 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-2814</guid>
		<description>How you find ideas for articles, I am always lack of new ideas for articles. Some tips would be great.</description>
		<content:encoded><![CDATA[<p>How you find ideas for articles, I am always lack of new ideas for articles. Some tips would be great.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Adam</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-2446</link>
		<dc:creator>Adam</dc:creator>
		<pubDate>Mon, 17 May 2010 21:20:17 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-2446</guid>
		<description>Hi, interesting article, but without fully testing the &quot;losing&quot; treatments aren&#039;t you in danger of producing false positives?  How can you statistically prove a treatment to be false, it you haven&#039;t sampled it enough times. Doesn&#039;t this work in reserve of GWOs principle of flood testing the losers to get them out of the way more quickly?</description>
		<content:encoded><![CDATA[<p>Hi, interesting article, but without fully testing the &#8220;losing&#8221; treatments aren&#8217;t you in danger of producing false positives?  How can you statistically prove a treatment to be false, it you haven&#8217;t sampled it enough times. Doesn&#8217;t this work in reserve of GWOs principle of flood testing the losers to get them out of the way more quickly?</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Jake Muney</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-640</link>
		<dc:creator>Jake Muney</dc:creator>
		<pubDate>Tue, 22 Dec 2009 21:46:08 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-640</guid>
		<description>Thank you for the intelligent critique. Me and my neighbour were just setting up to do some research about this. I am very glad to see such great information being shared freely out there.</description>
		<content:encoded><![CDATA[<p>Thank you for the intelligent critique. Me and my neighbour were just setting up to do some research about this. I am very glad to see such great information being shared freely out there.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: David Jacobsson</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-585</link>
		<dc:creator>David Jacobsson</dc:creator>
		<pubDate>Sun, 15 Nov 2009 00:04:50 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-585</guid>
		<description>Thanks, bookmarked this blog.</description>
		<content:encoded><![CDATA[<p>Thanks, bookmarked this blog.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Bethany-Grace</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-524</link>
		<dc:creator>Bethany-Grace</dc:creator>
		<pubDate>Fri, 11 Sep 2009 22:46:29 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-524</guid>
		<description>i emailed this to my mom....thanx</description>
		<content:encoded><![CDATA[<p>i emailed this to my mom&#8230;.thanx</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: affiliateclickpaypergirl</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-438</link>
		<dc:creator>affiliateclickpaypergirl</dc:creator>
		<pubDate>Sat, 29 Aug 2009 10:52:19 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-438</guid>
		<description>I do want to leave a comment here because the post here helps me a lot in dealing with the WordPress program! I could not delete anything in the program in the past and luckily, with this post, I know how to solve the problem now!</description>
		<content:encoded><![CDATA[<p>I do want to leave a comment here because the post here helps me a lot in dealing with the WordPress program! I could not delete anything in the program in the past and luckily, with this post, I know how to solve the problem now!</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Adaptive Multivariate Testing – Does It Work? @ In The News</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-80</link>
		<dc:creator>Adaptive Multivariate Testing – Does It Work? @ In The News</dc:creator>
		<pubDate>Mon, 03 Aug 2009 12:08:42 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-80</guid>
		<description>[...] Adaptive Multivariate Testing – Does It Work? [...]</description>
		<content:encoded><![CDATA[<p>[...] Adaptive Multivariate Testing – Does It Work? [...]</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Zee Aganovic</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-39</link>
		<dc:creator>Zee Aganovic</dc:creator>
		<pubDate>Mon, 27 Apr 2009 17:49:08 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-39</guid>
		<description>DM, thank you for sharing your opinion about adaptive testing methodology.

This is not just an ‘interesting idea’. This is a battle tested solution used by broad spectrum of companies over period of more than 2 years.

During that time the method has consistently delivered speedy results, it has eliminated testing risk, and it was very easy to use.

The algorithm is designed to take into account a time varying nature of website visitors. It collects combinations statistics over different day parts or days in the week. It’s decisions are driven by relational statistical model a not how an individual combination performs. As result it can effectively adopt to changes in visitor behavior.

Now, lets talk about your hypothetical ‘February 14th chocolate or flower sales’ example that in your mind kills the adaptive methodology.

Assuming that you are right about visitors behaving completely differently on February 14 then any other day, your options are:

    * Option 1 - Adaptive optimization: A system will adopt itself to a new situation, but because of a short burst nature of the change the adaptive response will be sub-optimal. Useful but not a perfect one.
    * Option 2 -Traditional multivariate testing solution: These methods will not react to change at all.
    * Option 3 - Let the human take control of the ‘stick’: This is a guessing game that can not guarantee consistent results.

Today, to better manage their website, the most companies are applying the best practices and ‘gut feel’ measures. The end result is that we have 98% of general web traffic wasted.

That is why we recommend use of a solution like www.hiconversion.com to merge the optimization science with a good marketing insight. There is not denying, an optimization test is only as good as input provided by a marketing person. Our tool gives you an ability to easily test many promotional ideas while helping you to consistently produce measurable increases in the online marketing ROI.

Cheers,

Zee
President &amp; CEO
Hiconversion, Inc.</description>
		<content:encoded><![CDATA[<p>DM, thank you for sharing your opinion about adaptive testing methodology.</p>
<p>This is not just an ‘interesting idea’. This is a battle tested solution used by broad spectrum of companies over period of more than 2 years.</p>
<p>During that time the method has consistently delivered speedy results, it has eliminated testing risk, and it was very easy to use.</p>
<p>The algorithm is designed to take into account a time varying nature of website visitors. It collects combinations statistics over different day parts or days in the week. It’s decisions are driven by relational statistical model a not how an individual combination performs. As result it can effectively adopt to changes in visitor behavior.</p>
<p>Now, lets talk about your hypothetical ‘February 14th chocolate or flower sales’ example that in your mind kills the adaptive methodology.</p>
<p>Assuming that you are right about visitors behaving completely differently on February 14 then any other day, your options are:</p>
<p>    * Option 1 &#8211; Adaptive optimization: A system will adopt itself to a new situation, but because of a short burst nature of the change the adaptive response will be sub-optimal. Useful but not a perfect one.<br />
    * Option 2 -Traditional multivariate testing solution: These methods will not react to change at all.<br />
    * Option 3 &#8211; Let the human take control of the ‘stick’: This is a guessing game that can not guarantee consistent results.</p>
<p>Today, to better manage their website, the most companies are applying the best practices and ‘gut feel’ measures. The end result is that we have 98% of general web traffic wasted.</p>
<p>That is why we recommend use of a solution like <a href="http://www.hiconversion.com" rel="nofollow">http://www.hiconversion.com</a> to merge the optimization science with a good marketing insight. There is not denying, an optimization test is only as good as input provided by a marketing person. Our tool gives you an ability to easily test many promotional ideas while helping you to consistently produce measurable increases in the online marketing ROI.</p>
<p>Cheers,</p>
<p>Zee<br />
President &amp; CEO<br />
Hiconversion, Inc.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Derek</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-38</link>
		<dc:creator>Derek</dc:creator>
		<pubDate>Sat, 25 Apr 2009 14:53:44 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-38</guid>
		<description>Interesting idea, but this model is severely flawed as it is susceptible to time bias, such as time-of-day, day-of-week, holiday and news events, etc.

For example, if the algorithm automatically adjusts what percent of each version is shown after only looking at Monday&#039;s traffic, then the decision it makes is based solely on user preferences for Mondays, not for other days of the week.

Similarly, suppose you are a flower or chocolates website ... if the algorithm looks at traffic from Feb 1 to 13th, adjusting several times in that timeframe, it probably zeros in on what it thinks is the &quot;best&quot; version. But, come Feb 14th (Valentine&#039;s day), everything changes because the big &quot;event&quot; has come and gone, and now the shopper&#039;s dynamics are totally different.  Where are you then? You basically need to start over.

These are some of the fundamental issue with self-optimizing &quot;auto pilot&quot; systems.  Even when we fly airplanes, we don&#039;t let the auto pilot take us the whole way ... there are many times that the human needs to take control of the stick.

DM</description>
		<content:encoded><![CDATA[<p>Interesting idea, but this model is severely flawed as it is susceptible to time bias, such as time-of-day, day-of-week, holiday and news events, etc.</p>
<p>For example, if the algorithm automatically adjusts what percent of each version is shown after only looking at Monday&#8217;s traffic, then the decision it makes is based solely on user preferences for Mondays, not for other days of the week.</p>
<p>Similarly, suppose you are a flower or chocolates website &#8230; if the algorithm looks at traffic from Feb 1 to 13th, adjusting several times in that timeframe, it probably zeros in on what it thinks is the &#8220;best&#8221; version. But, come Feb 14th (Valentine&#8217;s day), everything changes because the big &#8220;event&#8221; has come and gone, and now the shopper&#8217;s dynamics are totally different.  Where are you then? You basically need to start over.</p>
<p>These are some of the fundamental issue with self-optimizing &#8220;auto pilot&#8221; systems.  Even when we fly airplanes, we don&#8217;t let the auto pilot take us the whole way &#8230; there are many times that the human needs to take control of the stick.</p>
<p>DM</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Richard Hearne</title>
		<link>http://www.pearanalytics.com/blog/2009/adaptive-multivariate-testing-does-it-work/comment-page-1/#comment-28</link>
		<dc:creator>Richard Hearne</dc:creator>
		<pubDate>Mon, 02 Mar 2009 20:02:00 +0000</pubDate>
		<guid isPermaLink="false">http://pearweb.pearanalytics.com/?p=459#comment-28</guid>
		<description>Hi

Just wondered if you used their product, and if so how you found it?

You dont seem to have subscribe to comments, so perhaps you could reply to my mail? If so many thanks in advance.

Best rgds
Richard</description>
		<content:encoded><![CDATA[<p>Hi</p>
<p>Just wondered if you used their product, and if so how you found it?</p>
<p>You dont seem to have subscribe to comments, so perhaps you could reply to my mail? If so many thanks in advance.</p>
<p>Best rgds<br />
Richard</p>
]]></content:encoded>
	</item>
</channel>
</rss>

