Towards more agile and efficient product testing

Opportunities and limitations for small sample sizes

cOVER PAGEThe historic assumption that larger sample sizes are needed for product tests derives from the hypothesis that there is a risk of unreliable and varying consumer responses, i.e., variance. Today, large consumer panels and databasing of consumer responses allow us to revisit historic variance assumptions for product development.


In this paper we investigate the variance of products tested across regions and categories using different scales from 36,500 consumers in our database. We assess how reliable a smaller sample size of n=50 is versus larger samples of n=150 or more when testing products in the early stage and later stage of the product development life cycle..


Our findings suggest small sample sizes can be considered when the objective is to create differentiating products such as for pre-screening of prototypes. Such pre-screening allows us to save cost and time by reducing the number of products required for further testing. However, for other types of testing such as cost rationalization studies, or when subgroups need to be analysed, larger sample sizes are recommended.

 

To learn more, read Towards more agile and efficient product testing

 

Related news

  • [WEBINAR] Taste of the Future
    Food & Beverage Events replay

    [WEBINAR RECORDING] Taste of the Future

    Following the success of our "Taste of the Future" event, we're excited to offer a free webinar highlighting key takeaways and insights!
  • [EVENT] Taste of the Future

    [EVENT] Taste of the Future

    In Ipsos I&O Taste of the Future event on 15th May, you will learn more about Ipsos Global Trends interpretations for the Food industry.
  • [Webinar] KEYS – Brand Talk LIVE
    Consumers Events replay

    [Webinar] KEYS – Brand Talk LIVE

    Are you ready to uncover the secrets that underpin powerful brands in today’s ever-evolving landscape? From outstanding creative to enduring brand assets, we’ll be uncovering how brands can shape people’s expectations and deliver Brand Success.