Observation and participation

One of the (many) criticisms of market research is that it is based on artificial, post-rationalised claimed responses. This line of thinking contends that there have been plenty of studies showing us to be unreliable witnesses to our own thoughts and actions – therefore surveys, focus groups and the like can’t be trusted.

Obviously, the reality is no so black and white. There are some things I can recall perfectly well – places I’ve shopped in the past week, why I like to blog etc. My answers would be truthful, though with the latter example the analysis might not take my literal answer but instead interpret it into a broader motivation.

Nevertheless, what I know I know is only one part of the Johari Window (which was channeled by Donald Rumsfeld for his known knowns speech) – the arena quadrant. For the other three quadrants, these methods are insufficient.

Fortunately, there is more to research than surveys and focus groups.

To slightly paraphrase the hidden quadrant, this would involve a methodology that would provide us with previously unknown information. This can be achieved through participation. IDEO are big proponents of this – I particularly like the example Paul Bennett gives of improving hospital waiting. The best way for them to discover the patient experience was to become the patient and spend a day strapped to a gurney. The view from the gurney is boring ceiling after boring ceiling, so IDEO used this space to provide both information and soothing designs.

The blind spot quadrant is where we battle the unreliable witness through observation. This could either be straight-forward observation or a mixture of observation and participation such as ethnography (remember: ethnography is not an in-home interview). Siamack Salari of Everyday Lives gives the fantastic example of a project he did for a tea company. This tea company had invested a great deal of money in research to understand the different perspectives people had on the perfect cup of tea. For the colour, they had even developed a colour palette outlining varieties. In closed research, people would pick their perfect colour. Yet, when observed, the colour of tea would never match. This is because people don’t concentrate on making the perfect cup of tea – the colour depends on the amount of milk they have left in the fridge and whatever else is capturing their attention (such as the toaster). Valuable information though, as Siamack noted in a training session I attended, an expensive way of finding out the answer you want doesn’t exist.

Thus, two simple examples to show the role of observation and participation in improving our understanding of things. As for the unknown window…

sk

Image credit: http://www.flickr.com/photos/colorblindpicaso/3932608472

Google Firestarters #2 – Design Thinking

The second Firestarters event, hosted by Google and curated by Neil Perkin, was an excellent evening – probably even better than the first evening. There were lots of interesting people to speak to and debate with in the break-out session and afterwards, while the Google catering is unrivalled. I’m amazed the staff aren’t twice the size they are, given the volume of cupcakes around.

The primary reason for the quality of the event is the speakers. Both were very interesting.

Tom Hulme (IDEO)

Tom talked about design thinking as a set of beliefs. He advocated it as a form of divergent thinking. Strong companies that perform well tend to be good at optimising and being efficient in their areas of expertise. Creativity in opening up new avenues can bring in new aspects to a business, which they can subsequently optimise and renew the cycle. Traditionally these would be have been consecutive but with things moving so quickly they should now be concurrent.

Tom’s 8 steps for design thinking are

  1. Challenge the question
  2. Be user-centred (and do so in context. Focus groups are not the place to introduce ideas)
  3. Look to extremes
  4. Messages or experiences? The answer is both – they are coherent.
  5. Be holistic – the business model and marketing model are now indistinct from one another
  6. Value diversity
  7. Launch to learn – prototyping is now redundant as it is so cheap to launch and run A/B tests
  8. Stay in beta

Tom is a very charismatic speaker and came up with wonderful examples – from Sneakerpedia being an example of message and experience combining, to Steve Jobs’ calligraphy course as an example of diversity to his open document containing useful tips for start-ups.

He also ended with a great quote: “Looking at why people really hate stuff is wonderful inspiration to come up with new ideas”

John V Willshire (PHD)

John is well-known for his unique analogies, and he didn’t disappoint with a seamless weaving of Bad Religion and Adam Smith.

John was a counterpoint to Tom, in that he argued the case against process. Channelling Bruce Nussbaum, he said that companies are only comfortable with design theory when it is packaged as a process. And then they are principally purchasing the process, rather than the idea or outputs themselves. Real work, in other words.

Process might make bad things good, but it also makes great things good. It levels things out into mediocrity.

When Adam Smith discussed the division of labour, he noted that the benefits to industry would be in dexterity, time and technology. However, he noted that this process wasn’t applicable to agriculture due to its unpredictability and variety. As John noted with regard to marketing agencies, “The sell is industrial. The work is agricultural”.

sk

Image credit: http://www.flickr.com/photos/dunechaser/3339729380

Mediatel Media Playground 2011

My previous blog post covered my notes on Broadcast in a Multi-Platform World, which I felt was the best session of the day. Below are my notes from the other 3 sessions (I didn’t take any notes during the bonus Olympics session)

The data debate

Chaired by Torin Douglas, Media Correspondent for the BBC

Speakers:
Andrew Bradford, VP, Client Consulting, Media at Nielsen
Sam Mikkelsen, Business Development Manager at Adalyser

Panellists:
David Brennan, Research & Strategy Director at Thinkbox
Kurt Edwards, Digital Commercial Director at Future
Nick Suckley, Managing Director at Agenda21
Bjarne Thelin, Chief Executive at BARB

Some of the issues touched upon in this debate were interesting but I felt they were dealt with too superficially (but as a researcher, I guess it is inevitably I’d say that).

David Brennan thinks we need to take more control over data and how we apply it. There is a dumb acceptance that anything created by a machine must be true and we’ve lost the ability to interrogate the data

Nick Suckley thinks the main issue is the huge productivity problem with manual manipulation of data from different sources (Google has been joined by Facebook, Twitter and the mobile platforms), but this also represents a huge opportunity. He thinks the fight is not about who owns the data, but who puts it together

Torin Douglas posited whether our history of currencies meant that we weren’t so concerned with data accuracy, since everyone had access to the same information. Bjarne Thelin unsurprisingly disagreed with this, pointing out the large investment in BARB shows the need for a credible source.

David Brennan said his 3 Es of data are exposure (buying), engagement (planning) and effectiveness (accountability)

Nick Suckley thinks people would be willing to give up information for clear benefits but most don’t realise what already is being collected on them

Kurt Edwards thinks social media is a game-changer from a planning point of view as it sends the power back to the client. There is real-time visibility, but the challenge is to not react to a few negative comments

David Brennan concurred and worried about the possibility of social media data conclusions not being supported by other channels. You need to go out of your way to augment social media data with other sources to get the fuller picture

Bjarne Thelin gave the example of BBC’s +7 viewing figures to show that not all companies are focusing purely on real-time. He also underlines the fact that inputs determine outputs and so you need to know what goes in

David Brennan concluded by saying that in the old days you knew what you were getting. Now it is overblown, with journalists confused as to what is newsworthy or significant

Social media and gaming

Chaired by Andrew Walmsley, ex i-Level

Speakers:
Adele Gritten, Head of Media Consulting at YouGov
Mark Lenel, Director and senior analyst at Gamesvison

Panellists:
Henry Arkell, Business Development Manager at Techlightenment
Pilar Barrio, Head of Social at MPG
Toby Beresford, Chair, DMA Social Media Council at DMA
Sam Stokes, Social Media Director at Punktilio

The two speakers gave a lot of statistics on gaming and social gaming, whereas the panel focused upon social media. This was a shame, as the panel could have used more variety. All panel members were extolling the benefits of social media, and so there was little to no debate.

There was discussion about the difficulty in determining the value of a fan, the privacy implications, Facebook’s domination across the web and the different ways in which social media can assist an organisation in marketing and other business functions.

Mobile advertising

Chaired by Simon Andrews, Founder of addictive!

Speaker:
Ross Williams, Associate Director at Ipsos MediaCT

Panellists:
Gary Cole, Commercial Director at O2
Tamsin Hussey, Group Account Director at Joule
Shaun Jordan, Sales Director at Blyk
Will King, Head of Product Development at Unanimis
Will Smyth, Head of Digital at OMD

Ross Williams gave an interesting case study on Ipsos’ mobi app, which tracked viewer opinion during the Oscars.

Simon Andrews’ approach to chairing the debate was in marked contrast to the previous sessions. He was less a bystander and more a provocateur – he clearly stated his opinions and asked the panel to follow-up. He was less tolerant of bland sales-speak than the previous chairs, but was also more biased in approaching the panel with the majority of panel time filled with Simon speaking to Will Smyth.

Will King things m-commerce will boost mobile like e-commerce did with digital. Near field communication will move mobile into the real world.

Gary Cole pointed out that mobile advertising is only a quarter of a percent of ad spend but that clients should think less about display advertising and of mobile as a distinct channel. Instead, mobile can amplify other platforms in a variety of ways.

Tamsin Hussey said that as there isn’t much money in mobile, there is no finance to develop a system for measuring clicks and effectiveness of all channels. Currently, it has to be done manually.

Will Smyth said the app store is the first meaningful internet experience on the mobile. The mobile is still young and there is a fundamental lack of expertise at the middle management level across the industry. Social is currently getting all the attention (“Chairman’s wife syndrome”) but mobile has plenty to offer.

sk

Broadcast in a multi-platform world

Last week I attended the Mediatel Media Playground 2011 – the first session of which was Broadcast in a multi-platform world. Below are my notes.

Notes for the other sessions will follow later in the week. However, I found this seminar the most enjoyable and thought-provoking due to the sector being highly competitive with players who would traditionally be in separate markets, and the willingness of the speakers to engage in debate on this.

Details

According to the website, the themes of the debate were:

Platforms, content owners, broadcasters, manufacturers and the confused consumer too – the new broadcast world.

  • How are consumer viewing and listening habits changing?
  • What is Connected TV? How will it best be sold to the consumer?
  • How will broadcasters and programme makers stand out in a world of TV clutter?
  • How should VOD be sold to agencies and advertisers?
  • The role of the EPG
  • Who needs who most? Are these uneasy alliances going to come crashing down?
  • Is YouView just too late now or the catalyst to Connected TV taking off?

The session was chaired by Torin Douglas, Media Correspondent for the BBC and the panel consisted of:

  • Dara Nasr, Head – YouTube & Display at Google
  • Oli Newton, Head of Emerging Platforms at Starcom Mediavest
  • Dan Saunders, Head of Content Services at Samsung
  • Jeff Siegel, Head of Advertising at Rovi
  • Nigel Walley, CEO of Decipher
Notes

My notes are chronological, so will broadly follow the themes above. All “quotes” were hastily scribbled down, and so are subject to error and misinterpretation.

Introduction

Nigel Walley opened by saying that in many ways new media isn’t that different to old. “Broadcast is the original recommendation engine” albeit editorially driven rather than through algorithms.

He also said that we are now in a “post VOD world” where new media is a support to broadcast and not an alternative. This is actually a boon to live TV as those time-shifting need to actively avoid mobile and laptop to keep away from spoilers.

Oli Newton said that consumers don’t realise what technology they already have and what it can do – he used games consoles as an example of this. He sees the children being the main educators in spreading these forms of behaviour.

Dan Saunders talked about the rise of connected TVs (Smart TVs, in Samsung parlance). Samsung sell 1 in 4 TVs in the UK, and 75% of these will be connected. He says that smart TV isn’t a separate category but a price point in the overall line-up between HD and 3D.

Jeff Siegel notes that worldwide 50% of connectable sets are now connected (though Mat Watson of ITV disputed this for the UK, saying it is much lower)

Dara Nasr believes that digital and broadcast empower one another and the online/offline divide has disappeared

Consumer understanding

Nigel Walley believes it is a confusing time for consumers as there are different technologies, different players and different acronyms (DTRs/PVRs/DVRs).

For instance, an average household could have an IPTV for the Olympics, Virgin for their TV and broadband, a PS3 for the kids and a DVD player for Mum. All of these can play iPlayer but the BBC has done no strategic development to say which one is better. Nigel thinks Virgin should be the priority as it the best platform to correlate VOD viewing to the broadcast audience.

Unsurprisingly, Dan Saunders disagreed. He thinks a TV tuner with an internet connection allows viewers to augment broadcast to something meaningful – thus Samsung comes to the fore in Freeview homes.

Dara Nasr said that Youtube follow the user. To be a TV company they need to be on TV, though at the moment it is mobile that is growing their audience.

Nigel Walley questioned his strategy as on the same device there can be multiple versions of Youtube. Dara countered by saying this was because their API is open to external developers. They “want to be accessible everywhere, and see what wins”.

Oli Newton said it was not about names but what gives the best viewing experience. “It is being of the web, not on the web”.

Jeff Siegel agreed in that we should focus on features and not on definitions. On TV, the quality of the video is the main thing – scores and additional information can be mobile if necessary.

Nigel Walley feels the quality of the interface has been the main problem in the past but this is improving. In future, he sees Sky and Virgin could be the dominant app on a TV rather than a separate device, “but there is a technology race to go through first”. This might change how they are used – for instance Youtube is used differently on a TV to how it is on a PC

Nigel noted that another problem to date has been a lack of promotion of connected TVs. For instance, stores don’t have internet connections to enable them to demo it.

Oli Newton said that consumer understanding is the most important thing – they need to be able to ask the right questions in store. Apple’s “ad-ucation” has been good at this – even non-users know how to work an iPhone.

Impact

Nigel Walley sees the film industry as being most under threat as connected TVs can deliver a better experience. It will be hard to break through the system of broadcast promotions, trailers and TV guide features that build up a linear broadcast schedule.

Dan Saunders argued that connected TVs can only have a positive impact for companies like ITV – people are buying TVs to watch TV after all.

Nigel Walley then accused TV companies of not understanding the difference between customers and consumers. Sky and Virgin have customers with transactional records while BBC and ITV are trusted brands to consumers – thus they should treat BSkyB as a business partner rather than a competitor.

Role of EPG

Nigel Walley argued that platforms aren’t doing enough to promote channels. The EPG is dull and boring and wastes all the promotion that goes into a channel launch

Dan Saunders questioned the role of the EPG. It isn’t being used effectively for advertising and there is currently too much on the front page

Jeff Siegel feels it has to be consumer friendly before you can even consider advertising

Oli Newton feels that if you have a smart TV, you don’t care about the channels but the content – that’s where the power of the EPG is. The EPG is the best place to advertise “but has been woefully let down”

Nigel Walley concluded that “the EPG is still software, it is not yet a media”

Competing platforms

Oli Newton noted that there “content sinkholes” e.g. the Channel 4 programmes available on Youtube are different to those on 4oD and again different to those on TV VOD services.

Oli also feels that Youview “is a bit pointless” – other serices, that already had a head start on the interface and simplicity, are now occupying this space.

Nigel Walley said that the original Youview scope was great, but that was in 2007. Stores are already discounting things that are better than Youview.

Nigel finished by saying that with devices and manufacturers battling it out, broadcasters are now further down the value chain. However, they have the valuable content that lets them punch through.

Dynamic Knowledge Creation Model

The Dynamic Knowledge Creation Model was created by Nancy Dixon, building on the work by Ikuijro Nonaka. It refers explicitly to how organisations deal with knowledge, though other academics have noted its relevance in other fields.

Nonaka posited that there are four processes of knowledge creation that link across tacit and explicit knowledge. These are illustrated below.

SECI modelImage linked from here.

This shows that the four processes are

  • Tacit to tacit knowledge – acquired through conversation and socialisation. It may not be the primary subject of the conversation, but new data points can be joined up new ways to create additional meaning
  • Tacit to explicit knowledge – this can be again acquired through conversation or another form of communication, but in this instance the transference is intentional
  • Explicit to explicit knowledge – where multiple data sources are combined in intended ways, to create additional understanding that can be greater than the sum of their parts
  • Explicit to tacit knowledge – where individuals take things they have learnt and apply them to their thinking and actions

In Rachel Bodle’s article, she combines this with Dixon’s thinking to come up with the composite diagram below.

A Model of Dynamic Knowledge Creation The diagram shows that there are four types of knowledge assets within an organisation (or individual)

  • Routine knowledge (explicit to tacit) – learning by doing
  • Experiential knowledge (tacit to tacit) – judgement of individuals
  • Conceptual knowledge (tacit to explicit) – frameworks and models to utilise
  • Systemic knowledge (explicit to explicit) – editing and synthesising multiple sources
Market research agencies traditionally reside in the conceptual sphere – it takes the tacit knowledge from stakeholders and the target audience and converts them into meaningful, actionable recommendations and frameworks. The best agencies will frame their solution in such a way that makes it transferable beyond the confines of the specific brief.
However, there are also opportunities for agencies to assist organisations in the other areas
  • Routine knowledge – research may not necessarily help people or departments do their jobs better. But in certain circumstances, research tools extend into these areas. Workshop debriefs can walk through the practical implications of implementing the findings, ideally in a real situation. An example of this would be in processing and responding to consumer feedback.
  • Experiential knowledge – debriefs shouldn’t be reserved for the immediate stakeholder. By inviting everyone within an organisation, those inquisitive minds with a gap in their schedule can listen to the findings. There may not be any obvious, explicit benefit but the opportunity for serendipity arises
  • Systemic knowledge is traditionally the preserve of the client but, with resources increasingly stretched, some are looking to outsource this. Good research agencies should already be doing this – surveys and focus groups don’t reside within a black box. Secondary data collection and bricolage solutions using cost-effective online tools (the precise ones depend on the nature of the brief) should be pre-requisites in complementing the core research offering
I’ve only recently become aware of these models, but I’ve already found them extremely useful in reframing the nature of my projects. Organisations thrive on knowledge. It can only be a good thing if I can identify additional means of them harnessing and applying that

sk