Here's a simple task, let's say you have an antique that you want to sell on eBay and you need to figure out what it's worth, what would you do? I've sold a few things on eBay and to work out at least an idea of value you can searching for similar sold items and develop sort of an average, assuming that there are some recent similar items of course. There are also, depending on the item, online or printed guide books that might help although you would have to make sure the data was reasonably current and that the guide's methodology was acceptable. The more data points and in general the more current the data the greater the chance that you could predict the right price point. In fact if you had enough data you might even be able to determine the best time to sell your specific item. In any case data's the answer and more is definitely better. I read an announcement the other day from WorthPoint, an online resource for the global antiques and collectables community, that explained its new deal to buy eBay antiques data. That data (price, descriptions and images from 150 million transactions) combined with WorthPoint's other data sources including GoAntiques.com, TIAS and leading auction houses forms the most comprehensive research database for antiques. The data is sourced from a company called Advanced eCommerce Resource Systems, the sole authorized re-licenser of eBay market data.
There are mountains of data created every day; in fact the tally for 2010 was around 1.2 zettabytes (or 1.2 trillion gigabytes) according to a study from IDC commissioned by EMC. To put that in some sort of perspective that would be about 19 billion completely full 64 GB iPads or about 800 trillion copies of the famous novel Atlas Shrugged by Ayn Rand. The report also estimates that about 70% of that data is created by individuals and ranges from transaction data to all manner of socially generated content. Think about the things you do every day, shopping for groceries, bet you swiped your store card for a discount and used a debit or credit card to pay. Maybe you checked in on FourSquare when you got to the store, updated your facebook status, used a groupon coupon and even tweeted about the sale on fresh fish. Let's just say that the digital footprint you generate every day is significant and very telling directly online and offline in a variety of situations.
That's half the equation though, all of that data you generated is collected by some organization. Taken individually each data source provides some useful information but if you could aggregate it somehow, the overlap would tell a very complete story...what you like when, daily activities, interests, where you go, what catches your attention and all manner of behavioral clues.
There are three basic flavors of this data, transaction, behavioral (social) and location or contextual. The data can be used, once aggregated and analyzed either individualized and generalized. My opening example of WorthPont's new antique database is a great example of the generalized use of this data, mostly transaction data in this use case. Generalizing the data can provide everything from pricing trends to brand sentiment or broad public opinions. Brick and mortar stores can use it for merchandising, pricing, planning ad spend, designing loyalty programs, etc.
Individualizing the analysis of the available data can support both online and offline programs including online ad targeting, online and offline offer targeting, online dynamic pricing, individualized marketing programming, etc. Ultimately the inclusion of the behavioral and contextual data can lead to predicting future action, one of the ultimate goals for commerce. Predicting what might capture your interest, what and when you might buy, all of these are gold for merchants.
To some the discussion of this level of data collection and analysis may seem creepy or even an invasion of privacy. The key from a business perspective is to only use data that the individual has given permission to use. Some of the permissions are explicit and some is implicit though. The use of credit cards and store cards, for example, come withy implicit permission to collect and use data. On the other hand, social networks have an extensive set of permissions and controls over personal data (read the fine print though). From a business perspective it's pretty obvious why there's some much interest in finding ways to collect, analyze and use all of the data. What's just as important though is gaining an understanding of what's in it for the individual? The benefits vary by individual and by the specific use of course but in general the use of this data can make your overall experience with a business more individualized and personal. It can also lead to better and more compelling loyalty programs, sales / offers, coupons, etc. In other words there are some very good personal benefits that are exchanged for giving up some privacy.
The use of data in retail isn't a new thing, but the amount of data and the ways it can be used is. The addition of the behavioral and contextual data to the existing transaction data is very promising, although many of these systems are pretty new but evolving quickly. Predictive analysis is particularly interesting and promising. Big data and its use is a key component in the new commerce / commerce 2.0. More innovative use is coming as the lines between online and offline blur through the growth of mobile and social commerce. This year should see some innovative new uses and systems to support that use.
Tags: commerce, big data, commerce 2.0, social, mobile, loyalty, retail
I was flying across the US last week and was really annoyed to find that my flight didn't have Wifi. I mean really, 6 hours without an Internet connection, how would I get anything done? Of course when I have an inflight connection I still find myself complaining about the speed. I'm reminded of a comedy routine that I saw on YouTube from Louis C.K. "
The Spring 2011 user conference season is finally winding down and for me basically ended last week as I attended my fourth Deltek Insight user conference. Deltek, a company on a multi-year journey of transformation from a sleepy family run culture to a fast growth, innovative international public software company, has always had two strong foundation blocks on which to build, a fiercely loyal customer base and a focus on project based businesses. The Deltek I saw this year looks very different from the one of four years ago, having made several key acquisitions, particularly in the last year, leveraged some key trends in social business, moved some of its portfolio into the cloud, expanded significantly internationally and made some management team adjustments to meet the needs of a company making a run to break through the $500M revenue milestone. Deltek goes to market in two distinct business lines, Government (government agencies and government contractors) and Commercial Project Based Industries (Architectural, Engineering and Construction, Advertising, PR and Marcom, Accounting, Energy and Environmental, Legal Services, IT and Management Consulting, Project Manufacturing, Nonprofit and Aero and Defense), a strategy that has been in place now for some time, but this year saw some interesting enhancements in both lines of business.
I spent time this week in San Francisco with the Netsuite team and a good cross section of customers and partners at its first annual global user conference. The conference was well managed and very well attended with over 2000 attendees. From my perspective it was also packed with content and provided an interesting view into the emerging strategy that is supposed to continue Netsuite on it current path of fast growth and global expansion. I should also point out that I had quite a bit of fun at a special reception that Netsuite
Businesses operate because of conversations, this is not some great new revelation. We like to talk about how social is about enabling conversations like it's something revolutionary and new but that's just not true. I was preparing to give a talk to a group of sales executives this week on what social business can do for sales people and I actually put on a slide that social is about conversations, when it hit me how silly it sounds to tell sales people they should have conversations with customers. I'm pretty sure that if anybody in a business understands the importance of conversations it would be the sales team. If they don't they don't last long as a sales person or maybe the business itself doesn't survive. So why do we keep talking about conversations if at least part of the business has always been "social"?
Groupon's IPO is potentially valued up to $25 billion and it's subscriber base is doubling once a quarter, LivingSocial raised $400M in venture funding, Scoutmob nails $1.5M in it's first funding round, FourSquare hits 3M daily check ins and Facebook
I keep a list of all of the social software vendors I talk to and as I was updating it this morning I realized that it might prove useful to provide it here. Now it's certainly not ranked in any way, nor is it complete. I'm sure there are some companies that I've left off, and if you know of any please put them in the comments. The solutions for social business use are evolving rapidly and there are new offerings popping up all of the time and the more established social vendors are consolidating. I also expect that larger enterprise vendors will do their share of roll ups this year, as evidenced by Salesforce.com's recent acquisition of Radian6. For basic categories I'm using what is a loose interpretation of a social taxonomy that we (IDC) plan to publish later this summer. I won't provide the detail for each, but here's a brief guide:
