Convergent data – not big data

Time for bold statements.  Convergent data is the future of “big data”.  Endless petabytes of homogenous data got the ball rolling,  now it’s time to design heterogeneous data models that get us to the goal line.  Converging data into new and powerful constructs will give us the playbook!  So, what is convergent data and why am I making this case?  Let me point out the first 3 principles.

  • Diversity
  • Velocity
  • Profiling

Each component of convergent data should be measured from 1 – 100 (your milage may vary).  Determine the range your application by measuring it against my three values.

The goal:  300 = autonomous convergence.

  • Diversity: Number of sources that contribute data to a new meta set, not just how many discrete data elements you have in a set, but how many sources you can manage into a meta set.  This will have the benefit of greater signal to noise ratios.
    • E.g. 1 = Census data from the US Government.  100 = Self reporting contextual objects
  • Velocity: The rate at which data is processed.  Real-time is just the start.  Models that anticipate or generate possibility plans will be a premium.
    • E.g. 1 = Static or very long term.  100 = “Precognitive” data modeling
  • Profiling: The useable focal point of data.  No focus is of no importance.  You have to create a nexus for the data to have context.  We are at the very start of an information flood. Having a sense of where to stand in will be life or death.
    • E.g. 1 = A target customer. 100 =  A digital Avatar

So why am I proposing a different approach?  First, Big Data is a technical solution, not a business solution.  Big data is an overused hype engine.  The value is real, but it’s application has been extended well beyond the value proposition.

“Big Data is revolutionizing 21st-century business without anybody knowing what it actually means. Now computer scientists have come up with a definition they hope everyone can agree on.” – MIT technology review

I propose we shift the conversation and tackle the real value through one very clear use case.  I propose this model.

    1. Virtual avatars are constructed from your digital persona.  A persona you are invited too,encourage to control and manage.  Think of this as your personal context engine
    2. Virtual devices built in a physical context, AKA the Internet of things.  These units are nodes of dynamic information that contain abstraction data in a processing node.  Think of this as your environmental context engine
    3. Simulation models creating a future context.  Possible outcomes are staged to enhance our experience with options and variations explored via our virtual avatar.  These are not pre-processed data warehouses, they are dynamic landscapes mapped out based on our current avatar.  Dynamic to the meta context of our place in reality.

The potential to both sides is huge.  Companies and users interacting in a dynamic world that is transparent to us on a moment by moment basis.  Our Avatars are designed to travel through virtual spaces that simulations possible interactions, validated by our real actions.  These environments allow our avatars to build context in anticipation of our physical arrival.  If we deviate, the feedback clears up the errors in a model.  Futures are anticipated while history is valued in proper context.  Options laid out in a digital reality are relayed back to us in real time through our devices giving us a new context as we travel or move about our day.  Cooperation becomes standard business practice.

  • Sound like science fiction that can’t happen?
  • Huge data that will clog the digital highway?
  • Latency that will deter even the most early adopters?

Executed without a proper design model, yes.  Designed with this in mind, no.  We can have a digital world that shadows us, helping us, and giving us more control than ever.  This will take planning and design that entrusts users to interact with business in a more holistic manner.  Localizing processing power and controls to end points where security and data is built into the model will be crucial.  Users can choose to share what they wish for the experience offered to them.  Companies develop virtual enhancements that help people complete sales not lure them into traps.  It’s all very possible, if we measure our approach.  Big Data is not the answer, but it is a beginning.

Spread the word. Share this post!

About the author

2 comments on “Convergent data – not big data”

  1. Pingback: Constructing big data | GIGO

  2. Pingback: Convergence is a Virtual Reality | GIGO

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: