Oops! The input is malformed!
Originally published 3 October 2013
Search and analysis are not the same at all. And the fact that they are different really matters.
What is search? Search starts with knowing what you want to search for. Suppose we want to find all occurrences of the name “Joe Foster.” A search turns up all the places where “Joe Foster” is found. Sounds pretty simple, right?
Well, let’s look a little closer at this seemingly simple proposition. Our first proposition is that we know what we are looking for before we start. In this case, we are looking for “Joe Foster.” And as long as we know what we are looking for before we start, everything is fine. But what if we don’t know what we are looking for? What if we want to find all men who are older than 50, are retired military and live in Alabama?
Trying to use search technology is fine if we know what we are looking for at the outset. But if we don’t know what we are looking for at the outset search technology is pretty limited.
But there are other limitations to search. What happens when we do a search on “Joe Foster” and we find some hits? What do we know about “Joe Foster”? We know that he exists in a database, and we know how many times he exists there. But that’s it. We don’t know if Joe is a preacher, a rock collector, a dog trainer or a clown. In short, all we know is that there are multiple occurrences of “Joe Foster” in a database. And that’s all we know. We don’t even know if the first “Joe Foster” that we found is the same “Joe Foster” that exists elsewhere. The occurrences may be references to two entirely different people.
So we see that search has its limitations.
Now what about analysis? Analysis assumes we know just a little bit more about the data that we are going to analyze. Analysis assumes that we know such things as metadata about the data we are searching for. Metadata is just another form of context. In general, search assumes no context, but analysis assumes that there is context associated with the data that will be analyzed.
Therefore, when we do analysis we don’t have to know what we are looking for before we start. We can do a general purpose query such as: Show me all the men in Tennessee who played football for the Green Bay Packers. Or we can pose queries such as: Count the number of long-arm quilters in Colorado who do independent work. In analysis we have context so we can ask much more incisive analytical questions that rely on the context to help shape the query.
So you see, there is a really big difference between search and analysis.
SOURCE: Big Data: Search vs. Analysis
Recent articles by Bill Inmon