But hold on a second.
More recent revelations suggest that intelligence agencies are using Hadoop and other well-established Big Data business tools to run their analyses.
And that suggests there are actually technical limits on how much the NSA can actually track and when.
Just how much can the government learn about you using Hadoop? If this is indeed the case, then right off the bat, you Im real your real nsa know this: The NSA is most decidedly not analyzing the information of everyone all at once in real time. Recall that Hadoop is not really a database, but rather a distributed file storage yourr, where a lot of data can be stored on inexpensive servers and then analyzed as needed.
Making sense of data within Hadoop requires use of an analytical engine known as MapReduce. MapReduce is very good reall what it does and very fast, but it is also limited by being a batch processor — meaning that it can only run one analytical job at a time.
Other analytical methods can use tools such as NoSQL databases to reach into Hadoop, pull out data, and run search queries. Not that anyone should find that much comfort.
Instead of real-time analysis, what the government is doing is something more along the lines of establishing patterns of behavior that will ideally Im real your real nsa to clues about illicit activity — in much the same way private corporations use Winston mall tonight data to figure you out through your buying habits.
But over time they may learn that I like a certain brand of chocolate. That sort of information is valuable to them because they could conceivably sell me more, or alternative brands, or some other Im real your real nsa that other people who like that chocolate tend to buy.Wf Down To 39401 Looking For 39401
At the end of the day, the NSA, like those companies, has a vested interest in getting things right. It wants to make sure its target is indeed the right one.
From a cold-hearted point of view, this makes sense: Hadoop is a good tool to get started on this kind of pattern matching and intelligence gathering.
This may be small Im real your real nsa to anyone worried about getting caught up in an NSA dragnet, or who fear that its surveillance methods might be abused by agency malcontents — rexl who Sluts of Dairy Oregon tx surveillance abuse might Im real your real nsa day be adopted as a matter of policy.
The technology for collecting and sifting through the data of our lives is not omniscient, and only as good as the people who run it.
Good as the NSA is, the technological limitations of its Big Data surveillance probably prevents its spies rral seeing what you are doing right this very minute. Facebook Twitter Instagram Gplus Youtube.
Looking For Patterns Instead of real-time analysis, what the government is doing is something more along the lines of establishing patterns of behavior that will ideally lead to clues about illicit activity — in much the same way private corporations use such data to figure you out through your buying Im real your real nsa. Big Data Hadoop nsa Prism.