At the 2016 Spark Summit, Gartner Research Director Nick Heudecker asked: Is Spark the Future of Data Analysis? It’s an interesting question, and it requires a little parsing. Nobody believes that Spark alone is the future of data analysis, even its most ardent proponents. A better way to frame the question: Does Spark have a role in the future of analytics?
Read more
Many thanks to Australia’s Dez Blanchfield for his contributions to this roundup. We set out to create a special “Australia/APAC” edition; however, most of the stories have a global interest: chips are chips and deep learning is deep learning wherever you live. We did find this story, profiling a Tasmanian oyster farm that uses Microsoft’s IoT hub. Well, that’s embarrassing. MapR’s
Read more
On a Google blog, Kaz Sato describes how a Japanese farmer uses TensorFlow to classify cucumbers. Very good. Perhaps now Google can set TensorFlow to work figuring out how to comply with EU regulations. Good Reads Adrian Colyer returns for the Fall semester with daily papers. Superlative Reads Dez Blanchfield heaps praise on obscure blogger’s new book. HPE Holds a Fire Sale
Read more
Jim Kyung-Soo Liew and Tamas Budavari of Johns Hopkins ask whether Tweet sentiments still predict the stock market. Short Version: they do, but the market has arbitraged away any advantage from trading on the information. So there you have it: the stock market is efficient with respect to fundamental information, technical information, and Tweets. Enterra’s Stephen DeAngelis celebrates the “Algorithmic
Read more
In the second quarter of 2015, Hortonworks lost $1.38 for every dollar of revenue. In the second quarter of 2016, HDP lost $1.46 for every dollar of revenue. So I guess they aren’t making it up on volume. On the Databricks blog, Jules Damji summarizes Spark news from the past two weeks. AWS Launches Kinesis Analytics Amazon Web Services announces the availability
Read more
Quite a few open source announcements this week. One of the most interesting is Apache Bahir, which includes a number of bits spun out from Apache Spark. It’s another indicator of the size and strength of Spark, in case anyone needs a reminder. In other news, Altiscale and H2O.ai concurrently develop time travel: both vendors claim to support Spark 2.0,
Read more
Happy Leap Day. Tachyon’s rebranding as Alluxio, release of CaffeOnSpark and GA for Google Cloud Dataproc lead the hard news this week. The Alluxio announcement has inspired big thinkers to share big thoughts. And, we have a nice crop of explainers. Scroll down to the bottom for another SQL on Hadoop benchmark. Explainers — In SearchDataManagement, Jack Vaughn explains Spark
Read more
ML/AI 