IBM, Monday committed more than 3500 researchers and developers to work on Apache Spark open source big data project. The company also said that it will train more than 1 million data scientists and data engineers on Spark.
The IT giant plans to embed Spark into its Analytics and Commerce platforms, and offer Spark as a service on IBM Bluemix Cloud. IBM will also open source its IBM SystemML machine learning technology and collaborate with Databricks to advance Spark’s machine learning capabilities.
Beth Smith, General Manager, Analytics Platform, IBM Analytics
IBM has been a decades long leader in open source innovation. We believe strongly in the power of open source as the basis to build value for clients, and are fully committed to Spark as a foundational technology platform for accelerating innovation and driving analytics across every business in a fundamental way. Our clients will benefit as we help them embrace Spark to advance their own data strategies to drive business transformation and competitive differentiation.
Anand Mahurkar, CEO, Findability Sciences
Apache Spark with IBM BigInsights has given us tremendous capacity for our implementations for small and medium businesses, where MapReduce was not efficient. With Spark, the performance has improved multi fold. We’re now able to process streaming data from IoT devices and offer analytics for data in motion for things like traffic, commuters and parking.
