NEC and Hortonworks, a leading Hadoop distribution provider announced plans to develop YARN (architectural center of Hadoop) and Spark (in-memory data processing engine) support for the NEC new vector engine platform, SX-Aurora TSUBASA.
This new platform, combined with NEC's Big Data platform "Data Platform for Hadoop," significantly improves processing performance and scalability to deliver better business results for Artificial Intelligence (AI), Machine Learning and Advanced Analytics, says NEC.
Prior to this co-development, NEC and Hortonworks announced an expansion of their strategic partnership in September, 2017 to deliver a Big Data processing platform. Utilizing their strengths, the two companies aim to offer new products suited for advanced and high performance Big Data analysis in a wider range of industries and fields. Moreover, the companies aim to provide the results of this co-development as open source software (OSS) that can be implemented in diverse environments and various industry use cases.
Tomoyasi Nishimura, SVP, NEC
The prime objective of the collaboration will be to provide a high-speed, parallel process computing environment best suited for customers with large amounts of data that can be utilized for developing and building essential Machine Learning-based use cases. Adding support to the vector engine for Apache, Hadoop, YARN and Spark helps the customer to quickly achieve effective results from Big Data and AI use cases.
Yuji Hirokawa, Regional VP, Hortonworks and MD Hortonworks Japan
An enormous amount of data is required to achieve high accuracy in Machine Learning. The combination of SX-Aurora TSUBASA's high processing performance and Hortonworks HDP's scalability will be an innovative choice in the global market.