Show Hide image

Yahoo enhances Hadoop open source software

Addition of Security and Oozie will help businesses manage data.

Yahoo has enhanced its Hadoop open source software, adding the Security and Oozie programmes, which the company claims will allow enterprises to get value from their data and better manage their businesses.

Hadoop with Security enables authentication through integrating Hadoop with Kerberos, an open source authentication standard that enables secure collaboration and sharing of authenticated data.

Oozie is an open-source workflow management and coordination engine to manage jobs running on Hadoop, including Distributed File System, Pig and MapReduce.

Melanie Posey, research director at IDC Research, said: "Businesses across all sectors are looking for ways to leverage the vast quantities of data they are accumulating, and Apache Hadoop is an efficient solution for processing data at scale. Hadoop has matured and is now becoming an enterprise-ready cloud computing technology with the addition of Kerberos authentication.

"Now organisations of various sizes can leverage Yahoo!'s Hadoop investment and deployments to run it on their own systems and build out their own Hadoop deployments without starting from scratch on internal science experiments."

Further, the Oozie is designed to run complex work processes and ETL. It has been tested and deployed across Yahoo. Yahoo is also collaborating with scientific community for system research on large-scale data clouds.