SOURCE: The Linux Foundation

The Linux Foundation

June 27, 2016 11:30 ET

Apache™ Hadoop® Distributions Now ODPi Runtime Compliant

Altiscale, ArenaData, Hortonworks, IBM, and Infosys First to Comply With Industry Standard for Big Data Applications

SAN FRANCISCO, CA--(Marketwired - June 27, 2016) - ODPi, a nonprofit organization accelerating the open ecosystem of big data solutions, today announced that the Apache™ Hadoop® distributions products from Altiscale, ArenaData, Hortonworks, IBM, and Infosys are now ODPi Runtime Compliant. This ensures that their distributions provide big data application vendors a consistent set of base level expectations as defined by ODPi Runtime specification.

"Our members represent all key roles in the big data ecosystem -- Apache Hadoop distros, ISVs, system integrators, solution providers and end users -- and have brought their real-world experience in helping to align enterprise demands with the developer community," said John Mertic, director of program management for ODPi. "Having Altiscale, ArenaData, Hortonworks, IBM, and Infosys declare compliance with the ODPi Runtime Specification is a strong step toward simplifying and standardizing the big data ecosystem to accelerate the delivery of business outcomes."

ODPi's work complements the Apache Software Foundation and helps companies use Apache Hadoop more effectively. The organization's aim is to develop a cross-industry standard that enables developers to easily write applications that sit on top of big data stacks, lowering the costs of interoperability across systems.

ODPi Compliant Guidelines and Testing
Descending from Apache Hadoop 2.7, the Runtime Specification covers HDFS, YARN, and MapReduce components. It specifies how Apache components should be installed and configured and provides a set of tests for validation to make it easier to create big data solutions and data-driven applications.

To become ODPi compliant, the Apache Hadoop distributions submitted test results through a GitHub repository for specific products. To assist with compliance, ODPi provides a test suite and a reference build. The ODPi validation test suite guarantees that a distribution of Apache Hadoop from a compliant vendor or an end-user deployment of Apache Hadoop complies with the ODPi-defined specifications. The test framework and self-certification aligns closely with the Apache Software Foundation by leveraging Apache BigTop for comprehensive packaging, testing, and configuration.

Participation in the ODPi is open to anyone, with all work being done is public on GitHub. Developers can join the conversation on the mailing lists or Slack channel, as well as give feedback on the spec or provide tests for validating ODPi compliance.

What's Next for ODPi
The ODPi Operations Specification to help enterprises improve installation and management of Apache Hadoop and Apache Hadoop-based applications will be available later this year. The Operations Specification leverages Apache Ambari as a reference project. Apache Ambari is an ASF project for provisioning, managing, and monitoring Apache Hadoop clusters.

Comments from Members
Altiscale
"The Apache Hadoop ecosystem is both expanding and evolving rapidly, which not only makes it hard for app developers to keep up with the wide variety of projects, it also makes it challenging for enterprise customers to commit to a Hadoop platform and agree on the capabilities that they need. The ODPi standard specification addresses these issues, providing a solid foundation and peace of mind to developers and enterprise customers. At Altiscale, we are excited to announce that the Altiscale Data Cloud is now officially ODPi Runtime compliant." - Mike Maciag, COO at Altiscale

ArenaData
"As a small company running Apache Hadoop distributions and looking to expand in the Russian market, becoming ODPi Runtime compliant will help us provide current and future customers reassurance that their developing and testing applications will work across multiple platform providers." - Dmitry Komarov, head of sales and marketing at ArenaData

EMC Corporation
"The compliance of various distributions and application vendors on the ODPi runtime is a milestone. It provides standardization and portability for developers as well as ISVs and cloud administrators. Ultimately the goal is to provide increased efficiency and lower maintenance impact. Our customers can expect much more flexibility in their deployments and choice of solutions." - Smiti Sharma, Product Lead, Virtustream Cloud Services, EMC

SAS
"With Apache Hadoop distributions becoming ODPi Runtime compliant, we are able to focus on developing innovative applications and solutions for our customers that are compatible with the Hadoop ecosystem." - Craig Rubendall, vice president of platform R&D, SAS

Hortonworks
"We are proud to become ODPi Runtime compliant, which aligns with our Hortonworks Data Platform certification program. The ODPi common reference specs should lower the investment for application builders and increase the number of applications in the ecosystem, allowing us to provide greater value to our customers." - Alan Gates, co-founder, Hortonworks

IBM
"ODPi is providing a common specification to develop big data apps, opening up choices for developers by enabling interoperability across different distribution and application offerings. Having this platform to count on, starting with a small, specific and consistent packaging model that lives within the ecosystem, is extremely valuable to application developers. This will be a key differentiator for IBM to serve customers, which is why we have become ODPi Runtime compliant." - Ritika Gunnar, Vice President of Offerings, IBM Analytics

Infosys
"Infosys is focused on growing the adoption of big data technologies in the enterprise by making significant improvements in areas like development and deployment tools, performance and security. By becoming ODPi Runtime compliant, we are providing a compatible solution to our enterprise clients in Banking, Aeronautics and Retail." - Navin Budhiraja, SVP, Head of Architecture and Technology at Infosys Limited

Additional Resources

About ODPi
ODPi is a nonprofit organization committed to simplification and standardization of the big data ecosystem with a common reference specification. As a shared industry effort, ODPi members represent big data technology, solution provider and end user organizations focused on promoting and advancing the state of Apache Hadoop® and big data technologies for the enterprise. For more information about ODPi, please visit: http://www.ODPi.org.

Contact Information

  • Media Contact:
    Natasha Woods
    ODPi
    (415) 312-5289
    pr@odpi.org