Sunday , April 2 2023

The Observatory joins Ceph Foundation to advance open source storage


Yesterday, in Berlin, SARAO joined a further 30 members in setting up the Ceph Foundation to manage the massive growth of data and information generated by cloud, container and artificial intelligence applications.

The Linux Foundation, a nonprofit organization that allows mass innovation through open source, has announced that over 30 world leaders in technology form a new foundation to support the Ceph open source community. The Ceph project develops a unified distributed storage system, providing applications with object, block, and file system interfaces.

"Ceph has a long experience in success when it comes to helping organizations efficiently manage high growth and expanding data storage requirements," said Jim Zemlin, executive director of the Linux Foundation. "This partnership will help us store and retrieve the huge volumes of data that will be collected by the MeerKAT telescope," says Dr. Rob Adam, SARAO General Manager.

MeerKAT is a radio telescope with 64 antennas that was built on Karo's SKA site and will be integrated into the first phase of the Square Kilometer Array. MeerKAT has the ability to process real-time 275 gigabytes per second – equivalent to about 58 DVDs per second. SARAO currently uses Ceph to synthesize a ~ 20 petabyte object-based storage system for data generated by the MeerKAT radio telescope matrix.

Ceph is used by cloud providers and businesses around the world, including financial institutions (Bloomberg, Fidelity), cloud service providers (Rackspace, Linode), academic and governmental institutions (Massachusetts Open Cloud), telecommunications infrastructure providers (Deutsche Telekom) (BMW), software solutions providers (SAP, Salesforce) and more.

Ceph is also used by Rook, a Cloud Native Computing Foundation project that delivers smooth storage of files, blocks, and objects in Kubernetes, running the Ceph storage infrastructure alongside the applications which consumes storage.

Scalable, agile and massively scalable, Ceph significantly reduces the cost of storing business information in the private cloud and provides high availability for any blocked object, file, and data. Blocking and storing files is critical to any IT infrastructure organization and is an important component of infrastructure platforms such as OpenStack and Kubernetes.

Increasing new cloud, container and artificial intelligence / learning machine applications increases Ceph usage. Ceph combined with in-car analysis and learning can, for example, allow businesses to combat massive amounts of unstructured data to quickly identify customer behavior patterns, customer conversations, and potential non-compliance scenarios.

"A guiding vision for Ceph must be the current state of reliable and reliable storage technology and do so with 100% open source," said Sage Weil, co-creator of Ceph, project leader and chief architect at Red Hat for Ceph.

"While public cloud providers have popularized the auto-service storage infrastructure, Ceph brings the same capabilities to service providers, businesses and individuals with the power of robust development and the user community to drive future innovations in space Ceph Foundation is a testament to the strength of a diverse open source community that meets to address the explosive growth of storage and data services. "

"Ceph was designed and built for scalability, initially with supercomputers and later with cloud infrastructure in mind. A key design premise was that the storage system must provide a highly reliable and available service in a dynamic hardware environment and increasingly heterogeneous in everything, "said Carlos Maltzahn of the University of California, Santa Cruz, co-founder of the research project that created Ceph for the first time a decade ago.

Thomas Bennett, Senior Software Systems Engineer at SARAO, says: "SARAO uses Ceph in concert with local hardware to reduce the storage costs of the MeerKAT storage infrastructure." To share our experience and present Ceph, the team SARAO storage is in the process of establishing a Cape Town Ceph community forum. "

Related Links

South Africa's Astronomy Observatory

Star Chemistry, the universe and everything in it

Thank you for being here;

We need your help. The SpaceDaily news network continues to grow, but revenue has never been more difficult to maintain.

With the rise of Ad Blockers and Facebook – our traditional sources of revenue through advertising in quality networks continue to decline. And unlike many other news sites, we do not have a paywall – with those annoying usernames and passwords.

Our coverage of news requires time and effort to publish 365 days a year.

If you find our informative and useful news sites, please consider becoming a regular supporter or, for the time being, make a unique contribution.

SpaceDaily Contributor

$ 5 billed once

credit card or paypal

Monthly support for SpaceDaily
$ 5 Monthly Fees

paypal only

Multimessenger links to NASA's Fermi Mission show how luck favors preparedness

Greenbelt MD (SPX) 09.11.2018

In 2017, NASA's Gamma Space Telescope played a key role in two major breakthroughs that took place just five weeks ago. But what might seem like an extraordinary good fortune is indeed the product of research, analysis, training and development that has lasted more than a century.

On August 17, 2017, Fermi detected the first light ever seen from a source of gravitational waves – the space-time waves produced in this case by the fusion of two superdense neutron stars. Just five weeks at … read more

Source link