IT News - Storage

Storage Facing Trillion-Row Database Apocalypse
Blocks & Files, April 28th, 2022
A new era of large-scale analytics and storage is opening up ahead of us. Ocient, Imply, VAST Data, and WEKA are four startups positioned to store and access data among hundreds of petabytes or trillions of database rows in seconds.

Chris Mellor writes in Blocks & Files, "They all employ massively parallel access techniques in one way or another and fundamentally use software rather than hardware to achieve their performance levels.

Update. SingleStore's database can chew through a trillion rows/second using 448 Xeon Platinum 8180 Skylake cores, 28 per server, as its blog describes. The data was stored on SSDs, though that wasn't really significant since the queries were run warm-start, so the data was already cached in memory. The network was 10-gigabit Ethernet..."

DCIG is pleased to announce the 2022-23 DCIG TOP 5 Multi-Cloud SDS Object Storage Solutions. These products represent the TOP 5 SDS-based object storage solutions organizations should consider for multi-cloud deployments.

"Enterprise storage used to be only purchased as an appliance, with proprietary software inextricably bound to its hardware," notes Todd Dorsey in DCIG.

"Software-defined storage (SDS) changed this paradigm by separating the software from its underlying hardware. Decoupling the software from its physical storage opens many benefits.

Early applications for software-defined storage were limited, on-premises use-cases, but maturing SDS brought expanded features and deployment options. SDS reached out of the data center to the cloud. Organizations could tier data to cloud storage and even run SDS in the cloud within virtualized server environments..."

The vocabulary of sources and sinks are beginning to appear in the world of data storage as we witness the new addition of data processing frameworks and the applications in this space.

cfheoh writes in Stoarge Gaga, "I wrote about this in my blog 'Rethinking data. processing frameworks systems in real time' a few months ago, introducing my take on this budding new set of I/O characteristics and data ecosystem. I also started learning about the Kappa Architecture (and Lambda as well), a framework designed to craft and develop a set of amalgamated technologies to handle stream processing of a series of data in relation to time.

In Computer Science, sources and sinks are considered external entities that often serve as connectors of input and output of disparate systems. They are often not in the purview of data storage architects. Also often, these sources and sinks are viewed as black boxes, and their inner workings are hidden from the views of the data storage architects..."

How Enterprises Can Ensure NVMe Security In 2.0
SearchStorage, April 28th, 2022
Today's world demands airtight security more than ever. Key NVMe security features, such as namespaces, the Lockdown command and TLS in NVMe over TCP, keep data safe.

Dave Raffo writes in SearchStorage, "NVMe is the dominant interface for enterprise SSDs, and both its uses and features are expanding. However, greater adoption of any enterprise technology shines a light on its gaps.

As with all storage, security is more about protecting data on drives than the drives themselves. In many ways, NVMe SSDs use similar security as other types of drives -- particularly in the areas of encryption and key management.

New developments specific to NVMe security bear watching. These include NVMe-oF and features added to the NVMe 2.0 specification released in mid-2021..."

'STaaS for all' drives transformation by delivering as-a-service agility and flexibility. Before you invest, make sure your STaaS solution can power every workload across the infrastructure lifecycle.

Simon Watkins writes in CIO, "Just a few years ago, enterprises were rapidly shifting to a cloud-first IT model in the expectation that moving operations to the cloud would solve many, if not all, of IT's roadblocks, while offering few, if any, drawbacks. The public cloud delivered a new kind of IT and a new kind of experience - scalable, seamless, and simplified. Cloud set the standard for agility with an operational model that enabled customers to deploy new apps and services quickly and easily..."

See all Archived IT News - Storage articles See all articles from this issue