Do you work on the project on GitHub? You can use this tool to automatically sync your GitHub releases to SourceForge, so that your projects have a backup location, and take advantage of SourceForge's massive reach.

× 159017813 story
Data Storage Operating Systems

BeauHD posted from the out-with-the-old-in-with-the-new dept.

DidgetMaster writes: Hard drive costs now hover around $20 per terabyte (TB). Drives bigger than 20TB are now available. Fast SSDs are more expensive, but the average user can now afford these in TB capacities as well. Yet, we are still using antiquated file systems that were designed decades ago when the biggest drives were much less than a single gigabyte (GB). Their oversized file records and slow directory traversal search algorithms make finding files on volumes that can hold more than 100 million files a nightmare. Rather than flexible tagging systems that could make searches quick and easy, they have things like "extended attributes" that are painfully slow to search on. Indexing services can be built on top of them, but these are not an integral part of the file system so they can be bypassed and become out of sync with the file system itself. It is time to replace file systems with something better. A local object store that can effectively manage hundreds of millions of files and find things in seconds based on file type and/or tags attached is possible. File systems are usually free and come with your operating system, so there seems to be little incentive for someone to build a new system from scratch, but just like we needed the internet to come along and change everything we need a better data storage manager.

See Didgets for an example of what is possible.

In a Substack article, Didgets developer Andy Lawrence argues his system solves many of the problems associated with the antiquated file systems still in use today. "With Didgets, each record is only 64 bytes which means a table with 200 million records is less than 13GB total, which is much more manageable," writes Lawrence. Didgets also has "a small field in its metadata record that tells whether the file is a photo or a document or a video or some other type," helping to dramatically speed up searches. Do you think it's time to replace file systems with an alternative system, such as Didgets? Why or why not?

Slashdot

Fight Back Against the Latest Threats With ConnectWise Fortify. Advanced Threat Detection & Response by Your Side

You can get a free demo.

Array(0x5568e680f960)