rdos wrote:
I think this M.2 device should work:
https://www.samsung.com/us/computing/me ... 7s2t0b-am/. It has 3.3GB/s write speed and 2TB capacity.
3.3GB/s will be peak speed, and probably not sustainable over the long term. Modern SSD use some of the FLASH in SLC mode for fast writes, but it's limited in size, perhaps only a few of percent of the total FLASH, and used for smaller bursts of writes over a few seconds. After that, it'll degrade to TLC FLASH, with a corresponding reduction in performance.
This cache effect can be seen in synthetic benchmarks such as the
Anandtech benchmark suite. And synthetic benchmarks like this represent the best case.
To sustain the performance you need, you might have to consider striping across multiple drives
rdos wrote:
Korona wrote:
Do you really need an FS in such a situation? I would consider writing directly to a partition. You can then have some kind of index file that is stored on a proper FS on another partition.
It's kind of awkward to have the data on a raw partition. If I have it in a file I can easily copy it to an USB drive or save it elsewhere. Also, using a file I can more easily decide how much data to save, while with a partition, I would need to repartition the drive or use larger sizes than necessary.
This whole project sounds quite awkward. Writing to a partition with simple indexing, and wasting a bit of space, is a perfectly valid trade off. To write at full speed, you'd want to preallocate space to the files anyway, as you don't want filesystem meta-data being written in the middle of your data dump.
Just curious, what are you sampling?