π¬ video.infosec.exchange video.infosec.exchange
The billion row challenge: splitting lines using SIMD in Rust
I was scared to do it, but it was actually fine! This time we look at the quickest way to split up massive text files into separate lines, first by implementing our own zero-copy version of `BufReader::lines` and later using SIMD, which allows us to process 64 bytes simultaneously, using a single CPU instruction! I'm pretty sure this is the first time we've ventured into `nightly` Rust on this channel... You can find the code at https://codeberg.org/andybalaam/changelog-builder Read my blog at https://artificialworlds.net/blog Follow me on mastodon: [@andybalaam@mastodon.social](https://mastodon.social/@andybalaam)
βhttps://video.infosec.exchange/w/oyJg67E2P8HfuAcxPDboSm
Indexiert von findnix.eu Β· Eigene Seite einreichen