??vroom
The fastest delimited reader for R, 1.40 GB/sec/sec.
But that’s impossible! How can it be so
fast?
vroom doesn’t stop to actually read all of your data, it simply
indexes where each record is located so it can be read later. The
vectors returned use the Altrep
framework to
lazily load the data on-demand when it is accessed, so you only pay for
what you use. This lazy access is done automatically, so no changes to
your R data-manipulation code are needed.
vroom also uses multiple threads for indexing, materializing
non-character columns, and when writing to further improve performance.