When reading from many possibly large files in a fashion similar to random access, it is usually the fastest and most efficient to use memory maps. Although memory maps have many advantages, they represent a very limited system resource as every map uses one file descriptor, whose amount is limited per process. On 32 bit systems, the amount of memory you can have mapped at a time is naturally limited to theoretical 4GB of memory, which may not be enough for some applications.
The documentation can be found here: http://packages.python.org/smmap
Package Version | Update ID | Released | Package Hub Version | Platforms | Subpackages |
---|---|---|---|---|---|
3.0.2-bp155.2.13 info | GA Release | 2023-05-22 | 15 SP5 |
|
|
3.0.2-bp154.1.49 info | GA Release | 2022-05-09 | 15 SP4 |
|
|
3.0.2-bp153.1.15 info | GA Release | 2021-03-06 | 15 SP3 |
|
|
3.0.2-bp152.1.1 info | GA Release | 2020-04-28 | 15 SP2 |
|
|
0.9.0-bp151.3.1 info | GA Release | 2019-07-16 | 15 SP1 |
|
|
0.9.0-bp151.2.10 info | GA Release | 2019-05-18 | 15 SP1 |
|
|
0.9.0-bp150.2.4 info | GA Release | 2018-07-30 | 15 |
|
|