* Mon Mar 25 2024 Dirk Müller <dmueller@suse.com>
- update to 2024.3.1:
* allow override of expand in open()
* root handling in local file paths, fix for windows
* coroutines throttle to stream pool rather than batches
* write transactions in simplecache
* allow deep nested refs in referenceFS/parquet
* Fixes bug (#1476) that made open_files ignore expand=False
* remove extra calling mapper contains
* connection retry for SMB
* zip64 should be on is allowZip64 is
* Fri Mar 08 2024 Ben Greiner <code@bnavigator.de>
- Update to 2024.2.0
[#]# Enhancements
* add 9P known implementation (#1513)
* allow TqdmCallback subclassing (#1497, 1480)
* callbacks/branching kwargs handling and scopes (#1496, 1495,
1460)
* add aluuxioFS to known implementations (#1469)
* implement pipe_file for dirFS (#1465)
[#]# Fixes
* infer compression for .lzma files (#1514)
* fix append to categorical/parquet references (#1510)
* allow for FTP servers that list with leading "total" line
(#1503)
* convert FTP failure to FileNotFound (#1494)
* out of order reference fix (#1492)
* retry "backoff" response for DBFS (#1491)
* referenceFS case for scalar arrays (#1487)
* fix create_parents for SFTP (#1484)
* fix local .ls() on files (#1479)
* allow Path and similar in _expand_path (#1475)
* make lazy references editable (#1468)
* fix eq for abstract buffered files (#1466)
* fit tqdm cleanup (#1463)
* fix passing kwargs from cached file to underlying FS (#1462)
[#]# Other
* fix tests for supports_empty_directories=False (#1512)
* don't read references in init for referenceFS (#1521)
* code cleaning (#1518, 1502, 1499, 1493, 1481)
* pass through "replication" for HDFS (#1486)
* record more info for HTTP info() (#1483)
* add timeout argument to githubFS (#1473)
* add more security pars to webHDFS (#1472)
- Skip testing python39: no longer supported since ipython 8.19
(via notebook)
* Fri Jan 12 2024 pgajdos@suse.com
- have a possibility to not use pyarrow for testing [bsc#1218592]
* Sat Dec 16 2023 Dirk Müller <dmueller@suse.com>
- update to 2023.12.2:
* top-level glob in ZIP (#1454)
* append mode on local ZIP files/truncate (#1449)
* restrict ":" as protocol marker to data: (#1452)
* sftp relative paths (#1451)
* http encoding in HTTP FS put_file (#1450)
* Thu Dec 07 2023 Dirk Müller <dmueller@suse.com>
- update to 2023.12.1:
* Remove trailing "/" from directory names in zipFS (#1445)
* allow HTTP size guess in more circumstances (#1440)
* allow kwargs passed to GUI to be dict (#1437)
* transaction support for writing via a cache FS (#1434)
* make cached FSs work better with async backends (#1429)
* allow FSs to set their transaction implementation (#1424)
* add dataFS (#1421, 1415)
* allow basic auth in webHDFS (#1409)
* in referenceFS, maintain order when some keys are omitted in
cat (#1436)
* nested subdirectory listing in referenceFS (#1433)
* allow "=" in webHDF paths (#1428)
* fix file mode to consistent "r+b" format (#1426)
* pass on kwargs in HTTP glob (#1422)
* allow Path in can_be_local and open_local (#1419, #1418)
* fix parent for cachedFS (#1413)
* "ends" list in _cat_ranges was incorrect (#1402)
* Tue Nov 14 2023 Ondřej Súkup <mimi.vx@gmail.com>
- update to 2023.10.0
* alias "local://" to "file://" (#1381)
* get size of file cache (#1377)
* stop unexpected kwargs for SMB (#1391)
* dos formatting (#1383)
* small optimisations in referenceFS (#1393)
* define ordering behaviour for entrypoints (#1389)
* add LazyReferenceMapper to API docs (#1378)
* Thu Oct 05 2023 Dirk Müller <dmueller@suse.com>
- update to 2023.9.2:
* revert #1358: auto_mkdir in open() (#1365)
* code style updates (#1373, 1372, 1371, 1370, 1369, 1364)
* update CI setup (#1386)
- 2023.9.1
* #1353, save file cache metadata in JSON
* #1352, remove some unnecessary list iterations
* #1361, re-allow None for default port for SMB
* #1360, initialising GUI widget FS with kwargs
* #1358, pass auto_mkdir vi url_to_fs again
* #1354, auto delete temp cache directory
- 2023.9.0
* #1346, add ocilake protocol
* #1345, implement async-sync and async-async generic cp and
rsync
* #1344, add lakefs protocol
* #1337 add goatcounter to docs
* #1323, 1328, add xethub protocol
* #1320, in HTTP, check content-encoding when getting length
* #1303, add on_error in walk
* #1302, add dirfs attribute to mappers
* #1293, configure port for smb
* #1349, don't reorder paths in bulk ops if source and dest are
both lists
* #1333, allow mode="x" in get_fs_token_paths
* #1324, allow generic to work with complex URLs
* #1316, exclude bytes-cache kwargs in url_to_fs
* #1314, remote utcnow/utcfromtimestamp
* #1311, dirFS's protocol
* #1305, use get_file rather than get in file caching
* #1295, allow bz2 to be optional
* #1340, 1339, 1329 more bulk ops testing
* #1326, 1296 separate out classes in file caching for future
enhancements
* Wed Jul 05 2023 Ben Greiner <code@bnavigator.de>
- Update to 2023.6.0
[#] Enhancements
* #1259, add maxdepth fo cp/get/put
* #1263, allow dir modification during walk()
* #1264, add boxfs to registry
* #1266, optimise referenceFS lazy lookups, especially for
writing parquet
* #1287, 1288 "encoding" for FTP
[#] Fixes
* #1273, (re)allow reading .zstd reference sets
* #1275, resource.error for win32
* #1278, range reads in dbfs
* #1282, create parent directories in get_file
* #1283, off-by-one in reference block writing
* #1286, strip protocol in local rm_file
[#] Other
* #1267, async bulk tests
* #1268, types and mypy
* #1277, 1279, drop outdated forms io.open, IOError
* Tue May 30 2023 Dirk Müller <dmueller@suse.com>
- update to 2023.5.0:
* #1236, allow writing ReferenceFS references directly to
parquet
* #1255, copy of glob to single output directory
* #1254, non-recursive copy of directory (no-op)
* #1253, cleanup fix on close of ZIP FS
* #1250, ignore dirs when copying list of files
* #1249, don't error on register without clobber is registering
same thing again
* #1245, special case for other_files and relative path
* Other
* #1248, add test harness into released wheel package
* #1247, docs and tests around common bulk file operations
* 2023.4.0
* #1225, comprehensive docs of expected behaviour of cp/get/put
and tests
* #1216, test harness for any backend
* #1224, small fixes in reference and dask FSs
* #1218, mv is no-op when origin and destination are the same
* #1217, await in AbstractStreamedFile
* #1215, docbuild fixes
* #1214, unneeded maxdepth manipulation in expand_path
* #1213, pyarros and posixpath related test fixes
* #1211, BackgroundBlockCache: keep a block longer if not yet
used
* #1210, webHDFS: location parameter
* Other
* #1241, add HfFileSystem to registry
* #1237, register_implementation clobber default changes to
False
* #1228, "full" and "devel" installation options
* #1227, register_cache and reporting collision
* #1221, docs about implementations and protocols
* Sun Apr 02 2023 Ben Greiner <code@bnavigator.de>
- migrate to PEP517
- Enable pyarrow tests
- Reenable distributed test for python311