Commits on May 7, 2019

1. ensure S3Store does not attempt to write too-large chunks to S3 (… …

   …5+ GiB)
   
   Underlying library ``s3fs`` automatically writes objects to S3 in "chunks"
   or "parts" -- *i.e.* via multipart upload -- in line with S3's *minimum*
   limit for multipart of 5 MiB.
   
   This should, in general, avoid S3's *maximum* limit per (part) upload of
   5 GiB. **However**, ``s3fs`` assumes that no *single* ``write()`` might
   exceed the maximum, and as such fails to chunk out such too-large upload
   requests prompted by singular writes of 5+ GiB.
   
   This can and should be resolved in ``s3fs``. But first, it can, should
   be and is resolved here in ``S3Store``.
   
   resolves #530

   

   jesteria committed May 7, 2019
   Configuration menu

   • View commit details
   • Copy full SHA for be4f431
   • Browse repository at this point

   Copy the full SHA

   be4f431 View commit details

   Browse the repository at this point in the history