Mercurial > hg > Lemuriformes
view lemuriformes/chunk.py @ 12:82cd4e0b66cf
csv2sql
author | Jeff Hammel <k0scist@gmail.com> |
---|---|
date | Sun, 10 Dec 2017 15:18:00 -0800 |
parents | 244c29f46554 |
children |
line wrap: on
line source
def chunk(data, chunksize=100000): """ chunk `data` into smaller sizes of `chunksize` """ offset = 0 chunk = data[0:chunksize] while chunk: yield chunk offset += chunksize chunk = data[offset:offset+chunksize]