textfile

text file IO utility module.

By default, it use “utf-8” encoding.

dataIO.textfile.write(s, path, encoding='utf-8')[source]

Write string to text file.

dataIO.textfile.writebytes(b, path)[source]

Write binary to file.

dataIO.textfile.read(path, encoding='utf-8')[source]

Read string from text file.

dataIO.textfile.readbytes(path)[source]

Read binary from file.

dataIO.textfile.smartread(path)[source]

Read text from file, automatically detect encoding. chardet required.

dataIO.textfile.to_utf8(path, output_path=None)[source]

Convert any text file to utf8 encoding.

dataIO.textfile.readlines(path, encoding='utf-8', skiplines=None, nlines=None, strip='right')[source]

skip n lines and fetch the next n lines.

Parameters:
  • skiplines – default None, skip first n lines
  • nlines – default None, yield next n lines
  • strip – default None, available option ‘left’, ‘right’, ‘both’
dataIO.textfile.readchunks(path, encoding='utf-8', skiplines=None, chunksize=None, strip='right')[source]

skip n lines and fetch the next n lines as a chunk, and repeat fetching.

Parameters:
  • skiplines – default None, skip first n lines
  • chunksize – default None (size-1 chunk), lines chunk size
  • strip – default None, avaliable option ‘left’, ‘right’, ‘both’