textfile¶
text file IO utility module.
By default, it use “utf-8” encoding.
-
dataIO.textfile.
smartread
(path)[source]¶ Read text from file, automatically detect encoding.
chardet
required.
-
dataIO.textfile.
readlines
(path, encoding='utf-8', skiplines=None, nlines=None, strip='right')[source]¶ skip n lines and fetch the next n lines.
Parameters: - skiplines – default None, skip first n lines
- nlines – default None, yield next n lines
- strip – default None, available option ‘left’, ‘right’, ‘both’
-
dataIO.textfile.
readchunks
(path, encoding='utf-8', skiplines=None, chunksize=None, strip='right')[source]¶ skip n lines and fetch the next n lines as a chunk, and repeat fetching.
Parameters: - skiplines – default None, skip first n lines
- chunksize – default None (size-1 chunk), lines chunk size
- strip – default None, avaliable option ‘left’, ‘right’, ‘both’