1. 程式人生 > >超大文件打不開,分割下

超大文件打不開,分割下

python

同事說大文本文件打不開,寫個程序分割下就行了啊。。。

#!/usr/bin/env python3
# -*- coding:utf-8 -*-
# author: edit by infaaf
#   mail: [email protected]

# split big file per 10000

with open(‘source.txt‘) as f:
    linenum = 1
    filenum=1
    for line in f:
        if linenum >3:
            linenum=1
            filenum+=1
        with open(‘sourcesplit_%s‘%filenum,‘a‘) as outf:
            outf.write(line.strip()+"\n")

        print("linenum: %s, filenum: %s"%(linenum,filenum))
        print(line.strip())
        linenum+=1

超大文件打不開,分割下