amemv-crawler
amemv-crawler copied to clipboard
建议:下载时刷新缓存
with open(file_path, 'wb') as fh:
for chunk in resp.iter_content(chunk_size=1024):
fh.write(chunk)
fh.flush() # add 增加刷新缓存立即写入硬盘,大量下载时内存占用过高