dfs-datastores
dfs-datastores copied to clipboard
PailRecordWriter should bound number of open files
Right now, a PailRecordWriter can open an unlimited number of files. Instead of using a HashMap to contain the mapping of attributes to open files, PailRecordWriter should use a LinkedHashMap and close the eldestEntry when the number of open files exceeds a constant, say 128.
Otherwise, for some bad cases, the number of open files can exceed the per process limit, resulting in an exception.