gravitino
gravitino copied to clipboard
Optimize the configuration iterator in FileSystem provider
The following code is very time-consuming in FileSystemProvider like HDFSFileSystemProvider and needs to be optimized according to performance test:
Configuration configuration = new Configuration();
config.forEach(
(k, v) -> {
configuration.set(k.replace(GRAVITINO_BYPASS, ""), v);
});
The operation configuration.set() will take much time.
We can convert the map to an XML stream and store the XML stream in the configuration only once.
@yuqi1129 please assign it to me.