node icon indicating copy to clipboard operation
node copied to clipboard

"json" encoding support for fs.readX functions

Open Milk-Cool opened this issue 1 year ago • 5 comments

What is the problem this feature will solve?

The JSON.parse(fs.readFileSync(path)), fs.readFile(path, "utf-8", res => { res = JSON.parse(res); /* ... */ }) look just way too long and complex.

What is the feature you are proposing to solve the problem?

The "json" encoding for the builtin fs module. Here's how it might look like:

const users = fs.readFileSync("users.json", "json"); // Or { "encoding": "json" }

As you can see, it's much shorter and more clear.

What alternatives have you considered?

As I've shown above, JSON.parse is a variant right now, but it's just way too long. There's also r-json package, but having a separate package just for reading JSON files takes much more space.

Milk-Cool avatar Aug 06 '22 10:08 Milk-Cool

This can be roughly achieved via one helper function in userspace without external packages, e.g.:

const readJSON = async path => JSON.parse(await fsPromises.readFile(path));
// or
const readJSONSync = path => JSON.parse(fs.readFileSync(path));

Parsing JSON format probably would not have any performance benefits from being included in core, and there might be some discrepancy between possible/expected behaviours (e.g. should we strip BOM for convenience or keep it strict). Are there usecases where it is required specifically as part of fs?

LiviaMedeiros avatar Aug 06 '22 15:08 LiviaMedeiros

For what it's worth you can do require(path) instead of JSON.parse(fs.readFileSync(path)) which would work since you can require JSON files.

benjamingr avatar Aug 07 '22 11:08 benjamingr

For what it's worth you can do require(path) instead of JSON.parse(fs.readFileSync(path)) which would work since you can require JSON files.

Except that it would depends on the module cache, which may or may not be in sync with the actual file. You can also import(pathToFileUrl(path), { assert: { type: 'json' } }) with the same caveat.

aduh95 avatar Aug 08 '22 15:08 aduh95

For what it's worth you can do require(path) instead of JSON.parse(fs.readFileSync(path)) which would work since you can require JSON files.

Yoooooo that's cool

Milk-Cool avatar Aug 08 '22 15:08 Milk-Cool

This can be roughly achieved via one helper function in userspace without external packages, e.g.:

const readJSON = async path => JSON.parse(await fsPromises.readFile(path));
// or
const readJSONSync = path => JSON.parse(fs.readFileSync(path));

Parsing JSON format probably would not have any performance benefits from being included in core, and there might be some discrepancy between possible/expected behaviours (e.g. should we strip BOM for convenience or keep it strict). Are there usecases where it is required specifically as part of fs?

Probably not, it's all about conviniency

Milk-Cool avatar Aug 08 '22 15:08 Milk-Cool

I think encoding here is absolutely not related to JSON.

Also, as shown in the document, fs is a POSIX-like API. But JSON is an RFC standard.

The node:fs module enables interacting with the file system in a way modeled on standard POSIX functions.

So, I don't think we need to add JSON support for reading files. If we really do that, what about writing a JSON file? What about other formats like XML, CSV...

himself65 avatar Sep 05 '22 19:09 himself65

My opinion hasn't changed from the last time this feature was suggested: if this were to be implemented in Node.js core, it should have significant benefits over readFile + JSON.parse, such as failing early when a syntax error occurs.

tniessen avatar Sep 05 '22 21:09 tniessen

I'd be fine with fs.readJSON or similar. Using encoding would be kind of bad, the encoding of a file is sort of unrelated to whether it contains json. One explicit benefit of fs.readJSON is that it could default to utf8 which prevents the case of JSON.parse(fs.readFile(path)) with no encoding specified, which loads the file into memory as a buffer and then copies that to a string, which isn't great.

devsnek avatar Sep 05 '22 21:09 devsnek

There has been no activity on this feature request for 5 months and it is unlikely to be implemented. It will be closed 6 months after the last non-automated comment.

For more information on how the project manages feature requests, please consult the feature request management document.

github-actions[bot] avatar Mar 05 '23 01:03 github-actions[bot]