Performance Bug: removeFilePagesFromFrames is slowing down small transactions

[ray6080]

Kùzu version

master

What operating system are you using?

No response

What happened?

10K insertions into node table has been slowed down from 11s to ~110s on my local.

I did some profiling, and mostly the overheads/slowdown comes from removeFilePagesFromFrames during WAL::clearWAL after changes in https://github.com/kuzudb/kuzu/pull/3620.

Are there known steps to reproduce?

Table schema

CREATE NODE TABLE Person (
        id STRING,
        name STRING,
        age INT64,
        net_worth DOUBLE,
        PRIMARY KEY (id)

CSV file: profiles_10K.csv

Create 10K nodes with 10K transactions, each creation as a transaction. Compare the performance on latest master and latest release can produce the difference.