emile baizel
emile baizel
yes i'm using the bulk option for writes the issue is that we have a listener on the oplog and it adds more overhead if it is an update since...
here's my `pipeline.js` ``` var source = mongodb({ "uri": "mongodb://user:[email protected]:12345/mydb", "ssl": true, "bulk": true }) ```
no, the other way around. on the destination db, we only want to have inserts, and no upserts done on it
that's neat, i haven't worked with that before. is there overhead loading the javascript vm to run the function? or is that already being done anyway?
got it. so would the `doc['op']` be `update` and then `noop`, instead of the `u` and `s` you have in your example above? those are the functions i'm seeing on...
slightly off topic, but what's the expected rate gain with `bulk: true`? i've been seeing around 65k/minute rates without vs around 85k/minute with it. does this seem in line with...
interesting. i haven't been using a transform so maybe that's got something to do with it? will try the update/skip out right now. really appreciate all your help.
hey JP! qq on the transform fn. i'm trying the suggestion you had above about skipping if the ```op === update``` but the docs are all being sent to the...
hm i'm still seeing the updates go through. i created a file `skipUpsert.js` that only contains your function, and i'm calling everything with: ```javascript t.Source("source", source, "/^balances/").Transform(goja({"filename":"skipUpsert.js"})).Save("sink", sink) ``` does...
i added this to `_plugins/jekyll-less.rb`: ``` require "jekyll-less" @@mtimes = {} ``` and this resolved it for me. hope that helps.