Nicolas Williams

Results 89 comments of Nicolas Williams

### Static IP Experiment Heroku doesn't support static IPs, at least not in its standard cloud offering. This prevents it from being used to host Transformer PSC, which needs a...

### IP Test Case using Net::HTTP::Persistent ```ruby require 'net/http/persistent' http = Net::HTTP::Persistent.new http.proxy = :ENV p http uri = URI('https://ipinfo.io') res = http.request(uri) puts res.body ``` This may be run...

### Fixie https://elements.heroku.com/addons/fixie - approx 0.76 USD/1K reqs/month (@ 25K reqs) - HTTP proxy - HTTPS via CONNECT proxy - sets `FIXIE_URL` env var - 2 static IPs allocated; reported...

### Static IP Experiment Conclusion SOCKS proxies are not supported by Net::HTTP::Persistent. Whilst these would usually be my preference, they are not necessary since we require only HTTP/HTTPS traffic. So,...

To clarify something I muddled: Ingester PSC doesn't need run OpenCorporates reconciliation; rather, Transformer PSC does. This means that it doesn't need access to OpenCorporates or any IPs whitelisted, but...

Ingester PSC has been deployed to Heroku. There is only a production app, since it's not possible for us to run staging apps on the Register data pipelines within our...

Ingester PSC on Heroku is now live and streaming updates from PSC datasource.

Day 1 snapshot ingestion has started.

Day 1 snapshot ingestion has completed. There were various invalid rows reported, but I'm guessing that's unrelated since it was the same process as is run for the monthly bulk...

Day 1 PSC stream ingestion has been started: ``` 2024-04-23T13:13:03.010318+00:00 app[worker.1]: I, [2024-04-23T13:13:03.010203 #2] INFO -- : [11098166] /company/15673183/persons-with-significant-control/individual/a8AKQH1QivKUiOAK2fafp-Adgvo 2024-04-23T13:13:03.255341+00:00 app[worker.1]: I, [2024-04-23T13:13:03.255221 #2] INFO -- : [11098168] /company/15673184/persons-with-significant-control/individual/hSONNRBkkwHLpuU3giug0nbRb6A 2024-04-23T13:13:03.426444+00:00...