roles icon indicating copy to clipboard operation
roles copied to clipboard

Markets Website+API Operator/Maintainer

Open cbeams opened this issue 7 years ago • 43 comments

This role is responsible for operating the https://markets.bisq.network website and API as well as maintaining its source in the https://github.com/bisq-network/markets repository. Primary owner/maintainer: @wiz
Secondary owner/operator: @Emzy

cbeams avatar Sep 04 '17 12:09 cbeams

@dan-da, per bisq-network/dao#30, your dan-da/bitsquare_markets repo has been brought under the @bisq-network org at https://github.com/bisq-network/markets. Are you interested in continuing to fill the role of maintaining the codebase and operating the website? This would of course include getting compensated in $BSQ for your work.

If so, great. Please accept your invitation to join the @bisq-network organization. I'll get you assigned to this role, and we can get everything in order. If not, just let me know so we can put the word out about finding someone to take over this role. Thanks.

cbeams avatar Jan 09 '18 22:01 cbeams

2018.04 report

I am operating the market server, so as there is no one else responsible I will do the report: No known incidents occurred but I do not follow or monitor it closely.

ManfredKarrer avatar May 01 '18 15:05 ManfredKarrer

2018.05

Nothing to report

ManfredKarrer avatar May 30 '18 15:05 ManfredKarrer

2018.06 report

Update to 0.7.0.

ManfredKarrer avatar Jun 30 '18 15:06 ManfredKarrer

2018.07 report

Nothing to report.

/cc bisq-network/compensation#93

ManfredKarrer avatar Jul 26 '18 16:07 ManfredKarrer

2018.08 report

Nothing to report.

/cc bisq-network/compensation#112

ManfredKarrer avatar Aug 30 '18 21:08 ManfredKarrer

2018.09 report

Nothing to report.

/cc bisq-network/compensation#125

ManfredKarrer avatar Sep 27 '18 00:09 ManfredKarrer

2018.09 report

Nothing to report.

/cc bisq-network/compensation#125

ManfredKarrer avatar Sep 27 '18 00:09 ManfredKarrer

2018.10 report

Nothing to report.

/cc bisq-network/compensation#155

ManfredKarrer avatar Oct 31 '18 04:10 ManfredKarrer

2018.10 report

Nothing to report.

/cc bisq-network/compensation#155

ManfredKarrer avatar Oct 31 '18 04:10 ManfredKarrer

2018.11 report

Nothing to report.

/cc bisq-network/compensation#180

ManfredKarrer avatar Nov 30 '18 21:11 ManfredKarrer

2018.11 report

Updated to version 0.9.1 (required jdk update).

/cc bisq-network/compensation#189

ManfredKarrer avatar Dec 29 '18 14:12 ManfredKarrer

Issue with out of memory errors. Not clear why it happend as server reported sufficient free memory. I increased setting of maxMemory of app from 300 to 500 MB and updated code to 0.9.3. There was also a weird class not found error. With newly compiled 0.9.3 app was working again.

ManfredKarrer avatar Jan 21 '19 11:01 ManfredKarrer

2019.01 report

See comment above.

/cc bisq-network/compensation#205

ManfredKarrer avatar Jan 28 '19 18:01 ManfredKarrer

2019.02 report

I took over the operation of the markets website server.

Every second week there seems to be a server "crash" (out of memory). It seems to me the memory leak is in apache/php, more investigation needed. Restarting the Apache2 daemon fixes the problem every time.

I did a software update. But after the update still there was one out of memory problem.

/cc bisq-network/compensation#225

Emzy avatar Feb 27 '19 12:02 Emzy

2019.02 report

Nothing to report.

/cc bisq-network/compensation#227

ManfredKarrer avatar Feb 28 '19 05:02 ManfredKarrer

2019.03 report

Two times the server hat a out of memory problem. Restarting of apache and the bisq fixed it. I still have an eye on it.

/cc bisq-network/compensation#246

Emzy avatar Mar 27 '19 20:03 Emzy

2019.03 report

Nothing to report.

/cc bisq-network/compensation#252

ManfredKarrer avatar Mar 30 '19 03:03 ManfredKarrer

Cycle 1 report

The server hat no out of memory problem anymore.

/cc bisq-network/compensation#279

Emzy avatar May 08 '19 13:05 Emzy

@mrosseel Takes over primary role owner.

ManfredKarrer avatar May 12 '19 11:05 ManfredKarrer

Cycle2 report

The server had many out of memory problems again. Finally changed some parameters of the Apache2 service, seems to have worked so far.

/cc bisq-network/compensation#298

Emzy avatar Jun 08 '19 20:06 Emzy

Cycle3 report

The server had two out of memory problems again.

/cc bisq-network/compensation#310

Emzy avatar Jul 08 '19 20:07 Emzy

Cycle 4 report

The server more of memory problems again.

But not for 2 weeks. So I think I fixed it. Changed parameters of the Apache2 service again.

/cc bisq-network/compensation#324

Emzy avatar Aug 07 '19 19:08 Emzy

Cycle 5 report

The server is running fine after the last parameter fix. No restarts needed. Coordinating with the new maintainer.

/cc bisq-network/compensation#355

Emzy avatar Sep 09 '19 09:09 Emzy

Cycle 6 report

Everything running fine.

/cc bisq-network/compensation#373

Emzy avatar Oct 09 '19 10:10 Emzy

Cycle 6 report

As of today I'm taking over the primary maintainer role from @mrosseel (secondary will remain with @Emzy), and I've migrated the markets.bisq.network server to its new location. Currently investigating how to scale the markets API to handle more requests, as the server gets heavily overloaded at times.

/cc https://github.com/bisq-network/compensation/issues/380

wiz avatar Oct 09 '19 18:10 wiz

Cycle 7 report

Secondary role. Got login for new server from @wiz

/cc bisq-network/compensation#397

Emzy avatar Nov 10 '19 18:11 Emzy

Cycle 7 report

The Bisq Markets API server is under heavy load, but we're going to replace it soon with a full re-implementation using a smart-caching proxy and new API backend.

/cc bisq-network/compensation#398

wiz avatar Nov 11 '19 03:11 wiz

Cycle 8 report

The Bisq Markets API has been migrated to a new implementation utilizing a smart-caching proxy on Google Cloud Appengine and new API backend powered by risq. The new service is much faster for serving chart data on bisq.network/markets and is serving millions of requests daily to external third parties who have integrated the API into their sites.

This month the expenses are a bit higher due to one-off Google Cloud costs, i.e. as part of the migration before we optimized the site to lower costs. Going forward the site should run less than $300 per month hosting cost, which is a good deal considering the huge amount of traffic it gets. Ideally we will move away from Google at some point in the future, but we would need a very beefy CDN setup of some kind. The good thing is that the service is at 100% uptime now and very fast performance!

/cc https://github.com/bisq-network/compensation/issues/448

wiz avatar Dec 14 '19 16:12 wiz

Cycle 9 report

A few days ago we decided revert the Bisq Markets API to a fully self-hosted solution, and the temporary risq + google architecture has now been shut down. This decision was made since the risq project is no longer being maintained, and so I instead added some performance tweaks to the previous Bisq Statsnode + PHP service architecture.

I will continue to improve the Statsnode architecture, with the next goal being a one-command installer to make it easy to deploy multiple API service nodes and load-balance between them. This will allow us to maintain a self-hosted solution and scale it as Bisq grows.

/cc https://github.com/bisq-network/compensation/issues/470

wiz avatar Jan 18 '20 23:01 wiz