diadata icon indicating copy to clipboard operation
diadata copied to clipboard

Write an NFT Trades Scraper for Magic Eden Marketplace on Solana

Open jppade opened this issue 2 years ago • 3 comments

We are looking for a Go developer who is experienced in writing applications interfacing with the Solana blockchain. Basic knowledge in NFTs is helpful but not mandatory. Your task is to write a trades scraper for Magic Eden marketplace on Solana Blockchain https://magiceden.io/

The data must be fetched directly from on-chain, using for instance the public endpoints linked here: https://docs.solana.com/developing/clients/jsonrpc-api

Before applying to this task please have a look at the contracts/programs. This might not be a straightforward task and ideally, you only apply if you are confident you can fetch the relevant data from on-chain.

The scraper should be incremental, i.e. it should start scraping at the contract's deploy block and take up scraping at whichever block it stopped. As an example you can have a look at the Opensea trades scraper here: [github.com/diadata-org/diadata/pkg/dia/nftTrade-scrapers/opensea.go]https://github.com/diadata-org/diadata/blob/master/pkg/dia/nft/nftTrade-scrapers/opensea.go

Furthermore, please also take into account that NFT classes and NFTs which are not in our DB yet should be added in the trades scraper, similar to lines 486 and 491 in the Opensea trades scraper.

The structure for the scraper is already laid out. Your job is basically to implement the scraping logic in the file: github.com/diadata-org/diadata/pkg/dia/nftTrade-scrapers/magiceden.go and send the filled struct dia.NFTTrade to the corresponding main.go.

Any questions don't hesitate to ask!

jppade avatar Jun 23 '22 13:06 jppade

Issue Status: 1. Open 2. Started 3. Submitted 4. Done


This issue now has a funding of 540.0 USDC attached to it as part of the diadata-org fund.

gitcoinbot avatar Jun 23 '22 13:06 gitcoinbot

Issue Status: 1. Open 2. Started 3. Submitted 4. Done


Workers have applied to start work.

These users each claimed they can complete the work by 1 week, 3 days from now. Please review their action plans below:

1) gall0x has applied to start work (Funders only: approve worker | reject worker).

Hi, I'd love to work on this one, I already completed an NFT scrapper for Dia and I'd love keep learning about the project and a bit of Solana as well. 2) boyin0x has applied to start work (Funders only: approve worker | reject worker).

Hey, jppade, I have already worked in the Defi/dex scrapers, would be great to do it also with NFTs 3) janus has applied to start work (Funders only: approve worker | reject worker).

I have worked with this client before and I would like to continue working with the client. This is an interesting task which will challenge me to learn, and advance my knowledge. 4) mxmar has applied to start work (Funders only: approve worker | reject worker).

I was implementing a scraper in Go already, but not for NFT Trades. I know what to do. I will look into all your links and fit requirements with a Go implementation. That's all. I know how to work integrate Go with JSON-RPC API, how to fetch and aggregate blockchain data and interact with other app components (like generate package payload for another service, package, API or program).

Learn more on the Gitcoin Issue Details page.

gitcoinbot avatar Jun 24 '22 09:06 gitcoinbot

Is this still alive? @jppade

hhio618 avatar Sep 19 '22 07:09 hhio618

Issue Status: 1. Open 2. Started 3. Submitted 4. Done


Work for 540.0 USDC (540.00 USD @ $1.0/USDC) has been submitted by:

  1. @harjas27

@jppade please take a look at the submitted work:

  • PR by @harjas27

gitcoinbot avatar Oct 10 '22 18:10 gitcoinbot