Calls to collect/index_packages API endpoint takes too much time and often timeout

[pombredanne]

Calls to collect/index_packages API endpoint takes too much time and often timeout. We should instead return immediately and do all the bidding in a background task including:

• collect versions (one, all or vers)
• collect source packages
• then queue these for actual data collection

[pombredanne]

Same for the plain collect pkg:maven/com.amazonaws/[email protected] for example. We should NOT do the purl2vcs call in the request as this is impractically slow sometimes but only in the background.

[suyashgupta2411]

Hey @pombredanne can I try to resolve this?