public-roadmap icon indicating copy to clipboard operation
public-roadmap copied to clipboard

[Google Shopping API] `link` and `links` are missing even though `direct_link=true` is included

Open marm123 opened this issue 1 year ago • 90 comments

One of our users reported that the link is not present for some products even though the direct_link=true parameter is included. I couldn't recreate the issue on my side, but this might come up more often in the future if we don't address it.

Product missing link and links: image

Inspect Front

marm123 avatar Sep 02 '24 09:09 marm123

Thank you for creating the ticket @marm123. I couldn't replicate this bug. Did you have more people reaching out about this issue?

mikemorcerf avatar Sep 27 '24 21:09 mikemorcerf

Sorry for the late response @mikemorcerf. It was the only time someone reported it, I believe. I wasn't able to recreate it myself too.

marm123 avatar Oct 02 '24 12:10 marm123

Thanks @marm123. Let's wait to see if this problem will be reported again before doing more investigating.

mikemorcerf avatar Oct 02 '24 15:10 mikemorcerf

Another customer reached out about this:

Intercom | Inspect

schaferyan avatar Nov 13 '24 20:11 schaferyan

Another high-volume customer reached out about this:

Intercom | Inspect


Playground

image

NateSkiles avatar Nov 14 '24 19:11 NateSkiles

Another customer reached out about this.

Front | Inspect

sonika-serpapi avatar Nov 14 '24 20:11 sonika-serpapi

Another user reached out about this:

Front

NateSkiles avatar Nov 14 '24 20:11 NateSkiles

@mikemorcerf I'm just tagging you to make sure you're aware of the increasing reports of this issue, since you had started working on it previously.

schaferyan avatar Nov 14 '24 21:11 schaferyan

Thank you for tagging me, @schaferyan. I'll look into it.

mikemorcerf avatar Nov 14 '24 21:11 mikemorcerf

Another customer reported this:

Intercom

schaferyan avatar Nov 14 '24 23:11 schaferyan

A user reported this.

Intercom

hilmanski avatar Nov 15 '24 02:11 hilmanski

Another user reported this.

Front

hilmanski avatar Nov 15 '24 03:11 hilmanski

The coffee example from @NateSkiles started working for me after I sent a request with no_cache.

Krugloff avatar Nov 15 '24 07:11 Krugloff

@Krugloff Yeah, this seams to be working again this morning:

image

Playground

Thank you for creating the ticket @marm123. I couldn't replicate this bug. Did you have more people reaching out about this issue?

This issue appears to be sporadic, as @mikemorcerf couldn't reproduce this after it was initially reported.

NateSkiles avatar Nov 15 '24 17:11 NateSkiles

@NateSkiles Yes, it's working again. Now I'm working on a change that I believe will generate more consistent results.

mikemorcerf avatar Nov 15 '24 17:11 mikemorcerf

@mikemorcerf Here’s another Inspect. Interestingly, the second result includes a link.

Krugloff avatar Nov 15 '24 19:11 Krugloff

https://serpapi.com/searches/22b134190b08b273/6736f57aa775f2df5421732d.html

image

The direct-links are here.

Krugloff avatar Nov 15 '24 19:11 Krugloff

Thank you @Krugloff. These direct_links are actually injected into the html by us. If you look at the Google Shopping Page this div with #direct-links won't be there.

mikemorcerf avatar Nov 15 '24 20:11 mikemorcerf

A customer reported this issue.

Intercom

hilmanski avatar Nov 19 '24 01:11 hilmanski

A high-volume customer reports this issue:

Intercom

NateSkiles avatar Nov 19 '24 20:11 NateSkiles

@NateSkiles, @hilmanski, @schaferyan, @sonika-serpapi, @marm123, I spoke with @aciddjus and we came to the conclusion that unfortunately my solution is not viable because it uses one request per product to retrieve all direct_links. I closed my PR Google Shopping API - use GET request to fetch direct_links, but it can still be used as a reference. I'll unassign myself for this ticket.

mikemorcerf avatar Nov 20 '24 17:11 mikemorcerf

@Krugloff @hilmanski @mikemorcerf @schaferyan Has the issue been resolved? We are still seeing this issue.

KBCG avatar Nov 25 '24 17:11 KBCG

@KBCG Apologies for the confusion; we are currently still investigating this issue.

I did want to mention that this issue appears to be sporadic, as I'm seeing links returned at the moment:

https://serpapi.com/playground?engine=google_shopping&q=playstation+5&location=Austin%2C+Texas%2C+United+States&gl=us&hl=en&direct_link=true&num=100&device=desktop&direct_link=true&newPara=direct_link

Additionally, if links are not returned for a specific item, you can also retrieve them via the Google Products API:

https://serpapi.com/google-product-api

https://serpapi.com/playground?engine=google_product&product_id=4887235756540435899&gl=us&hl=en

We'll be sure to ping you once this issue has been resolved. In the meantime, please let us know if you have any questions.

NateSkiles avatar Nov 25 '24 17:11 NateSkiles

The high-volume customer followed up on this issue.

Intercom

hilmanski avatar Dec 10 '24 01:12 hilmanski

Another user asked about this.

Intercom

hilmanski avatar Dec 10 '24 05:12 hilmanski

Another customer reached out about it:

Front

martin-serpapi avatar Jan 09 '25 16:01 martin-serpapi

Another user reported this:

Intercom

martin-serpapi avatar Jan 09 '25 16:01 martin-serpapi

Another customer reported this:

Intercom

Search Inspect 1 | Search Inspect 2

NateSkiles avatar Jan 09 '25 17:01 NateSkiles

Another customer requested this:

Intercom

martin-serpapi avatar Jan 10 '25 09:01 martin-serpapi

Another customer reported this:

Front | Intercom

martin-serpapi avatar Jan 10 '25 09:01 martin-serpapi