public-roadmap icon indicating copy to clipboard operation
public-roadmap copied to clipboard

[Bing Search API] Weird search results

Open hilmanski opened this issue 11 months ago • 75 comments

On top of the empty result, I'm also seeing weird behavior on the Bing results.

After testing it both on playground and API, I think it only happens on our playground.

For example, when I'm searching for "Apple," it shows all the results from "discussion.apple.com" which is very different from the actual results on Bing.

Image

Search results for "Nike"

Image

ref for empty search: https://github.com/serpapi/public-roadmap/issues/2330

hilmanski avatar Jan 19 '25 23:01 hilmanski

Odd, it's as if a "site:" parameter were injected into the query.

A customer reported this issue.

One of the examples also has empty HTML, but contains results in the JSON.

Here are some examples they shared:

Search Inspector 1 | Search Inspector 2 | Search Inspector 3

I was able to replicate their example after a couple retries in the Playground:

Playground

After testing it both on playground and API, I think it only happens on our playground.

It's also worth noting that this behavior is not specific to the Playground, as the Source User Agent for the customer's examples is Ruby.

The customer mentioned that they have been noticing this issue since at least 3 days.

Front

schaferyan avatar Jan 23 '25 22:01 schaferyan

I think this issue may be largely the same as this one: https://github.com/serpapi/public-roadmap/issues/1550

dsojevic avatar Jan 30 '25 04:01 dsojevic

Customer followed up on this reporting this is heavily impacting their workflows.

Front

alexbarron avatar Jan 30 '25 16:01 alexbarron

A high-volume customer reported this.

Intercom

hilmanski avatar Jan 31 '25 01:01 hilmanski

Another customer reported this:

Front

schaferyan avatar Feb 10 '25 22:02 schaferyan

A high-volume customer reported this.

Front

hilmanski avatar Feb 14 '25 03:02 hilmanski

A change has been deployed that has seen significant improvements for this issue during benchmarking.

I don't want to mark this as resolved as the change wasn't specifically to address this, so I will carry out some more targeted benchmarks to better confirm before updating the status.

It's probably also worth keeping an eye out for new reports (or lack thereof) to see if there's a correlation.

dsojevic avatar Feb 14 '25 11:02 dsojevic

A user reported this.

Intercom

hilmanski avatar Mar 19 '25 06:03 hilmanski

A user reported some valid queries that are returning empty again. These work in actual Bing.

Inspect Inspect

I also tested a search for "elon musk" in our API where the location was Italy and got Chinese results for zhihu.com only:

Image

Playground Inspect

Intercom

alexbarron avatar Apr 30 '25 15:04 alexbarron

Another customer reported this:

Intercom

schaferyan avatar May 01 '25 18:05 schaferyan

Our enterprise customer followed up on this.

Front

hilmanski avatar May 06 '25 02:05 hilmanski

A customer reported this:

Intercom

oceansize avatar Jun 10 '25 14:06 oceansize

A customer reached out to flag additional Bing-related strangeness:

Texas-based search returns Japanese results:

Image

Search for a person returns listings for pain-relief gel:

Image

I was able to get a strange result of my own with the above query, which seemed to only take the first word of the search term:

Playground Link

Image

The customer has also been experiencing searches that do not return results:

Search Inspector 1 | Search Inspector 2

Intercom Chat

oceansize avatar Jun 16 '25 16:06 oceansize

An enterprise customer reported this:

Intercom

NateSkiles avatar Jun 16 '25 17:06 NateSkiles

Search samples from the enterprise customer above:

Inspect - many Wikipedia pages | Inspect - mobile links | Inspect - many duplicates

hilmanski avatar Jun 17 '25 00:06 hilmanski

A few more reports, including Enterprise Customer. Some results are empty, some are returned in the wrong language.

Intercom Intercom

marm123 avatar Jun 17 '25 10:06 marm123

Another high volume customer reported both the results for only the first word, and results that look like a "site:" operator was used.

Front

schaferyan avatar Jun 18 '25 18:06 schaferyan

Another report from a customer using site: operators:

Intercom

alexbarron avatar Jun 19 '25 10:06 alexbarron

Another user reached out as they are facing this issue. They are also using the site: operator in the query:

Intercom

sonika-serpapi avatar Jun 23 '25 16:06 sonika-serpapi

Another Enterprise customer reached out about this:

Front

schaferyan avatar Jun 23 '25 17:06 schaferyan

Another user reached out about this:

Intercom

sonika-serpapi avatar Jun 24 '25 20:06 sonika-serpapi

Another user reached out about this:

Intercom

oceansize avatar Jun 25 '25 08:06 oceansize

Another high-volume customer reached out about this:

Intercom

oceansize avatar Jun 25 '25 11:06 oceansize

Another customer reached out about this:

Front

oceansize avatar Jun 27 '25 15:06 oceansize

A Customer complained about this. Using the site: on the keyword now returns unrelated website.

Intercom | sample search

hilmanski avatar Jun 30 '25 03:06 hilmanski

An experimental fix for this has been deployed and is rolling out to a fixed percentage of searches.

We aim to roll it out to all searches once stability has been proven at scale.

The examples from this issue can be seen working with higher quality results below:

Image

Image

dsojevic avatar Jun 30 '25 15:06 dsojevic

Great, how has it been looking?

leemul avatar Jul 01 '25 12:07 leemul

Hi @leemul, thank you for your message.

As @dsojevic mentioned, the solution looks stable in terms of the quality of results, but we're yet to determine how it'll perform at scale. We'll make sure to let you know as soon as we have more information.

marm123 avatar Jul 02 '25 13:07 marm123

Another user reported this:

Intercom

marm123 avatar Jul 04 '25 11:07 marm123

@dsojevic A customer reported receiving low quality results again. I've been able to reproduce it pretty consistently.

Image

Inspect Inspect Inspect Inspect

Playground

Intercom

alexbarron avatar Jul 10 '25 12:07 alexbarron