PyAirbyte icon indicating copy to clipboard operation
PyAirbyte copied to clipboard

[source-instagram] start_date config parameter not working for source-instagram connector

Open maloyuso opened this issue 1 year ago • 1 comments

Connector Name

source-instagram

Connector Version

3.1.0

What step the error happened?

Configuring a new connector

Relevant information

The Instagram connector is currently not recognizing config parameter "start_date". When executing any stream read, the parameter is ignored and only the current date (today date) data is extracted. I'm using the open-source airbyte versión 0.19.1 (with pip install airbyte).

import airbyte as ab
 
source: ab.Source = ab.get_source(
        name="source-instagram",
        config={
            "start_date": "2024-01-01T00:00:00Z",
            "access_token": access_token
        }
 )

source.select_streams(["user-insights"])
source.read(cache=ab.get_default_cache())

Relevant log output

Sync Progress: source-instagram -> DuckDBCache Started reading from source at 19:58:47:

Read 30 records over 3.9 seconds (7.6 records/s, 0.01 MB/s).

Received records for 1 streams:

30 stories Cached 30 records into 1 local cache file(s).

Finished reading from source at 19:58:54.

Started cache processing at 19:58:54:

Processed 1 cache file(s) over 0.03 seconds.

Completed cache processing for 1 streams:

stories Finished cache processing at 19:58:54.

Sync completed at 19:58:54. Total time elapsed: 7.1 seconds

Contribute

  • [x] Yes, I want to contribute

maloyuso avatar Nov 07 '24 02:11 maloyuso

@marcosmarxm can you poke around to see if there's a widespread issue?

Here's the thing — Instagram is a pretty popular connector that syncs up quite a lot of data across a lot of workspaces, and we haven't heard other reports of this.

It's possible this is specific to pyairbyte, OR the start_date config has a funny slightly different key and there's a docs mismatch or something.

natikgadzhi avatar Mar 05 '25 06:03 natikgadzhi