[source-instagram] start_date config parameter not working for source-instagram connector
Connector Name
source-instagram
Connector Version
3.1.0
What step the error happened?
Configuring a new connector
Relevant information
The Instagram connector is currently not recognizing config parameter "start_date". When executing any stream read, the parameter is ignored and only the current date (today date) data is extracted. I'm using the open-source airbyte versión 0.19.1 (with pip install airbyte).
import airbyte as ab
source: ab.Source = ab.get_source(
name="source-instagram",
config={
"start_date": "2024-01-01T00:00:00Z",
"access_token": access_token
}
)
source.select_streams(["user-insights"])
source.read(cache=ab.get_default_cache())
Relevant log output
Sync Progress: source-instagram -> DuckDBCache Started reading from source at 19:58:47:
Read 30 records over 3.9 seconds (7.6 records/s, 0.01 MB/s).
Received records for 1 streams:
30 stories Cached 30 records into 1 local cache file(s).
Finished reading from source at 19:58:54.
Started cache processing at 19:58:54:
Processed 1 cache file(s) over 0.03 seconds.
Completed cache processing for 1 streams:
stories Finished cache processing at 19:58:54.
Sync completed at 19:58:54. Total time elapsed: 7.1 seconds
Contribute
- [x] Yes, I want to contribute
@marcosmarxm can you poke around to see if there's a widespread issue?
Here's the thing — Instagram is a pretty popular connector that syncs up quite a lot of data across a lot of workspaces, and we haven't heard other reports of this.
It's possible this is specific to pyairbyte, OR the start_date config has a funny slightly different key and there's a docs mismatch or something.