data-acquisition-pipeline
data-acquisition-pipeline copied to clipboard
How to run Youtube_DL Pipeline?
I find youtube_api_pipeline.py. Any specific changes that I need to do for scraping using the youtube_dl pipeline? I have already made the changes (youtube_service_to_use = YoutubeService.YOUTUBE_DL) as per the documentation in the youtube_pipeline_config.py, but still, the crawler always expects the youtube_api_key as the environment variable (os.environ["youtube_api_key"] = str(kwargs["youtube_api_key"])).