NTC4818

Is there any idea why aws lambda might not be accepting this code? The error is that it can't see libmagic, but I am not sure where the mapping is....

It is the official python binary from AWS version 3.8 but if I can get anything + 3.7 I’m good with that if anyone has a file working On Mon,...

Awesome, sorry I missed that note. I will spin up an ec2 with python 3.9 and run the following command, prepare it as a lambda layer and place where I...

Not quite the ticket. I built the layer as requested with the pip install command with pip 3.9 and then updated the brotlipy layer as well with 3.9 and received...

Still Not reading as it was in python 3.7, any ideas why it might be acting differently. It is running in aws lambda environment

Yes but 3.7 is no longer supported on AWS Lambda.

And 3.8 dies later this year in support, so is there a way to build these binaries to run in python 3.9 Lambda Layer?

Broken DAG: [/usr/local/airflow/dags/stream_to_kafka_dag.py] No module named 'kafka_spark_structured_streaming' which tells me I should have one dag in one folder and the other in the docker-airflow. Is that true? Tried continuing and...

I think what is happening is they are not in the right structure maybe? I just followed the docker commands as mentioned in the post. I was able to move...

Sorry this may be annoying but I am a data engineer and really want to get better at building pipelines. Its so hard to find deliberate practice like this, so...