astro-sdk icon indicating copy to clipboard operation
astro-sdk copied to clipboard

Published 20 hours ago • verified publisher icon astronomer

Spike: Investigate reducing noise in logs

Open dimberman opened this issue 2 years ago • 2 comments

Right now logs in astro tasks are VERY noisy due to the sheer number of logs in certain connectors (e.g. snowflake, BQ, etc.). Do we actually need to surface all of these logs?

dimberman avatar Mar 02 '22 16:03 dimberman

@kaxil what are your thoughts here? On the one hand it feels risky to suppress connector logs (e.g. if the SnowflakeHook thinks these are INFO level then maybe they are?)

dimberman avatar Mar 23 '22 20:03 dimberman

Yeah I agree, we should not suppress them and users can change the Airflow log level too

kaxil avatar Apr 04 '22 22:04 kaxil