litdata icon indicating copy to clipboard operation
litdata copied to clipboard

[wip]: Exp/Add TimeWindowFilter for controlled logging

Open bhimrazy opened this issue 8 months ago • 1 comments

Before submitting
  • [ ] Was this discussed/agreed via a Github issue? (no need for typos and docs improvements)
  • [ ] Did you read the contributor guideline, Pull Request section?
  • [ ] Did you make sure to update the docs?
  • [ ] Did you write any new necessary tests?

What does this PR do?

This PR tends to experiment and add the time window filter to have the debugger logs between the given time frame.

To be updated and tested...

Usage

# sample.py
from litdata.debugger import enable_tracer
enable_tracer()

# other logics here

# add time in seconds
LITDATA_LOG_START_TIME=5  LITDATA_LOG_END_TIME=10  python sample.py

PR review

Anyone in the community is free to review the PR once the tests have passed. If we didn't discuss your PR in GitHub issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

bhimrazy avatar Apr 11 '25 20:04 bhimrazy

Codecov Report

Attention: Patch coverage is 14.81481% with 23 lines in your changes missing coverage. Please review.

Project coverage is 79%. Comparing base (0635369) to head (2137cec). Report is 30 commits behind head on main.

:x: Your patch status has failed because the patch coverage (15%) is below the target coverage (50%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files
@@         Coverage Diff         @@
##           main   #550   +/-   ##
===================================
- Coverage    79%    79%   -0%     
===================================
  Files        40     40           
  Lines      6081   6102   +21     
===================================
+ Hits       4803   4807    +4     
- Misses     1278   1295   +17     
:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

codecov[bot] avatar Apr 11 '25 21:04 codecov[bot]

Closing this PR for now. Will reopen it if needed.

bhimrazy avatar Jun 02 '25 10:06 bhimrazy