langflow icon indicating copy to clipboard operation
langflow copied to clipboard

feat: adding list of Data output to Parse Data

Open mieslep opened this issue 1 year ago • 3 comments

This pull request includes several changes to the ParseDataComponent class and related functions to enhance data processing capabilities. The most significant changes include adding new imports, updating input and output configurations, and modifying the data_to_text function to support more flexible data formatting.

Enhancements to data processing:

  • src/backend/base/langflow/components/processing/parse_data.py: Added import for Data from langflow.schema.

Updates to ParseDataComponent class:

  • src/backend/base/langflow/components/processing/parse_data.py: Updated DataInput to accept lists by setting is_list=True.
  • src/backend/base/langflow/components/processing/parse_data.py: Modified Output configurations to include additional information and added a new output method parse_data_as_list for processing data as a list.
  • src/backend/base/langflow/components/processing/parse_data.py: Refactored the parse_data method to use a new helper method _parse, and added the parse_data_as_list method to handle list outputs.

Improvements to data_to_text function:

  • src/backend/base/langflow/helpers/data.py: Updated the data_to_text function to return either a single string or a list of strings, depending on the presence of a separator. [1] [2]

mieslep avatar Nov 14 '24 13:11 mieslep

CodSpeed Performance Report

Merging #4598 will improve performances by ×16

Comparing mieslep:phil/parse-data (a142b6e) with main (654b443)

Summary

⚡ 2 improvements
✅ 13 untouched benchmarks

Benchmarks breakdown

Benchmark main mieslep:phil/parse-data Change
test_successful_run_with_output_type_any 5,049.6 ms 310.9 ms ×16
test_successful_run_with_output_type_debug 321.6 ms 228.9 ms +40.54%

codspeed-hq[bot] avatar Nov 14 '24 14:11 codspeed-hq[bot]

Will modify to keep signature of data_to_text as -> str only.

mieslep avatar Nov 14 '24 17:11 mieslep

@ogabrielluiz this should now be gtg from my perspective.

mieslep avatar Nov 15 '24 13:11 mieslep