hop icon indicating copy to clipboard operation
hop copied to clipboard

[Feature Request]: Request for Built-in CPython Support to Enhance External Library Compatibility in Apache Hop

Open AlefRP opened this issue 1 year ago • 0 comments

What would you like to happen?

Request for Built-in CPython Support to Enhance External Library Compatibility in Apache Hop

Summary

The current external Python plugin (Script) in Apache Hop faces challenges, particularly in efficiently utilizing external libraries (does not work with it). Integrating built-in CPython support would resolve these issues, leveraging CPython's robust handling of external libraries for advanced data processing capabilities. Pentaho, e.g, has a built in CPython.

Issue Description

The external Python plugin available in Apache Hop does not seamlessly support the use of external libraries, which is crucial for complex data transformations and analysis. This limitation hampers the execution of advanced Python scripts within Apache Hop workflows, affecting performance and utility.

Proposal

I propose the integration of built-in CPython support in Apache Hop. This would enable direct execution of Python scripts, including those requiring external libraries, within Apache Hop's environment. The main advantages include:

  • Improved performance and reliability.
  • Expanded data processing and analysis capabilities through direct access to Python's extensive library ecosystem.
  • A streamlined workflow for Python-based data manipulation directly within Apache Hop.

Expected Outcome

By addressing the current limitations with a built-in CPython solution, Apache Hop can enhance its attractiveness to a broader audience, including data scientists and engineers who rely heavily on Python's ecosystem for data processing tasks.

Conclusion

Incorporating built-in CPython support will significantly enhance Apache Hop's functionality and user experience, particularly for advanced data processing and analysis tasks. I look forward to the community's input and the potential development of this feature.

Issue Priority

Priority: 3

Issue Component

Component: Other

AlefRP avatar Feb 23 '24 11:02 AlefRP