Minor: Automation improvement OSS requirements

[aniketkatkar97]

Backend Changes:

• Search API for ingestion pipelines now returns applicationType and airflowConfig Fields.

UI Changes:

• Introduced on-demand pipeline status fetching functionality for the IngestionRecentRuns component.

Type of change:

• [x] Bug fix
• [x] Improvement
• [ ] New feature
• [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
• [ ] Documentation

Checklist:

• [x] I have read the CONTRIBUTING document.
• [ ] My PR title is Fixes <issue-number>: <short explanation>
• [ ] I have commented on my code, particularly in hard-to-understand areas.
• [ ] For JSON Schema changes: I updated the migration scripts or explained why it is not needed.