kibana icon indicating copy to clipboard operation
kibana copied to clipboard

[Ingest Pipelines] Add Manage processors page

Open yuliacech opened this issue 1 year ago • 8 comments

Fixes https://github.com/elastic/kibana/issues/190818

Summary

Summarize your PR. If it involves visual changes include a screenshot or gif.

Checklist

Delete any items that are not applicable to this PR.

Risk Matrix

Delete this section if it is not applicable to this PR.

Before closing this PR, invite QA, stakeholders, and other developers to identify risks that should be tested prior to the change/feature release.

When forming the risk matrix, consider some of the following examples and how they may potentially impact the change:

Risk Probability Severity Mitigation/Notes
Multiple Spaces—unexpected behavior in non-default Kibana Space. Low High Integration tests will verify that all features are still supported in non-default Kibana Space and when user switches between spaces.
Multiple nodes—Elasticsearch polling might have race conditions when multiple Kibana nodes are polling for the same tasks. High Low Tasks are idempotent, so executing them multiple times will not result in logical error, but will degrade performance. To test for this case we add plenty of unit tests around this logic and document manual testing procedure.
Code should gracefully handle cases when feature X or plugin Y are disabled. Medium High Unit tests will verify that any feature flag or plugin combination still results in our service operational.
See more potential risk examples

For maintainers

yuliacech avatar Aug 20 '24 16:08 yuliacech

/ci

yuliacech avatar Aug 26 '24 15:08 yuliacech

/ci

yuliacech avatar Aug 27 '24 15:08 yuliacech

/ci

yuliacech avatar Aug 27 '24 16:08 yuliacech

/ci

yuliacech avatar Aug 28 '24 10:08 yuliacech

/ci

yuliacech avatar Aug 29 '24 13:08 yuliacech

/ci

yuliacech avatar Aug 30 '24 09:08 yuliacech

/ci

yuliacech avatar Aug 30 '24 16:08 yuliacech

/ci

yuliacech avatar Sep 02 '24 08:09 yuliacech

:broken_heart: Build Failed

Failed CI Steps

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
ingestPipelines 327 335 +8

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
ingestPipelines 375.1KB 386.5KB +11.4KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
ingestPipelines 16.7KB 17.4KB +757.0B

History

  • :broken_heart: Build #231229 failed e44105e1e4f228559bb209736f09f3fd55a33bbc
  • :broken_heart: Build #231058 failed 31a5b40abdf7684f2726058e22b74f992f538e35
  • :yellow_heart: Build #230811 was flaky 943683b32b8d5838fcced5f6b410d3203541520f
  • :yellow_heart: Build #230376 was flaky e9bbe830cf5f7c140d774f4595bf02c7c1dcc0e4

To update your PR or re-run it, just comment with: @elasticmachine merge upstream

kibana-ci avatar Sep 02 '24 09:09 kibana-ci

@elasticmachine merge upstream

sabarasaba avatar Sep 27 '24 13:09 sabarasaba

@elasticmachine merge upstream

sabarasaba avatar Sep 30 '24 11:09 sabarasaba

Thanks for the review @ElenaStoeva!

  • In the PR description I see that the "Database file" field in the Add processor form has a dropdown with all available processors, but I don't see this when I run locally. Has this been changed?

The geoip processor will remain the same, only the new IP location processor has the dropdown that allows you to select the database

Will this be resolved from Es side? Also, I wonder if we could make the error message more readable in case there is an error.

Still waiting on their confirmation on which are the right keys, this validation error is on our side so maybe theres something we could initially do for it

  • Regarding the privileges, I tried testing the "read-only" view where the "Manage processors" button is not displayed, but when I only add the read_pipeline role, I'm not able to view the Ingest pipelines app at all (probably because it doesn't have a read-only view?). How did you test this, what privileges did you use?

In order to see and use Ingest Pipelines you need two privileges: manage_pipeline and cluster:monitor/nodes/info. If you want to also see the Manage processors link, you also need to have the manage permission.

Screenshot 2024-10-09 at 08 54 12

sabarasaba avatar Oct 09 '24 06:10 sabarasaba

@elasticmachine merge upstream

sabarasaba avatar Oct 09 '24 11:10 sabarasaba

Pinging @elastic/kibana-management (Team:Kibana Management)

elasticmachine avatar Oct 14 '24 15:10 elasticmachine

/ci

ElenaStoeva avatar Oct 14 '24 16:10 ElenaStoeva

/ci

mattkime avatar Oct 14 '24 20:10 mattkime

/ci

ElenaStoeva avatar Oct 15 '24 10:10 ElenaStoeva

/ci

ElenaStoeva avatar Oct 15 '24 11:10 ElenaStoeva

/ci

ElenaStoeva avatar Oct 15 '24 13:10 ElenaStoeva

/ci

ElenaStoeva avatar Oct 15 '24 15:10 ElenaStoeva

:green_heart: Build Succeeded

Metrics [docs]

Module Count

Fewer modules leads to a faster build time

id before after diff
ingestPipelines 329 339 +10

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id before after diff
ingestPipelines 375.4KB 392.6KB +17.2KB

Page load bundle

Size of the bundles that are downloaded on every page load. Target size is below 100kb

id before after diff
ingestPipelines 16.7KB 17.5KB +845.0B

History

  • :broken_heart: Build #242625 failed 372bbf121f56fc51284af15879006002e73ffef3
  • :broken_heart: Build #242562 failed d108302bc5b9566cac83ccd67a180581bdf143e6
  • :broken_heart: Build #242509 failed ccc25bcf86e12e55f6cc11a451e464abd27eb2af
  • :broken_heart: Build #242349 failed 7228df792de78db2bd20514e86d57acb73d92bd9
  • :broken_heart: Build #242324 failed c69902e3fc1cd377b6eb491911e7dbe1d17fa30e

cc @sabarasaba @ElenaStoeva

elasticmachine avatar Oct 15 '24 16:10 elasticmachine

@elasticmachine run docs-build

ElenaStoeva avatar Oct 15 '24 17:10 ElenaStoeva

Starting backport for target branches: 8.x

https://github.com/elastic/kibana/actions/runs/11351709960

kibanamachine avatar Oct 15 '24 17:10 kibanamachine

💚 All backports created successfully

Status Branch Result
8.x

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

kibanamachine avatar Oct 15 '24 18:10 kibanamachine