IntelOwl icon indicating copy to clipboard operation
IntelOwl copied to clipboard

refactor of analyzers for local queries

Open cristinaascari opened this issue 10 months ago • 11 comments

(Please add to the PR name the issue/s that this PR would close if merged by using a Github keyword. Example: <feature name>. Closes #999. If your PR is made by a single commit, please add that clause in the commit too. This is all required to automate the closure of related issues.)

Description

Analyzers periodically download external dbs and store data in additional tables of the IntelOwl db instead of saving it in a local file. Close #2407

Type of change

Please delete options that are not relevant.

  • [ ] Bug fix (non-breaking change which fixes an issue).
  • [x] New feature (non-breaking change which adds functionality).
  • [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected).

Checklist

  • [x] I have read and understood the rules about how to Contribute to this project
  • [x] The pull request is for the branch develop
  • [x] A new plugin (analyzer, connector, visualizer, playbook, pivot or ingestor) was added or changed, in which case:
    • [x] I strictly followed the documentation "How to create a Plugin"
    • [ ] Usage file was updated. A link to the PR to the docs repo has been added as a comment here.
    • [ ] Advanced-Usage was updated (in case the plugin provides additional optional configuration). A link to the PR to the docs repo has been added as a comment here.
    • [x] I have dumped the configuration from Django Admin using the dumpplugin command and added it in the project as a data migration. ("How to share a plugin with the community")
    • [ ] If a File analyzer was added and it supports a mimetype which is not already supported, you added a sample of that type inside the archive test_files.zip and you added the default tests for that mimetype in test_classes.py.
    • [ ] If you created a new analyzer and it is free (does not require any API key), please add it in the FREE_TO_USE_ANALYZERS playbook by following this guide.
    • [ ] Check if it could make sense to add that analyzer/connector to other freely available playbooks.
    • [ ] I have provided the resulting raw JSON of a finished analysis and a screenshot of the results.
    • [ ] If the plugin interacts with an external service, I have created an attribute called precisely url that contains this information. This is required for Health Checks.
    • [ ] If the plugin requires mocked testing, _monkeypatch() was used in its class to apply the necessary decorators.
    • [ ] I have added that raw JSON sample to the MockUpResponse of the _monkeypatch() method. This serves us to provide a valid sample for testing.
  • [ ] I have inserted the copyright banner at the start of the file: # This file is a part of IntelOwl https://github.com/intelowlproject/IntelOwl # See the file 'LICENSE' for copying permission.
  • [ ] If external libraries/packages with restrictive licenses were used, they were added in the Legal Notice section.
  • [ ] Linters (Black, Flake, Isort) gave 0 errors. If you have correctly installed pre-commit, it does these checks and adjustments on your behalf.
  • [ ] I have added tests for the feature/bug I solved (see tests folder). All the tests (new and old ones) gave 0 errors.
  • [ ] If the GUI has been modified:
    • [ ] I have a provided a screenshot of the result in the PR.
    • [ ] I have created new frontend tests for the new component or updated existing ones.
  • [ ] After you had submitted the PR, if DeepSource, Django Doctors or other third-party linters have triggered any alerts during the CI checks, I have solved those alerts.

Important Rules

  • If you miss to compile the Checklist properly, your PR won't be reviewed by the maintainers.
  • Everytime you make changes to the PR and you think the work is done, you should explicitly ask for a review by using GitHub's reviewing system detailed here.

cristinaascari avatar Feb 24 '25 09:02 cristinaascari

Cri, please take into account this PR! https://github.com/intelowlproject/IntelOwl/pull/2761 That would add additional endpoints and data to be saved locally. Please wait that PR to be merged and then make the changes for those cases too before merging this PR

mlodic avatar Feb 24 '25 10:02 mlodic

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar Mar 07 '25 09:03 github-actions[bot]

This pull request has been closed because it had no updates in 15 days. If you're still working on this fell free to reopen.

github-actions[bot] avatar Mar 13 '25 09:03 github-actions[bot]

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar Mar 25 '25 09:03 github-actions[bot]

This pull request has been closed because it had no updates in 15 days. If you're still working on this fell free to reopen.

github-actions[bot] avatar Mar 31 '25 09:03 github-actions[bot]

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar Apr 14 '25 09:04 github-actions[bot]

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar Apr 25 '25 09:04 github-actions[bot]

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar May 09 '25 09:05 github-actions[bot]

This pull request has been closed because it had no updates in 15 days. If you're still working on this fell free to reopen.

github-actions[bot] avatar May 15 '25 09:05 github-actions[bot]

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar May 27 '25 09:05 github-actions[bot]

This pull request has been closed because it had no updates in 15 days. If you're still working on this fell free to reopen.

github-actions[bot] avatar Jun 02 '25 09:06 github-actions[bot]

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar Jun 21 '25 09:06 github-actions[bot]

This pull request has been closed because it had no updates in 15 days. If you're still working on this fell free to reopen.

github-actions[bot] avatar Jun 27 '25 09:06 github-actions[bot]

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar Jul 09 '25 09:07 github-actions[bot]

This pull request has been closed because it had no updates in 15 days. If you're still working on this fell free to reopen.

github-actions[bot] avatar Jul 14 '25 09:07 github-actions[bot]

This pull request has been marked as stale because it has had no activity for 10 days. If you are still working on this, please provide some updates or it will be closed in 5 days.

github-actions[bot] avatar Jul 26 '25 09:07 github-actions[bot]

This pull request has been closed because it had no updates in 15 days. If you're still working on this fell free to reopen.

github-actions[bot] avatar Jul 31 '25 09:07 github-actions[bot]

@cristinaascari do you have any news about this? This PR has become pretty old. It would be better to avoid keeping PRs for such long time so that other people could pick up this issue and solve it. We are about to make the public release soon (next week). If no other update we receive, I'll close this PR for good

mlodic avatar Oct 28 '25 17:10 mlodic

Hi @mlodic, I don't have any update and I'm not planning on working on this PR soon, so I guess we can close it.

cristinaascari avatar Oct 29 '25 08:10 cristinaascari