eliza icon indicating copy to clipboard operation
eliza copied to clipboard

feat: Add twitterapi.io search plugin

Open kaitoInfra opened this issue 11 months ago • 2 comments

This commit adds a new plugin for searching Twitter content without login. The plugin supports complex queries and integrates with the existing API.

Relates to:

Closes #1431

Risks

Low: 1.The plugin has been extensively tested on Apify with millions of executions, ensuring stability and reliability. 2.After adding the current plugin, there is no place to call it yet. The parts involving other modules will be submitted later. For now, please review this plugin first.

Background What does this PR do? This PR introduces a new plugin for fetching Twitter data reliably and efficiently. It addresses the limitations of using personal Twitter accounts for scraping, such as rate limits and account bans, by leveraging a proven solution that has already processed millions of requests on Apify.

What kind of change is this?

Features: Adds a new plugin for Twitter data fetching.

AI agents require large amounts of high-quality, timely data to function effectively. The intelligence of an AI agent depends on two key factors:

The capabilities of the underlying AI model.

The quality, quantity, and timeliness of the data it processes.

Using personal Twitter accounts for scraping data poses significant risks, including account bans and rate limits. This plugin provides a reliable, scalable, and high-performance solution for fetching Twitter data, which has already been validated through millions of executions on Apify.

Additionally, I am offering free usage credits to help developers get started quickly and contribute to the project.

Documentation changes needed? I added a new environment variable and have updated the documentation in all relevant languages. I also explained the purpose of this variable. TWITTER_API_IO_KEY= #A third-party Twitter API key for data retrieval. This shared key is for testing only - get your personal key at https://twitterapi.io to avoid QPS limitations

In the src/tests directory under my newly added component folder, you can find all the unit tests for the APIs. I ran the command pnpm --filter @elizaos/plugin-twitter-search test and confirmed that all unit tests passed successfully.

Detailed testing steps pnpm --filter @elizaos/plugin-twitter-search test

Verify that the plugin can fetch Twitter data without login.

Test the plugin's performance under high concurrency.

Ensure the plugin handles rate limits and errors gracefully.

Discord username: [kaitoeasyapi] Twitter: kaitoEasyApi Apify Twitter Actor: https://apify.com/kaitoeasyapi/twitter-x-data-tweet-scraper-pay-per-result-cheapest

kaitoInfra avatar Jan 01 '25 18:01 kaitoInfra

nice

lalalune avatar Jan 01 '25 19:01 lalalune

@odilitime Hi, I've resolved the conflicts in my PR. Could you please help review and merge this PR when you have time? Thank you! 🙏

kaitoInfra avatar Jan 05 '25 17:01 kaitoInfra

Hello,

We are changing our plugin development strategy to be more scalable. We have moved the plugins out into their own repos and we're looking for people to either maintain those or own them on their own Github.

If you'd like to be a maintainer, file an issue in the plugin repo and join our Discord https://discord.gg/elizaos to coordinate.

If you'd like to control the plugin on your own Github, please add an issue to the plugin repo pointing to your repo, and add a modification to the registry. Submit a PR to edit the registry here: https://github.com/elizaos-plugins/registry

Closing this PR for now. Let us know if you have any questions.

odilitime avatar Feb 06 '25 23:02 odilitime