25+ firewall_rules and filters

[robert-put]

Confirmation

• [X] My issue isn't already found on the issue tracker.
• [X] I have replicated my issue using the latest version of the library and it is still present.

cf-terraforming version

cf-terraforming v0.2.0

Expected outcome

1. I expected to have 27 firewall_rule resources outputted
2. I expected to have 27 filters resources outputted
3. I expected to have 27 firewall_rule import commands outputted
4. I expected to have 27 filter import commands outputted

Actual outcome

1. 24 firewall__rule resources where outputted
2. 24 filter resources where outputted
3. 25 firewall_rule import commands outputted
4. 25 filter import commands where outputted

After running the imports I fixed the 25th resource's(that got imported) based on what it wanted to delete. But there where 2 firewall rules with missing corresponding filters and 2 filters that where not referenced in the firewall rules....

Seems to be related to the pagination limit of 25 for the api, but I don't see anything in the docs for this tool in how to resolve that.

Steps to reproduce

1. have 27+ firewall_rules in cloudflare and try to import them

References

No response

[jacobbednarz]

This is something I'm looking to offload to cloudflare-go instead as it will benefit all the consumers once it lands. See https://github.com/cloudflare/cloudflare-go/issues/619

[robert-put]

Ahh that would explain it, was just starting to look into the go api to try and understand how it handled pagination but not familiar with go yet.

[angryman9]

A similar problem when generating resources/imports custom hostnames. Only 50 records are generated.

[SimonGtn]

+1 on the custom hostnames, trying to import 115 and only getting 50 back.

[ldb]

Same for cloudflare_account_member resources: Only 20 are exported.

[gray1117]

We have the same issue with only generating 25 firewal_rule and firewall_filter, is there any progress on this issue?

[huguesalary]

I am running into the same issue for cloudflare_firewall_rule