tailwindui-crawler icon indicating copy to clipboard operation
tailwindui-crawler copied to clipboard

Is this broken now?

Open sujeetpillai opened this issue 1 year ago • 18 comments

I'm unable to use it to download.

First I got the "Not logged in error" when downloading a section. Since it was looking for my email address in the HTML, the email address is not present as is on that page html anymore. It's in a modal dialogue.

When I bypassed that, I got an error where "component.snippets" was null. The data-page attribute has a javascript object there doesn't have those fields anymore. In fact the iframes for each component now has srcdoc.

sujeetpillai avatar Jan 06 '24 10:01 sujeetpillai

Interesting what exactly is not working ? I used this repo for the first time yesterday and it works locally and as a download action.

tecio-first avatar Jan 12 '24 20:01 tecio-first

ref: https://github.com/kiliman/tailwindui-crawler/issues/84 @sujeetpillai

muesli-dev avatar Mar 12 '24 12:03 muesli-dev

Not logged in error after logging in.

[email protected] start node index.mjs

🔐 Logging into tailwindui.com... 🔍 Fetching https://tailwindui.com/login ⏱ 235ms (200) ✅ Success!

🗂 Output is ./output 🔍 Fetching https://tailwindui.com/components ⏱ 182ms (200) ⏳ Processing /components/marketing/sections/heroes... 🔍 Fetching https://tailwindui.com/components/marketing/sections/heroes ⏱ 178ms (200) 🚫 Not logged in

toshsan avatar May 22 '24 16:05 toshsan

I haven't checked recently. Let me see.

kiliman avatar May 22 '24 17:05 kiliman

Ok, I tried it locally image

And here's my GitHub Action which runs daily image

kiliman avatar May 22 '24 17:05 kiliman

Hmm. I have tried again on my repo. Same error as i reported above. Could you please share your commit hash to make sure we are on the same codebase?

toshsan avatar May 22 '24 22:05 toshsan

It's the latest master d3cc6ee9cf2c87145aa2943ff9c7806e4b80855c

Do you have the all-access subscription? That's what I have. I wonder if that's the difference.

kiliman avatar May 22 '24 23:05 kiliman

Hmm. I have tried again on my repo. Same error as i reported above. Could you please share your commit hash to make sure we are on the same codebase?

Maybe this works for you also https://github.com/kiliman/tailwindui-crawler/issues/84

muesli-dev avatar May 23 '24 13:05 muesli-dev

@kiliman The issue I noticed are that tailwind is now blocking non-origin access from its CDN (https://tailwindui.com/build/assets/). So we need to download the sources from the headers and iframe and serve them locally.

abdussamadbello avatar Jun 06 '24 17:06 abdussamadbello

Yes, I noticed that too. I have a version running locally that I'm still testing. I'll try to get a preview version that you can try out by tomorrow.

kiliman avatar Jun 06 '24 17:06 kiliman

Thanks @kiliman ... Youre awesome!

abdussamadbello avatar Jun 07 '24 15:06 abdussamadbello

Yes, I noticed that too. I have a version running locally that I'm still testing. I'll try to get a preview version that you can try out by tomorrow.

Eagerly waiting for updates

abdussamadbello avatar Jun 19 '24 13:06 abdussamadbello

Yes, I noticed that too. I have a version running locally that I'm still testing. I'll try to get a preview version that you can try out by tomorrow.

Would be great if you could release the preview version. I copied almost all components by hand in the meantime to have them available when I'm on a plane. However, they updated many, many components to headlessui 2.1, and I definitely don't want to copy all of them by hand again xD

VIEWVIEWVIEW avatar Jun 24 '24 14:06 VIEWVIEWVIEW