actor-templates

actor-templates copied to clipboard

Add new Python template - Scrapy & Playwright

4

- Some "JavaScript-heavy websites" (e.g. https://tripadvisor.com) cannot be scraped by using just Scrapy. > Can you check why our Beautiful Soup template fails on [tripadvisor.com](https://tripadvisor.com/)? https://console.apify.com/actors/jWYbXHu32SvZf1Cgb/runs/0IYh4rWH9Ig2vIUSM#output - Solution: We can...

vdusek

Advice on how to run Scrapy template without using __main__.py

2

I'd like my project to have several CLI commands, e.g. using [click](https://click.palletsprojects.com/). It's not entirely clear to me how to properly move the \_\_main\_\_.py logic somewhere else, so that I...

honzajavorek

### Description - Currently, the `apify create` process only provides a `Pip` setup by default. - This enhancement aims to offer users the flexibility to choose between `Pip` and `Poetry`...

vdusek

We agreed there will be 2 variants of the Crawlee templates now 1. The one we have with a simple use case - you give it `startUrls` and `maxRequestsPerCrawl` and...

jbartadev

Currently, if the actor from a template cannot be built on the platform(same for local) our test still passes. It can lead to not working actors on the platform, which...

drobnikj

Augment templates configs with more opinionated stricter rules for actor development

3

this: https://maximorlov.com/linting-rules-for-asynchronous-code-in-javascript and also: - Add rule for `Apify.getValue('INPUT')` -> `Apify.getInput()` - `async` event listeners on `page.on()` or any other event listener that is synchronous. if it's there, ask to...

pocesar

Bumps [http-cache-semantics](https://github.com/kornelski/http-cache-semantics) from 4.1.0 to 4.1.1. Commits 2449650 Update mocha 560b2d8 Don't use regex to trim whitespace b1bdb92 Remove linting package zoo c20dc7e Cache 308 See full diff in compare...

dependabot[bot]

- [ ] ensure all readmes (and dockerfiles?) are in root of template - [ ] use separate file for dataset schema to make it clear what's `actor.json` and what's...

mnmkng

Creation of a template for basic crawler.

eneiromatos

Bumps the npm_and_yarn group with 7 updates: | Package | From | To | | --- | --- | --- | | [@babel/traverse](https://github.com/babel/babel/tree/HEAD/packages/babel-traverse) | `7.21.5` | `7.24.8` | | [axios](https://github.com/axios/axios)...

dependabot[bot]