TODO

[yijingping]

• [x] Json中如何存放python code 在前端使用编辑器，后端存储时字符串化
• [x] innerHtml 获取 使用lxml.html.to_string()解决
• [x] html 去除script和外链 使用正则表达式解决
• [x] 部分直接以链接跳走
• [x] 图片类型下载到七牛云
• [ ] exec传入当前url等信息
• [ ] 监控
• [x] 配置（访问速度、是否使用浏览器壳、使用随机代理等）
• [x] Indexrule 索引使用列表

[yijingping]

• [ ] 添加配置界面（如scrapinghub）
• [ ] 添加浏览器壳支持（可配置是否启用图片加载等）
• [ ] 添加mongodb存储功能支持

[xielm12]

如果能做成可视化，不用自己写xpath就更赞了

[ghost]

Hello,

We have an exciting opportunity for you! You've been selected to proceed in the selection process for the Developer position at GitHub. Congratulations on your achievement!

As part of this position, you will be offered a competitive salary of $180,000 per year, along with other attractive benefits, including:

• Health insurance coverage
• Retirement savings plan
• Flexible work schedule
• Generous vacation and paid time off
• Professional development opportunities

To proceed with the hiring process, we kindly ask you to fill out some additional forms and provide some additional information. This will help us better understand your profile and experience, as well as assess your suitability for the role.

Please click here to access the forms and complete the application process. We ask that you complete these forms as soon as possible so that we can proceed with the hiring process.

Important: You have 24 hours to complete the application process.

If you have any questions or need further information, please don't hesitate to contact us.

Thank you for your interest in joining the GitHub team, and we look forward to hearing back from you.

Best regards,
GitHub Recruitment Team BraedenNorris, @cameronodell1998, @accpwork, @qct, @tuxcanfly, @g010329, @vunguyenqut, @lynnroyal, @HALOSTAR, @DarthNoodle, @cicoph, @naelob, @yazeed, @Yhtiyar, @dosomder, @lavanphat, @TheKelvinPerez, @kishansudani, @BI-NOP, @yibana