python – 如何从命令行使用Scrapy传递表单数据?
发布时间:2020-12-20 12:05:41 所属栏目:Python 来源:网络整理
导读:我怎么能从命令行传递用户名和密码?谢谢! class LoginSpider(Spider): name = 'example.com' start_urls = ['http://www.example.com/users/login.php'] def parse(self,response): return [FormRequest.from_response(response,formdata={'username': 'jo
我怎么能从命令行传递用户名和密码?谢谢!
class LoginSpider(Spider): name = 'example.com' start_urls = ['http://www.example.com/users/login.php'] def parse(self,response): return [FormRequest.from_response(response,formdata={'username': 'john','password': 'secret'},callback=self.after_login)] def after_login(self,response): # check login succeed before going on if "authentication failed" in response.body: self.log("Login failed",level=log.ERROR) return # continue scraping with authenticated session... 解决方法
打开终端并确保安装了scrapy.
> scrapy外壳 信息: > Scrapy 1.0.0 (编辑:李大同) 【声明】本站内容均来自网络,其相关言论仅代表作者个人观点,不代表本站立场。若无意侵犯到您的权利,请及时与联系站长删除相关内容! |