I read through
scrapy documentation, grasped idea that I have to understand HTML, xpath, css, selectors, responses, middleware, integration possibilities of beautifulsoup and lxml spiders, data export and changes to definitions possibilities to spiders as well as that every specific site may require his unique approach. I did standard Scrapy Example spiders, I did
pypi imagebot and it worked, but I could not managed to get through writing unique spider to online shop. So I found on github Scrapy tutorial, which I hope to learn in near time. Below is
Scrapy guru site which looks promising. I will write my practical experience after I test examples and go it through. Below images and link of tutorial.
http://scrapy-guru.readthedocs.io/en/latest/intro.html#get-started
 |
| Scrapy guru workflow chart |
 |
| Scrapy guru project structure |
 |
| scrapy guru spider |
No comments:
New comments are not allowed.