An Overview of Ruia

Ruia is An asynchronous web scraping micro-framework, powered by asyncio and aiohttp, aims at making crawling url as convenient as possible.

Write less, run faster is Ruia's philosophy.

Ruia spider consists the following four parts:

Ruia Part Is Required Description
Data Items Required a collection of fields
Spider Recommended a manager to make your spider stronger
Middleware Optional used for processing request and response
Plugin Optional used to enhance ruia functions