Deploy your first web crawler in under 5 minutes
crsp new
command generates a template inside the directory of your choosing.
Edit the generated files to customize your crawler’s behavior.
Read Build a web crawler to learn the basic syntax.crsp dev
command.
This emulates your crawler’s behavior locally.
Certain features like JavaScript rendering are unavailable in this mode.
Keep in mind that the speed will be much slower compared to running in production.