Intellipaat Back

Explore Courses Blog Tutorials Interview Questions
0 votes
in Python by (45.3k points)

This is Windows 7 with python 2.7

I have a scrapy project in a directory called caps (this is where scrapy.cfg is)

My spider is located in caps\caps\spiders\

I cd into the scrapy project and try to run

scrapy crawl campSpider -o items.json -t json

I get an error that the spider can't be found. The class name is campSpider


    spider = self.crawler.spiders.create(spname, **opts.spargs)

  File "c:\Python27\lib\site-packages\scrapy-\scrapy\", l

ine 43, in create

    raise KeyError("Spider not found: %s" % spider_name)

KeyError: 'Spider not found: campSpider'

What am I missing here ?

1 Answer

0 votes
by (16.8k points)
edited by

Set the "name" property of the spider. 

For Example:

class campSpider(BaseSpider):

   name = 'campSpider'

Without the name property, the scrapy manager will not be able to find your spider.

Related questions

Browse Categories