In General, I would use `BaseSpider` is not `CrawlSpider` and manually prescribed xpaths for next_page and news.
Something like this:
def parse(self, response): news_css = 'div.fc-item__container > a::attr(href)' for news_link in response.css(news_css).extract(): req = scrapy.Request(response.follow(url=news_link, callback=self.parser_items) yield req next_page_css = 'div.pagination__list > a::attr(href)' for nextpage_link in response.css(news_css).extract(): req = scrapy.Request(response.follow(url=nextpage_link, callback=self.parse) yield req
PS Code is not tested, but I think the meaning is clear. Usually, with these spiders easier to work with than BroadCrawl
