login with scrapy-playwright

[scrapy-plugins]

login with scrapy-playwright

[elacuesta]

Please, share what you have tried.

[elacuesta]

Without more context, all I'll venture to say is that PageCoroutine("fill", "#to_date", "2021-12-17") should produce the expected results.

[Alfin72]

sorry for disturbing you during the holiday season.

I am basically trying to log in using playwright and then send the response to scrapy.

Here is how my spider looks.

`import scrapy
from scrapy_playwright.page import PageCoroutine

class ScrollSpider(scrapy.Spider):
name = "quotes"

def start_requests(self):
    yield scrapy.Request(
        url="https://quotes.toscrape.com/login",
        meta=dict(
            playwright=True,
            playwright_include_page=True,
            playwright_context="new",
            playwright_page_coroutines=[
                PageCoroutine("fill", "#username", "2021-12-17"),
                PageCoroutine("fill", "#password", "2021-12-18"),
                PageCoroutine("click", selector="[type='submit']"),
                PageCoroutine("wait_for_timeout", 5000),
            ],
        ),
    )

def parse(self, response):
    # 'response' contains the page as seen by the browser
    yield {"url": response.url}  

Instead of login and returning "https://quotes.toscrape.com/"
I am getting {'url': 'https://quotes.toscrape.com/login'}

Here is the playwright code which I am trying to replicate using scrapy_playwright.

`from playwright.sync_api import sync_playwright

with sync_playwright() as p:
for browser_type in [p.chromium]:
browser = browser_type.launch(headless=False)
page = browser.new_page()
page.goto("https://quotes.toscrape.com/login")
page.fill('#username', '2021-12-16')
page.fill('#password', '2021-12-17')
page.wait_for_timeout(5000)
page.query_selector('[type="submit"]').click()
page.wait_for_timeout(15000)
browser.close()`

[Alfin72]

I tried the same code on a different website and the code works, I believe the bug might be in (https://quotes.toscrape.com/login) hence I will close this issue.