Web scrape with login

How can I login to a website before scraping the URLs?

I tried puppeteer but having issue on login successfully. Does Agenty have some recommendations on how to do web scraping easily behind login. I have to be able to enter the username, password and click on login button before scraping the pages in my input.

@jumi you can use the Form authentication feature in Agenty. All you need to do is configure your agent to visit login page and then enter the username/password on corresponding fields before starting the scraping of password protected websites.

This is how the login config will looks like -

 "login": {
        "enabled": true,
        "type": "FORM",
        "data": [
            {
                "command": "NAVIGATE",
                "target": null,
                "value": "https://demo.moodle.net/login/index.php"
            },
            {
                "command": "TYPE",
                "target": "#username",
                "value": "admin"
            },
            {
                "command": "TYPE",
                "target": "#password",
                "value": "sandbox",
            },
            {
                "command": "CLICK",
                "target": "#loginbtn",
                "value": null,
            },
            {
                "command": "WAIT",
                "target": null,
                "value": "2",
            }
        ]
    }, 

Here is video -