Fetch data from behind a log-in (auth API)

You can scrape data from behind a log-in with kimono using kimono's Chrome Extension. Make sure that you've given Kimono access during Private Browsing in the chrome extension settings.

To do this, navigate to the page that you would like to kimonify (after the log-in process). Click the chrome extension   and from the toolbar you can select the lock icon  to enter auth mode - the lock icon will pulsate if kimono detects that the page you are on requires authentication.

When the lock icon is clicked, kimono will open your page in a new incognito window without access to your cookies/session data, i.e. it will have logged you out of the site you were looking at.

If you are not redirected to the login page after clicking , you will need to click the cursor  button to enter navgiation mode - this disables kimono extraction - allowing you to click links and move between pages. Navigate to the login page.

While in auth mode, you will notice that the normal data circles in the toolbar have been replaced by the buttons.

With the first data circle (with the profile icon) highlighted, select the username/email field, with the second data circle (with the key icon) highlighted, select the password field and with the third data circle (with the up arrow) highlighted, select the submit button. Kimono will move between data circles as you click each type. If you are having trouble selecting the data, read about how to select unclickable data: here.

Once you've identified the three elements, click to enter your credentials. You must tick the agreement checkbox to allow kimono to store your credentials. After completing the form, kimono will log you into the website and you'll see the post-login data again.

Now you're ready to extract data with kimono just as you normally would.

If you're having trouble selecting the username/password/submit button, try using advanced mode to select the exact field or button you need.

Powered by Zendesk