How to Scrape a List of URLs

A list page rarely tells the whole story. A product grid shows a shortened title and a price; the description, stock count and specifications sit on each product's own page. Getting those means opening every page and reading the same few fields.

This guide does that in two passes on Books to Scrape: one to collect the links, one to visit them. On the list page the first book is shown as "A Light in the ..."; by the end you will have its full title from its own page.

What you need

• Google Chrome on a computer (version 114 or later)
• The Easy Scraper AI extension
• Either a list page that links to the pages you want, or a CSV file with the URLs in one column

Steps

1. 1

   Step 1: Scrape the list and keep the link column

   Open the list page, open the side panel and check the detected fields. At least one of them holds the link to each item — on the practice site there are two, "Link" and "Link 2", and both lead to the book's own page. Keep one of them ticked, then press Start. Only ticked fields are collected, so a link column you untick here will not be available later.

   
2. 2

   Step 2: Open one detail page and switch to Details

   Click through to any one of the items and choose Details at the bottom of the panel. The first time on a site it says "Nothing chosen yet".

   
3. 3

   Step 3: Click the fields you want

   Click "Pick fields on the page", then click each value on the page: here the title and the price. Picked fields get a green outline with a name (Title, Price) and the small box on the page counts them: "2 picked". If an outline is not quite right, "Select more" and "Select less" in that box grow or shrink it. Click something again to remove it, and click Done when you have them all.

   
4. 4

   Step 4: Check the saved fields

   The panel now lists the fields with the values it read from this page. They are saved as a template for the site, so you only do this once. "Highlight matches" shows on the page what each field points at, and "Pick again" lets you add or remove fields later.

   
5. 5

   Step 5: Switch to Batch and choose the URLs

   Choose Batch. With no list yet it offers two sources: "Upload CSV", or "Use links from the last scrape". Pick the second, select the link column and click Use.

   
6. 6

   Step 6: Press Start

   The panel shows how many URLs are queued — "URL list 20 URLs" — and Start runs them. Each page is opened in the same tab in turn and the fields are read from it. The counter shows progress, for example "6 rows · 6/20 · 00:13".

   
7. 7

   Step 7: Export the table

   When it finishes, click "Open results window" and export as CSV or JSON, or copy the table. Each row starts with the URL it came from.