loops Scenario 1 — Iterate Over URL List Variable

Written by RTILA X Engineering Team

Beginner ~4 min

What You'll Learn

Iterate over a list of URLs

Real-World Use Case

Scraping multiple product pages

LIVE DEMO

URL List Iteration

Five target pages visited through a for_each URL list loop.

URL List

EXPECTED OUTPUT

Visited Page Titles

title
Basic Navigation Scenario 1 — Extract All Product Titles
Basic Navigation Scenario 2 — Scrape Top 30 Headlines with URLs
Basic Navigation Scenario 3 — Take a Full-Page Screenshot
Basic Navigation Scenario 4 — RTILA X
Basic Navigation Scenario 5 — Get Text of Hero Banner

RTILA X PROJECT JSON

RTILA X Automation Project

iterate-url-list.json

{
  "name": "Iterate_URL_List",
  "settings": {
    "urls": [
      "https://learn.rtila.com/scenarios/loops/1"
    ],
    "variables": [
      {
        "is_list": true,
        "name": "url_list",
        "required": true,
        "value": "https://learn.rtila.com/scenarios/basic-navigation/1\nhttps://learn.rtila.com/scenarios/basic-navigation/2\nhttps://learn.rtila.com/scenarios/basic-navigation/3\nhttps://learn.rtila.com/scenarios/basic-navigation/4\nhttps://learn.rtila.com/scenarios/basic-navigation/5"
      }
    ]
  },
  "datasets": {
    "visited_pages": {
      "item_selector": "css=html",
      "properties": [
        {
          "name": "title",
          "type": "text",
          "selector": "css=title"
        }
      ]
    }
  },
  "commands": [
    {
      "command": "for_each",
      "params": {
        "source_type": "variable",
        "variable": "url_list",
        "as": "url",
        "do": [
          {
            "command": "goto",
            "params": {
              "url": "${url}"
            }
          },
          {
            "command": "extract_data",
            "params": {
              "dataset": "visited_pages"
            }
          }
        ]
      }
    }
  ]
}

RTILA X Concepts

This scenario demonstrates the for_each command using a list variable. Each URL is visited in turn and the page title is extracted into the dataset.

Did you complete this scenario?

Ready to run this automation?

Copy the project JSON above, open RTILA X, create a new project, and paste it.

Download RTILA X Free → View setup guide →

This scenario covers 2 RTILA X commands and is referenced in 2 learning articles.

Continue Learning

Was this helpful?