Skip to main content

data-transformation Scenario 4 — Extract Nested List Data and Export Parquet

Written by RTILA X Engineering Team

Intermediate ~6 min
Prerequisites: data-transformation/1 data-transformation/2

What You'll Learn

Chain multiple transformations on a dataset

Real-World Use Case

Cleaning and enriching leads

LIVE DEMO

Wireless Headphones

electronicssalenew
Wireless HeadphonesWireless Headphones

Gaming Monitor

electronicsgamingfeatured
Gaming MonitorGaming Monitor

Ergonomic Keyboard

electronicsofficenew
Ergonomic KeyboardErgonomic Keyboard

USB-C Charger

electronicsaccessoriessale
USB-C ChargerUSB-C Charger
EXPECTED OUTPUT

RTILA X PROJECT JSON

    {
  "name": "Extract_Nested_Lists",
  "settings": {
    "urls": [
      "https://learn.rtila.com/scenarios/data-transformation/4"
    ]
  },
  "datasets": {
    "nested_items": {
      "item_selector": "css=.nested-item",
      "properties": [
        {
          "name": "title",
          "type": "text",
          "selector": "css=.nested-title"
        },
        {
          "name": "tags",
          "type": "list",
          "selector": "css=.tag",
          "properties": [
            {
              "name": "tag_name",
              "type": "text",
              "selector": "css=self"
            }
          ]
        },
        {
          "name": "images",
          "type": "list",
          "selector": "css=.nested-img",
          "properties": [
            {
              "name": "src",
              "type": "attribute",
              "selector": "css=self",
              "attribute": "src"
            }
          ]
        }
      ]
    }
  },
  "commands": [
    {
      "command": "wait_for_selector",
      "params": {
        "selector": "css=.nested-item"
      }
    },
    {
      "command": "extract_data",
      "params": {
        "dataset": "nested_items"
      }
    },
    {
      "command": "comment",
      "params": {
        "text": "Parquet export would preserve nested arrays natively"
      }
    }
  ]
}
  

List-type properties allow nested collection extraction. Each nested list can have its own properties, creating hierarchical data ready for formats like Parquet.

Did you complete this scenario?

Ready to run this automation?

Copy the project JSON above, open RTILA X, create a new project, and paste it.

This scenario covers 2 RTILA X commands and is referenced in 2 learning articles.

Continue Learning

Was this helpful?