WONDERBREAD Workflow Demonstrations

WONDERBREAD: A Benchmark + Dataset for Business Process Management (BPM) Tasks

Raw tables

Industry Research and benchmarks
Kind of data Real
Published by Zenodo
Creators Wornow, Michael
Published 2024-06-14
Licence CC BY 4.0
Copy on mindzie Yes - download it below
Total size 1.9 GB

About this data set

In the publisher's words:

Paper: WONDERBREAD: A Benchmark for Evaluating Multimodal Foundation Models on Business Process Management Tasks

The WONDERBREAD dataset contains 2,928 human demonstrations of 598 web navigation workflows across 6 types of BPM tasks. These tasks measure the ability of a model to generate accurate documentation, assist in knowledge transfer, and improve the efficiency of workflows.

Please see our website for more details: https://wonderbread.stanford.edu/

To start, download debug_demos.zip (1 GB). It contains a subset of 24 demonstrations which can give you a sense of how the dataset is structured.

To reproduce the paper, download gold_demos.zip (33 GB). It contains 724 demonstrations corresponding to the 162 "Gold" tasks which were used for all the evaluations in the original paper.

Get the data

mindzie keeps a copy of every file, so you can download it here. The licence is CC BY 4.0: credit the publisher with the citation below when you share results.

File Form Format Size
Process Mining Task Demonstrations.xlsx Raw tables xlsx 586 KB Download
debug_demos.zip Raw tables zip 943 MB Download
demos_sop_and_trace_only.zip Raw tables zip 771 MB Download
demos_sop_only.zip Raw tables zip 3.8 MB Download
df_rankings.csv Raw tables csv 110 KB Download
df_valid.csv Raw tables csv 325 KB Download
gold_demos_sop_and_trace_only.zip Raw tables zip 191 MB Download
gold_demos_sop_only.zip Raw tables zip 1.1 MB Download
metadata.json Raw tables json 794 KB Download
qa_dataset.csv Raw tables csv 42 KB Download

The original is at Zenodo.

Use it in mindzie

  • Raw tables: load the tables as raw data - a .csv per table, a .zip of them, or one .sqlite file. See From Raw Tables to an Event Log.
  • A single file can be up to 2 GB.

Licence and citation

Licence: CC BY 4.0

Commercial use: allowed. Sharing a copy: allowed.

Cite it as:

Wornow, Michael (2024). WONDERBREAD: A Benchmark + Dataset for Business Process Management (BPM) Tasks. Zenodo. https://doi.org/10.5281/zenodo.14094162

See Licences and Attribution for what each licence allows.

For AI agents

This data set as JSON, with a download address and checksum for every file: https://docs.mindziestudio.com/sample-data/datasets/wonderbread-workflow-demonstrations.json