Hoi!-A Multimodal Dataset for Force-Grounded, Cross-View Articulated Manipulation

Version 1.0
Hoi!-A Multimodal Dataset for Force-Grounded, Cross-View Articulated Manipulation
Engelbracht, Tim; Zurbrügg, René; Wohlrapp, Matteo; Büchner, Martin; Valada, Abhinav; Pollefeys, Marc; Blum, Hermann; Bauer, Zuria, 2026, "Hoi!-A Multimodal Dataset for Force-Grounded, Cross-View Articulated Manipulation", https://doi.org/10.60507/FK2/QODWTV, bonndata, V1
Learn about Data Citation Standards.
    The dataset is too large to download. Please select the files you need from the files table.
Contact Owner Share
Dataset Metrics
154,550 Downloads
Description
We present a dataset for force-grounded, cross-view articulated manipulation that couples what is seen with what is done and what is felt during real human interaction. The dataset contains 3048 sequences across 381 articulated objects in 38 environments. Each object is operated under four embodiments - (i) human hand, (ii) human hand with a wrist-mounted camera, (iii) handheld UMI gripper, and (iv) a custom Hoi! gripper - where the tool embodiment provides synchronized end-effector forces and tactile sensing. Our dataset offers a holistic view of interaction understanding from video, enabling researchers to evaluate how well methods transfer between human and robotic viewpoints, but also investigate underexplored modalities such as force sensing and prediction. Further information can be found on the Website. (2026-03-20)
Subject Computer and Information Science; Engineering
Related Publication IsSupplementTo: Engelbracht, T., Zurbrügg, R., Wohlrapp, M., Büchner, M., Valada, A., Pollefeys, M., ... & Bauer, Z. (2025). Hoi!--A Multimodal Dataset for Force-Grounded, Cross-View Articulated Manipulation. CVPR 2026
Notes version 0.1
License/Data Use Agreement

CC BY 4.0

Table
Tree
Filter by
1 to 10 of 4,769 Files
Engelbracht_Hoi-Dataset_Readme.txt
Plain Text - 11.0 KB
Published May 26, 2026
129 Downloads
MD5: 1cc1905f8ce634e56339eb9465865a0a
Preview "Engelbracht_Hoi-Dataset_Readme.txt"
manifest.csv
bathroom_1/Comma Separated Values - 27.9 KB
Published May 26, 2026
26 Downloads
MD5: 5069001f0ebbaeafa697009c2053dfa6
manifest.csv
Data
Preview "bathroom_1/manifest.csv"
sizes.txt
bathroom_1/Plain Text - 25.9 KB
Published May 26, 2026
14 Downloads
MD5: b4f2cb61d6779dd9bcea6f894cb37325
sizes.txt
Data
Preview "bathroom_1/sizes.txt"
interaction_splitting_info_1-2.json
bathroom_1/gripper/JSON - 632 B
Published May 26, 2026
29 Downloads
MD5: f4465888e4ef7158b0bb0face8de9254
interaction_splitting_info_1-2.json
Data
interaction_splitting_info_1-2_confirmed.json
bathroom_1/gripper/JSON - 664 B
Published May 26, 2026
110 Downloads
MD5: d9cf961d71420e7fb44ebda6831e334d
interaction_splitting_info_1-2_confirmed.json
Data
anonymization.json
bathroom_1/gripper/aria_gripper/bathroom_1_1-2_gripper_vrs/JSON - 185 B
Published May 26, 2026
15 Downloads
MD5: 9499b775839758aa83ab50b72020fbe0
anonymization.json
Data
anonymization_cache.zip
bathroom_1/gripper/aria_gripper/bathroom_1_1-2_gripper_vrs/ZIP Archive - 46.7 KB
Published May 26, 2026
42 Downloads
MD5: 91d9cc0a7334bd29456042c54b772553
anonymization_cache.zip.zip
Data
calib.zip
bathroom_1/gripper/aria_gripper/bathroom_1_1-2_gripper_vrs/ZIP Archive - 750 B
Published May 26, 2026
59 Downloads
MD5: 87a55455887bdd161bd00aebf0ee9594
calib.zip.zip
Data
camera_depth.zip
bathroom_1/gripper/aria_gripper/bathroom_1_1-2_gripper_vrs/ZIP Archive - 5.5 GB
Published May 26, 2026
25 Downloads
MD5: e338db08a92fa20226794882fa88b5c1
camera_depth.zip.zip
Data
camera_rgb.zip
bathroom_1/gripper/aria_gripper/bathroom_1_1-2_gripper_vrs/ZIP Archive - 1.4 GB
Published May 26, 2026
144 Downloads
MD5: d920385292d0803a43f33afe3137ee5e
camera_rgb.zip.zip
Data
Edit File

This file has already been deleted (or replaced) in the current version. It may not be edited.

Restrict Access

Restricting limits access to published files. People who want to use the restricted files can request access by default.If you disable request access, you must add information about access to the Terms of Access field.

Learn about restricting files and dataset access in the User Guide.

Enable access request
You must enable request access or add terms of access to restrict file access.
Save Changes
Edit Embargo

The selected file or files have already been published. Contact an administrator to change the embargo date or reason of the file or files.
Edit Retention Period

The selected file or files have already been published. Contact an administrator to change the retention period date or reason of the file or files.
Delete Files

The file will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Select File(s)

Please select one or more files.

Share Dataset

Share this dataset on your favorite social media networks.

Continue
Dataset Citations

Citations for this dataset are retrieved from Crossref via DataCite using Make Data Count standards. For more information about dataset metrics, please refer to the User Guide.

Sorry, no citations were found.
Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired or the files can only be transferred via Globus.

You may request access to any restricted file(s) by clicking the Request Access button.

Ineligible Files Selected

The selected file(s) may not be transferred because you have not been granted access or the file(s) have a retention period that has expired or the files are not Globus accessible.

You may request access to any restricted file(s) by clicking the Request Access button.

Download Options

The files selected are too large to download as a ZIP.

You can select individual files that are below the 93.1 GB download limit from the files table, or use the Data Access API for programmatic access to the files.

Select File(s)

Please select a file or files to be downloaded.

Inaccessible Files Selected

The selected file(s) may not be downloaded because you have not been granted access or the file(s) have a retention period that has expired.

Click Continue to download the files you have access to download.

Ineligible Files Selected

Some file(s) cannot be transferred. (They are restricted, embargoed, with an expired retention period, or not Globus accessible.)

Click Continue to transfer the elligible files.

Delete Dataset

Are you sure you want to delete this dataset and all of its files? You cannot undelete this dataset.

Delete Draft Version

Are you sure you want to delete this draft version? Files will be reverted to the most recently published version. You cannot undelete this draft.

Unpublished Dataset Preview URL

You can create a Preview URL to copy and share with others who will not need a repository account to review this unpublished dataset version. Once the dataset is published or if the URL is disabled, the URL will no longer work and will point to a "Page not found" page. Only one Preview URL can be active for a single draft dataset.

To cite this data in publications, use the datasets persistent ID instead of this URL. For more information about the Preview URL feature, please refer to the User Guide.

General Preview

Create a URL that others can use to review this draft dataset version before it is published. They will be able to access all files in the dataset and see all metadata, including metadata that may identify the dataset's authors.

Anonymous Preview

Create a URL that others can use to access an anonymized view of this unpublished dataset version. Metadata that could identify the dataset's author will not be displayed. (See Tool Tip for the list of withheld metadata fields.) Non-identifying metadata will be visible.

The dataset's files are not changed and users of the Anonymous Preview URL will be able to access them. Users of the Anonymous Preview URL will not be able to see the name of the Dataverse that this dataset is in but will be able to see the name of the repository, which might expose the dataset authors' identities.

To verify that all identifying information has been removed or anonymized, it is recommended that you logout and review the dataset as as it would be seen by an Anonymous Preview URL user. See User Guide for more information.

You won't be able to create an Anonymous Preview URL once a version of this dataset has been published.

Unpublished Dataset Preview URL

Are you sure you want to disable the Preview URL? If you have shared the Preview URL with others they will no longer be able to use it to access your unpublished dataset.

Delete Files

The file(s) will be deleted after you click on the Delete button.

Files will not be removed from previously published versions of the dataset.

Compute

This dataset contains restricted files you may not compute on because you have not been granted access.

Deaccession Dataset

Are you sure you want to deaccession? This is permanent and the selected version(s) will no longer be viewable by the public.

Deaccession Dataset

Are you sure you want to deaccession this dataset? This is permanent an it will no longer be viewable by the public.

Version Differences Details

Please select two versions to view the differences.

Version Differences Details
 
Version:
Last Updated:
Version:
Last Updated:
Select File(s)

Please select a file or files for access request.

Select File(s)

Embargoed files cannot be accessed. Please select an unembargoed file or files for your access request.

Edit Tags

Select existing file tags or create new tags to describe your files. Each file can have more than one tag.

Request Access

  You need to Log In to request access.

Dataset Terms

Please confirm and/or complete the information needed below in order to request access to files in this dataset.

This dataset is made available under the following terms. Please confirm and/or complete the information needed below in order to continue.

Our Community Norms as well as good scientific practices expect that proper credit is given via citation. Please use the data citation shown on the dataset page.

CC BY 4.0

Preview Guestbook

Upon downloading files the guestbook asks for the following information.

Account Information

Package File Download

Use the Download URL in a Wget command or a download manager to download this package file. Download via web browser is not recommended. User Guide - Downloading a Dataverse Package via URL

https://bonndata.uni-bonn.de/api/access/datafile/

Compute Batch
Clear Batch
Dataset Persistent Identifier Change Compute Batch
Compute Batch
Submit for Review

You will not be able to make changes to this dataset while it is in review.

Publish Dataset

Are you sure you want to republish this dataset?

Due to the nature of changes to the current draft this will be a major release (2.0)

Publish Dataset

This dataset cannot be published until bonndata is published by its administrator.

Return to Author

Return this dataset to contributor for modification. The reason for return entered below will be sent by email to the author.

???dataset.curationStatusHistory???
???dataset.curationStatus??????dataset.curationDate??????dataset.curationAssigner???
No records found.
Add/Edit a Version Note
Styled Citation