Kindly provide your feedback on the following assertions about Chart A
Loading Chart A...
1. I think the chart seems easy to understand at a glance
NOYES
DisagreeI had to look at the chart several times just to identify basic values/elements
2. I think that the chart answers the given question
NOYES
DisagreeCrucial pieces of information needed to answer the question are missing
3. I think the chart is visually appealing and attractive
NOYES
DisagreeThe chart looks somewhat unattractive with many flaws.
Kindly provide your feedback on the following assertions about Chart B
Loading Chart B...
1. I think the chart seems easy to understand at a glance
NOYES
DisagreeI had to look at the chart several times just to identify basic values/elements
2. I think that the chart answers the given question
NOYES
DisagreeCrucial pieces of information needed to answer the question are missing
3. I think the chart is visually appealing and attractive
NOYES
DisagreeThe chart looks somewhat unattractive with many flaws.
Choose the chart you would prefer to see
Chart A
Loading Chart A...
Chart B
Loading Chart B...
No Strong Preference
≈
Same preference for both charts
Chart Comparison - Enlarged View
Chart A
Chart B
×
Context Information
Loading context...
Dataset Sample
Dataset Name:
Category:
📚 Narrative Summary
Loading dataset sample...
📊 Preference Annotation : A Brief Overview
Thanks for signing up for this pilot study! You are tasked with evaluating a series of data visualizations created from real datasets across diverse domains. Each annotation case is presented across 3 slides, which you can navigate using the arrow buttons or the dot indicators at the top of the page. The first two slides each show one of two candidate data visualizations (Chart A and Chart B) — both built from the same underlying dataset and intended to answer the same question about that data, which is displayed prominently in the navigation bar. The third slide lets you make a direct side-by-side comparison and record your overall preference between the two charts.
💬 Comments are essential
Each slide includes a Comments text box, and we strongly encourage you to use it for each of the 3 slides. Please share your subjective impressions freely — what you noticed, what confused you, what stood out, any trade-offs you weighed, and most importantly, your thoughts while choosing the overall preference . Your written thoughts are just as valuable as your slider ratings for this pilot study, and there is no such thing as a comment that is too short or too detailed.
Navigation & Saving
Use the ‹ › arrow buttons or the dot indicators to move between slides within a question.
You may click on a chart image to enlarge it for a closer look.
Continuing past the last slide (slide 3) will advance you to the next annotation question.
Use the 💾 Save button at any point to save your current responses without submitting.
Click Submit once you are satisfied with all your responses for that annotation case.
You can also download all your saved responses as a JSON file at any time using the download button ( Recommended for this PILOT STUDY ).
Expectations
For each chart, you will be asked to rate it on a few slider-based assertions covering various aspects of perception such as readability, precision, and aesthetics. There is no time pressure — take as long as you need to examine each chart carefully before responding. There are no right or wrong answers. The sliders are a 5-scale range from Strongly Disagree to Strongly Agree, and a short description is shown beneath each slider to help clarify what your chosen position means for each assertion.
Evaluation Criteria
🔍 Readability
Is the chart easy to perceive for you, and can you easily identify and understand the visually encoded information (data values, scale, annotations, etc.)?
🎯 Precision
Given the question, do you feel that the given chart can satisfactorily answer it?
🎨 Aesthetics
How visually appealing do you find it? Consider factors such as color choices, layout, use of space, labelling, and the overall visual design.
⭐ Overall Preference
Given the previous considerations about presence of important information to answer the question, your ability to easily identify and decode it, and the overall design/aesthetic appeal, which chart would you prefer?