Advanced Methods in HCI
Spring 2022
*Note that the course dates and lectures will be updated throughout the semester.*
Instructor: Narges Mahyar
Email: nmahyar@cs.umass.edu
Office: Room 322, Computer Science Building
Office Hours: TBD
TA: Alyx Burns
Description
This is an advanced course in Human-Computer Interaction. This course will provide a deeper treatment of some topics that are typically found in an undergraduate HCI course. For example, design methodologies, evaluation methodologies (both quantitative and qualitative), human information processing, cognition, and perception. This course will also introduce students to research frontiers in HCI. The course will cover topics of Universal Usability, CSCW, Digital Civics and fundamentals of designing interactive technology for people.
Course Overview
People are increasingly surrounded by interactive computational technology systems that are integral to their everyday life. However, poorly designed systems are common, and they can lead to negative outcomes such as frustration, lost time, and errors. The role of design is more crucial than ever before for crafting appropriate systems that truly meet people’s needs, abilities, and expectations. This course covers the theories and concepts important for all professionals and researchers that design interactive technology for human use. This course will build common ground across students from a range of backgrounds, so they will have a shared vocabulary and methods to bring into other components of the Designing for People. Designing for People means designing for human experience, abilities, and fallibilities, which requires in-depth engagement of people throughout the design process in order to develop interactive technologies that fit human needs and capabilities. More specifically, the course adopts a human-centered design (HCD) approach and teaches a highly iterative process called design thinking. This process draws heavily on fundamental human-computer interaction (HCI) methods. Students will have a chance to practice and hone their abilities through weekly homework in the context of a project, in-class activities, and discussions.
Course Origins
This course was originally developed and taught by Prof. Joanna McGerener and Dr. Leila Aflattony at University of British Columbia (UBC) as a new graduate course in HCI on the Fundamentals of Designing Interactive Computational Technology for People (DFP). The course draws on Prof. McGerener’s many years of teaching HCI courses at UBC and also borrows materials from Prof. Karon MacLean and Jessica Dawson.
Textbooks
Survey and research articles will be the primary text for the course, chosen from a collection of readings. There is no textbook required.
Prerequisite
Students are expected to have taken an HCI course prior to taking this course. While there are no other formal prerequisites, the ability to do basic computer programming will be an asset for the prototyping part of the course. Alternate tools that require minimal programming will, however, be possible. Further, there will be some coverage of experimental design and analysis, which relies on some basic statistical knowledge.
University policies and information
Accommodation Statement
The University of Massachusetts Amherst is committed to providing an equal educational opportunity for all students. If you have a documented physical, psychological, or learning disability on file with Disability Services (DS), you may be eligible for reasonable academic accommodations to help you succeed in this course. If you have a documented disability that requires an accommodation, please notify me within the first two weeks of the semester so that we may make appropriate arrangements.
Academic Honesty Statement
Since the integrity of the academic enterprise of any institution of higher education requires honesty in scholarship and research, academic honesty is required of all students at the University of Massachusetts Amherst. Academic dishonesty is prohibited in all programs of the University. Academic dishonesty includes but is not limited to: cheating, fabrication, plagiarism, and facilitating dishonesty. Appropriate sanctions may be imposed on any student who has committed an act of academic dishonesty. Instructors should take reasonable steps to address academic misconduct. Any person who has reason to believe that a student has committed academic dishonesty should bring such information to the attention of the appropriate course instructor as soon as possible. Instances of academic dishonesty not related to a specific course should be brought to the attention of the appropriate department Head or Chair. Since students are expected to be familiar with this policy and the commonly accepted standards of academic integrity, ignorance of such standards is not normally sufficient evidence of lack of intent (http://www.umass.edu/dean_students/codeofconduct/acadhonesty/).
Inclusive Statemnet
In this course, each voice in the classroom has something of value to contribute. Please take care to respect the different experiences, beliefs, and values expressed by the students, faculty, and staff involved in this course. My colleagues and I support UMass’s commitment to diversity, and welcome individuals regardless of age, background, citizenship, disability, sex, education, ethnicity, family status, gender, gender identity, geographical origin, language, military experience, political views, race, religion, sexual orientation, socioeconomic status, and work experience (cics.umass.edu/about/inclusivity-statement).
Week | Date | Topics and Readings | Lectures | Deliverables |
1 | Tues- Jan 25 | Course Overview & Logistics and History of HCI
No Reading | Lecture 1 | |
Thurs- Jan 27 | Principles of Interaction Design
Reading: Norman, Donald A. The Design of Everyday Things. Basic Books, 01/01/2013. Web. 31 Aug. 2017. Chapter 1. The psychopathology of everyday things. | Lecture 2 | Research Journal | |
2 | Tues- Feb 1 | Human-centered Design & HCI Reading: Norman, Donald A. The Design of Everyday Things. Basic Books, 01/01/2013. Web. 31 Aug. 2017. Chapter 6. Design Thinking. | Lecture 3 | Research Journal |
Thurs- Feb 3 | Field Studies – Observations Reading: Porcheron, M., Fischer, J. E., and Sharples, S. (2016) Using mobile phones in pub talk. Proceedings of ACM CSCW ’16, 1649-166. | Lecture 4 | Research Journal | |
3 | Tues- Feb 8 | Field Studies – Interviews Reading: Jasim, M., Hoque, E., Sarvghad, A., & Mahyar, N. (2021, June). CommunityPulse: Facilitating community input analysis by surfacing hidden insights, reflections, and priorities. In Designing Interactive Systems Conference 2021 (pp. 846-863).
Optional Reading: Research Methods in Human-Computer Interaction. 2017. Chapter 8. Interviews and Focus Groups. | Lecture 5 | Research Journal |
Thurs- Feb 10 | Field Studies – Surveys/Questionnaires
Reading: Malin Eiband, Mohamed Khamis, Emanuel von Zezschwitz, Heinrich Hussmann, and Florian Alt. 2017. Understanding Shoulder Surfing in the Wild: Stories from Users and Observers. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI ’17). ACM, New York, NY, USA, 4254-4265. Optional Reading: Research Methods in Human-Computer Interaction. 2017. Chapter 5. Surveys. | Lecture 6 | Research Journal | |
4 | Tues- Feb 15 | Personas and Tasks
Reading: Salminen, J., Jung, S. G., Chowdhury, S., Sengün, S., & Jansen, B. J. (2020, April). Personas and analytics: A comparative user study of efficiency and effectiveness for a user identification task. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (pp. 1-13). Optional Reading: About Face: The Essentials of Interaction Design, Chapter 3. Modeling Users: Personas and Goal John Wiley & Sons. | Lecture 7 | Research Journal |
Thurs- Feb 17 | Requirements and Metrics
Reading: Xiao, Z., Zhou, M. X., Liao, Q. V., Mark, G., Chi, C., Chen, W., & Yang, H. (2020). Tell me about yourself: Using an AI-powered chatbot to conduct conversational surveys with open-ended questions. ACM Transactions on Computer-Human Interaction (TOCHI), 27(3), 1-37. Optional Reading: Interaction Design: Beyond Human-Computer Interaction. Chapter 10. Task Description, Task Analysis, Chichester, West Sussex: Wiley. | Research Journal | ||
5 | Tues- Feb 22 | No class-Monday Class Schedule | ||
Thurs- Feb 24 | Milestone 1 Presentation
No Reading | Milestone 1 Report & Presentation | ||
6 | Tues- Mar 1 | Qualitative Data Analysis – Affinity Diagrams
Reading: Mahyar, N., Nguyen, D. V., Chan, M., Zheng, J., & Dow, S. P. (2019, June). The civic data deluge: Understanding the challenges of analyzing large-scale community input. In Proceedings of the 2019 on Designing Interactive Systems Conference (pp. 1171-1181). Optional Reading: Contextual Design: Design for Life. Chapter 6. The Affinity Diagram. Elsevier Inc. | Research Journal | |
Thurs- Mar 3 | Qualitative Data Analysis – Thematic Analysis
Reading: Hoarding and Minimalism: Tendencies in Digital Data Preservation. Proceedings of the CHI 2018. Paper 587, 12 pages. pp. 1-12. | Research Journal | ||
7 | Tues- Mar 8 | Mental Models
Reading: Mental Models by the Nielsen-Norman Group – https://www.nngroup.com/articles/mental-models/ | Research Journal | |
Thurs- Mar 10 | Conceptual Models
Reading: Johnson, J., & Henderson, A. (2002). Conceptual models: begin by designing what to design. interactions, 9(1), 25-32. | Research Journal | ||
8 | Tues- Mar 15 | No Class-Spring Recess | ||
Thurs- Mar 17 | No Class-Spring Recess | |||
9 | Tues- Mar 22 | Prototyping – Low Fidelity
Reading: Sturdee, M., & Lindley, J. (2019, November). Sketching & drawing as future inquiry in HCI. In Proceedings of the Halfway to the Future Symposium 2019 (pp. 1-10). Optional Reading: Sketching user experiences: The workbook, Section 4. Snapshots in Time: The Visual Narrative. | Research Journal | |
Thurs- Mar 24 | Milestone 2 Presentations
No Reading | Milestone 2 Report & Presentation | ||
10 | Tues- Mar 29 | Prototyping – Mid and High Fidelity
Reading: Tohidi, M., Buxton, W., Baecker, R., & Sellen, A. (2006, April). Getting the right design and the design right. In Proceedings of the SIGCHI conference on Human Factors in computing systems (pp. 1243-1252). | Research Journal | |
Thurs- Mar 31 | Evaluation – Usability Testing
Reading: Human-Computer Interaction, Chapter 9. Evaluation techniques (pp. 318-364), Pearson. | Research Journal | ||
11 | Tues- Apr 5 | Evaluation – Cognitive Walkthrough
Reading: Mahyar, N., Burke, K. J., Xiang, J., Meng, S., Booth, K. S., Girling, C. L., & Kellett, R. W. (2016, November). Ud co-spaces: A table-centred multi-display environment for public engagement in urban design charrettes. In Proceedings of the 2016 ACM international conference on interactive surfaces and spaces (pp. 109-118). Optional Reading: User Interface Inspection Methods, Chapter 4. Cognitive Walkthrough. | Research Journal | |
Thurs- Apr 7 | Evaluation – Heuristic Evaluation
Reading: User Interface Inspection Methods, Chapter 1. Heuristic Evaluation. | Research Journal | ||
12 | Tues- April 12 | Designing Controlled Experiments
Reading: Burns, A., Xiong, C., Franconeri, S., Cairo, A., & Mahyar, N. (2021). Designing with Pictographs: Envision Topics without Sacrificing Understanding. IEEE transactions on visualization and computer graphics. Optional Reading: Research Methods in Human-Computer Interaction. 2017. Chapter 3. Experimental Design. | Research Journal | |
Thurs- April 14 | Evaluation – Quantitative Analysis (Guest Lecture by Ali Sarvghad) Reading: TBD
Optional Reading: Research Methods in Human-Computer Interaction. 2017. Chapter 4. Statistical Analysis. | Research Journal | ||
13 | Tues- April 19 | Milestone 3 Presentations
No Readings | Milestone 3 Report & Presentation | |
Thurs- April 21 | TBD | |||
14 | Tues- April 26 | Visual Design
Reading: Franconeri, S. L., Padilla, L. M., Shah, P., Zacks, J. M., & Hullman, J. (2021). The science of visual data communication: What works. Psychological Science in the Public Interest, 22(3), 110-161. | Research Journal | |
Thurs- April 28 | Human Abilities
No Readings | |||
15 | Tues- May 3 | Final Project Presentations No Reading | Final Report & Demo |
Researcher journals are an important part of the deliverables in this course.
Instructions on how to post your entries in your researcher journal are found further below.
Journal entry: Reflections on the assigned readings
Due: by 8 AM the day that readings are covered in class. This is a strict cutoff. (Note: we reserve the right to change this time within the term)
Students must do the core readings before the classes. By the due date/time, students must create an entry in their shared journal with a question/comment about the material being covered that day, one note per required reading. We encourage you to also to have a copy of these questions/comments with you in class and use them as a springboard for discussion.
Your questions/comments should be thoughtful, and clearly show that you have done the reading and reflected on it. They do not all have to be phrased in the form of a question, a comment is fine. If you are genuinely confused by some aspect of the reading, then it is useful and legitimate to ask for clarification. However, simply asking something that you could trivially look up yourself is not a good question.
The goal of the shared journal is not only for you to reflect on the readings yourself, but also to learn about your classmates reflections on those same readings. For this reason, the journal entries are open to the full class. This will lead to richer in-class discussions.
Each question/comment should be at most one short to medium length paragraph. Often two or three sentences will suffice. The goal is to have short, crisp questions/comments.
Submitting your Researcher Journal entries
Researcher Journals are found as a module in Pizza. Each reading is set up as a Discussion item with the label that matches the reading number on the course schedule page. For example, to submit your journal entry for the first reading simply “Reply” to the discussion topic “Reading #1”.
Four important things to note:
- The researcher journals are open/visible to the entire class. Thus, all students in the class as well as the instructors will be able to see your entry (but only grading for their own entries).
- You are should not edit an entry after submission.
- You can optionally reply directly to other students’ entries — again, your reply will be visible to all.
Tab Content
Project title: Designing a Human-centred Interactive Computational Technology
Description:
Throughout the course, we will explore and apply different methods that are appropriate for designing and evaluating an interactive computational technology that closely meets human needs. Examples of potential technologies are interactive 2D interfaces, interactive 3D devices, wearables, robots, and so on. Your team will choose a topic from the list provided below which will seed your project. You will identify a clear problem to be addressed (or potential design opportunity) by investigating people’s behaviors, activities, and interactions, and will then create a working prototype that meets their needs, which you will evaluate. Following the design thinking process, there are approximately 6 project milestones, which may include a small final design showcase. These will be scheduled approximately every other week and there will be deliverables for each. For approximately half of these milestones, your team will need to be prepared to “present” your work during class time in the form of a “design crit” for which you will be marked and receive constructive feedback. Meeting the project milestones is crucial in completing the project successfully.
Team formation:
The first step in the research project is to form a team with 3 other people. There is not a lot of time for this, so you will need to move fast. You are free to work with whomever you choose, but you should strive for as multi-disciplinary a team as possible. Your team will choose a project topic listed in the project description. Groups will be set up for each team in Piazza. Once your team is formed, you will need to complete a team contract and submit it to Gradescope. The due dates for these steps are noted in deliverables on the Schedule page.
Milestones:
Please see course schedule for tentative dates for each milestone. A draft outline of what might be required for each of the milestones is given below. These will be refined and provided to you as you approach each milestone.
- Milestone 1: In this stage, you will craft a meaningful and actionable problem statement or design focus through analyzing of the information gathered about user needs and context. In addition, you will develop a persona (or personas), which is a model of a user that focuses on the individual’s characteristics and goals when using an artifact. The personas should be based on thoughtful analysis of data you’ve collected through research you’ve completed with your participant groups.
- Milestone 2: You will develop a conceptual design of your potential interactive computational system, considering your participant group requirements. You need to submit a design requirement document with detailed description of a system to be developed. This stage provides source material for building prototypes and innovative solution to the problem. You will also submit a low-fidelity prototype at this stage.
- Milestone 3: At this stage, you will create a high-fidelity working prototype or prototypes (first iteration) of a computational technology according to your concept. The prototype(s) of your concept needs to detail how the concept will be experienced and used. The medium of the mock-up depends on the solution and may show an interface or a physical/tangible 3D mock-up. In addition, you will devise a method for evaluating your prototype.
- Final Report: You will test your prototype(s) with participants who are representative of the group of people you are designing for and analyze your results. The final report will encompass many of the components from prior milestones in the form of a research paper.
Grading (tentative)
Milestones 1, 2, & 3 (10% each) | 30% |
Final Report & Presentation (15% each) | 30% |
Total: | 70% |
Submission:
Details provided in individual milestone descriptions.
Topics:
Potential design problems/opportunities/situations, which are deliberately vaguely specified:
- Waiting time for paying/ordering food can be long at restaurants.
- Texting while walking is dangerous, but people cannot stop.
- Train/metro platforms can be jammed with people. It is frustrating and can be dangerous.
- Hiking alone in unknown areas can be dangerous. Getting lost is a common problem for solo hikers.
- Managing simple physical tasks at home such as turning on/of lights can be challenging for older adults.
- Need access to older adults
- Houses can be broken into when no one is at home. Police advise people to make their houses look occupied when they are away.
- Need access to participants who have homes
- Babies scream, as they can’t say actual words when they try to get their parents attention. It is challenging for parents to understand their baby’s needs.
- Need access to participants with babies.
- Educating children (ages 2-4) can be challenging as they can’t communicate, read and write.
- Studying effectively has never been more challenging for university students. The demands on their attention have continued to rise.
- Planning some types of events can be clunky (e.g., potlucks where there is flexibility of date, location, and numbers)
- Personal safety when walking alone on campus late at night can be a concern.
- Services like Craigslist work well for resale, but services that support a loaning economy are scarce.
- Planning a trip among friends and family who are not co-located can be a challenge.
- Collaborating over files has never been better supported with services such as Google docs, Google Drive, and Dropbox. But these services can make managing files more complex.
- People have become addicted to their phones. Well-being is being compromised.
- Children do not play outside as much as they used to, and are therefore not getting the same amount of exercise as they used to.
- Need access to parents of small children
- Too much energy is being wasted with lights being left on in homes unnecessarily.
- Easy access to digital photography and the low cost of storage has led people to lose track of what they capture.
- Services like Yelp provide crowd-sourced reviews for local business, but reliable services to find and review local musicians and bands are practically non-existent.
- With the amount of work graduate students do (courses, TAing, research), they generate a lot of files which can be hard to manage.
- The number of photos people save on their phones is huge, they are generated by several apps (Camera, WhatsApp, Snapchat) and for several purposes (personal, reminders, scans). Phones have some capability to help users manage this but they don’t really work.
- Finding a place to rent can be challenging, especially for students who are often new to a city. There are different web portals and also ads spread throughout neighbourhoods. Renters also face stress, potential scams, and may not know if the place is being advertised at a fair price.
- MOOC courses/e-learning has opened the door for all the students to have a good education. But it’s missing the most critical factor of the educational system: student-teacher real-time interaction.
- Some people go to the gym regularly and keep it as a hobby while for others, it can be challenging to make a reasonably flexible workout plan and follow it.
- Mobile phones are collecting and storing more private user data, sometimes with little awareness on the user’s part. This exposes privacy risk.
- Some adults consume a number of over-the-counter and prescription medications; a tool that can assist them in tracking the daily consumption and long-term side effects would be beneficial.
- New international students can struggle with important non-academic activities such as banking, transportation, and housing. They would benefit from some guidance.
- Some people spend a lot of time on international flights and can often get bored, fatigued, and stressed. Airport and in-flight experiences could be made more eventful and less stressful.
*Notes*
- some of these would be difficult to observe in situ
- some would involve participants who might be more difficult to access