HCI 541 Survey Design and Analysis
Summary
Students design and analyze surveys with an emphasis on user experience research. Benefits and costs of using surveys are compared to other UX methods. Students identify threats to validity and factors for the appropriate use of surveys. Course activities include survey question design, pilot testing, sampling, implementation, and analysis. Students use statistical software and survey software such as Qualtrics.
Course Goals
At the end of the course, students will be able to do the following:
- Identify user research scenarios where survey methods are appropriate.
- Identify threats to validity.
- Design surveys following best practices.
- Pilot test surveys.
- Implement and administer a survey using software tools such as Qualtrics
- Perform statistical analysis and report findings.
Texts
Required Texts
Survey Research Methods, 5th Edition (2014)
by Floyd J. Fowler Publisher: Sage
Selected readings
Grading
Grade Determination
| 30% |
2 Individual Projects (15% each) |
| 20% |
2 Team Projects (10% each) |
| 10% |
Quizzes (5% each) |
| 25% |
Summary Report (Individual submission) |
| 15% |
Individual Contribution |
Assignments and projects will be generally graded with a letter grade and converted to a 10-point scale (10 for an A, 9.5 for A/A-, 9 for an A-, 8.5 for a B, 8 for a B-, etc). Students receiving more than 95% of possible points are guaranteed at least an A, more than 90% at least an A-, more than 80% at least a B-, more than 70% at least a C-, and more than 60% at least a D.
The summary report is an individual submission due during finals week. It includes original insights, reflections or experiences for each of the phases in the user-centered design process. It takes the place of a final exam.
The score for individual contribution to class and team projects is based on contributions to class activities, documented contributions in team reports, observed team activities (in class, email or group message boards) and team member reports at the end of the quarter. Students who make solid contributions to their team projects and regularly participate in class (i.e. weekly contribution) receive at least an A- (9 points) of the contribution points. Weekly contribution includes in-person attendance, zoom attendance or online posts. Exceptional contributions may receive an A or an A+ (11 points). Supplemental contribution points can be earned by participating in the CDM subject pool (1 additional point for each whole credit of participation, up to 2 additional points).
Team presentations occur in the last week of class. All students should contribute to the presentation, although all members do not need to be physically present for the presentation. At the end of the quarter every student is expected to submit a completed evaluation form for each group member.
Team projects will generally be completed in groups of three, four or five. To form groups, students review student-submitted proposals and submit preferences to work on them. Groups will then be formed based on the preferences.
For team projects, all team members are expected to contribute to the project's activities and summary report. Generally, each group member will receive the same score on each project. However, in some cases, additional credit may go to those who make an exceptional contribution to a project and reduced credit to those who contribute little to a project. Any adjustment will be based on a variety of indications including group participation in class, contribution summaries in reports, and student feedback at the end of the quarter.
Policies
Students are expected to attend every class or watch the asynchronous recording.
Late assignments will be accepted up to 3 days late, with a 1 point penalty. Assignments submitted more than 3 days after the due date will not be accepted without an excused absence cleared by the dean of students office.
Additional assignments for extra credit will not be offered.
All grade challenges must be submitted in writing and include an explanation why the given score or grade should be reconsidered.
Prerequisites
IT 403 or comparable statistics course
Tentative Schedule
| Week |
Topic |
Reading |
Assignment |
| Mar 29 |
Course Overview; Survey properties |
Fowler ch. 1 |
|
| Apr 5 |
Survey development process |
Reading on cognitive interviews |
Assignment 1 |
| Apr 12 |
Threats to validity |
Fowler ch. 2 |
|
| Apr 19 |
Sampling; non-response bias |
Fowler ch. 3 and 4 |
Assignment 2 |
| Apr 26 |
Method and question design |
Fowler ch. 5 and 6 |
Quiz 1 |
| May 3 |
Survey evaluation |
Fowler ch. 7 |
Team Project 1 |
| May 10 |
Survey implementation and administration |
Fowler ch. 8 |
|
| May 17 |
Survey analysis |
Fowler 9 and 10 |
Team Project 2 |
| May 24 |
Variatns to survey methods |
TBD |
Quiz 2 |
| May 31 |
Project presentations, review |
Course notes and presentations |
Informal presentations |
| Jun 7 |
|
|
Final Report |
This syllabus is subject to change as necessary during the quarter. If a change occurs, it will be thoroughly addressed during class, posted under Announcements in D2L and sent via email.
Evaluations are a way for students to provide valuable feedback regarding their instructor and the course. Detailed feedback will enable the instructor to continuously tailor teaching methods and course
content to meet the learning goals of the course and the academic needs of the students. They are a requirement of the course and are key to continue to provide you with the highest quality of teaching. The
evaluations are anonymous; the instructor and administration do not track who entered what responses. A program is used to check if the student completed the evaluations, but the evaluation is completely
separate from the student’s identity. Since 100% participation is our goal, students are sent periodic reminders over three weeks. Students do not receive reminders once they complete the evaluation.
Students complete the evaluation online in CampusConnect.
This course will be subject to the university's academic integrity policy. More information can be found at http://academicintegrity.depaul.edu/ If you
have any questions be sure to consult with your professor.
All students are expected to abide by the University's Academic Integrity Policy which prohibits cheating and other misconduct in student coursework. Publicly sharing or posting online any prior or current materials from this course (including exam questions or answers), is considered to be providing unauthorized assistance prohibited by the policy. Both students who share/post and students who access or use such materials are considered to be cheating under the Policy and will be subject to sanctions for violations of Academic Integrity.
All students are required to manage their class schedules each term in accordance with the deadlines for enrolling and withdrawing as indicated in the University Academic Calendar. Information on enrollment, withdrawal, grading and incompletes can be found at http://www.cdm.depaul.edu/Current%20Students/Pages/PoliciesandProcedures.aspx.
Students who feel they may need an accommodation based on the impact of a disability should contact the instructor privately to discuss their specific needs. All discussions will remain confidential.
To ensure that you receive the most appropriate accommodation based on your needs, contact the instructor as early as possible in the quarter (preferably within the first week of class), and make sure that
you have contacted the Center for Students with Disabilities (CSD) at:
Lewis Center 1420, 25 East Jackson Blvd.
Phone number: (312)362-8002
Fax: (312)362-6544
TTY: (773)325.7296