Guide to Evaluation Reporting Options
Log in to Bronco Course Evaluations
Online Course Evaluations is a web-based system for evaluating the vast majority of courses at Boise State University. Students are asked about characteristics of the course and instructor to provide information for improvement.
Questions, comments, or concerns? Contact: firstname.lastname@example.org
This document is for anyone who has access to view evaluation results for classes taught by other instructors. This commonly includes roles of Department Chair, Dean, Program or Course Coordinator, etc.
These instructions will describe 6 different “use cases” or common needs for retrieving and using the course evaluation results of multiple classes.
- Retrieve concise, complete reports for one class at a time
- Efficiently retrieve results for a grouping of classes (e.g., for all courses by a single instructor or within a department)
- A formatted report for each selected class
- An Excel spreadsheet of quantitative (presented for each class and a summary for all classes)
- Overall mean and distribution results for an aggregated group of classes
- An instructor results summary of formatted for Annual performance or P&T Reviews
- Monitor response rates for individual classes, a department or a college
- Obtain a list of questions used for your class or area
The courses you can view are determined by your unique access restrictions. For example, if the users access is restricted to the Biology department, the user will only see “Arts & Sciences” under School, and “Biology” under Department.
If you are unable to access courses that should be available to you, please let us know at email@example.com.
Whereas the instructor usually accesses their own class results from the Home menu, administrators will use one of the Reports menu items.
- Status Tracking – used to find the real time response rates for individual classes or classes within a department or college.
- Report Browser – allows you to set various filters to list classes of interest, then view various reports of the individual classes.
- Rollup Reports – allows you to set filters that will define a set of classes whose results will be aggregated or compared.
- Instructor Analysis – displays an instructor’s results over time compared to the department’s aggregate results. WebOptics shows both an overall summary for each course as well as results for each individual evaluation form question over time.
- Instructor Summary – Provides a summary of an instructor’s evaluations across courses and within a selected time period.
Use Case #1: Retrieve concise, complete reports for one class at a time
After opening the Reports > Report Browser, there are three options for sifting through the thousands of classes to find the one or few that you need.
- Select the filters, moving from left to right, narrowing the course list to your desired classes. You may hold the Ctrl key down to select multiple items within a filter.
- OR use the Search box to begin typing any part of the class—the ID, number, department, instructor, course title, etc. It will quickly return possible rows.
- OR you may sort the results on any column as you wish.
To retrieve one or two classes, click “View” to see the possible reports for that class.
We recommend the “BSU Instructor Report” which includes all quantitative and qualitative question. The full question text is used to make it easy to read, and brief summaries of question sets are included.
Select a report, and you may save or print it.
Use Case #2: Retrieve results for a grouping of classes
- Complete results in a formatted report for each selected class
- Quantitative or All results in Excel spreadsheets (presented for each class and a summary for all classes)
After narrowing your list of classes within the Report Browser, you may select a batch of classes to output reports. Click on the boxes to select the classes you wish to include.
As you select classes, the bottom right corner will record the number of items in your batch.
After selecting the desired classes, click the ‘Create Batch File’ link.
Next your selected list appears with options to select the ‘Output Type’ and ‘Reports’.
|Output Type||Reports||Report Needs|
|Zip PDF File||BSU Instructor Report||Complete formatted results for a group of classes (qualitative and quantitative)|
|An Excel File||Quantitative or All Responses||Quantitative results in Excel for a group of classes
Produce one excel File with quantitative results or all (qualitative and quantitative) for multiple classes (one Excel worksheet per class, plus one summary worksheet)
Use Case 3: Overall mean and distribution results for an aggregated group of classes
While Report Browser specializes in separate, singular class reports, the Rollup Reports focuses on mean data for aggregated groups of classes. Rollup Reports only report on quantitative questions. However, the rollup capability greatly expands your ability to analyze trends and comparisons. Here are some examples of ways you might use Rollup Reports:
|Example Aggregation||Sample Uses|
|Rollup all class sections into a course||Course Coordinator may wish to compare how different sections performed.|
|Rollup all class sections taught by a single instructor||Department Chair could calculate an average evaluation score for each instructor.|
|Rollup all lab sections for 100 level courses in a department||Dept. Lab Manager is able to determine if there are problematic issues across all labs.|
|Compare small, medium and large sized undergraduate courses||Program Director is able to see if class size is detrimental to student satisfaction with a class.|
|Compare online vs face to face classes across a department||Program Director can check that online sections are roughly equivalent to in person sections.|
How to Create a Rollup Report
There are three main sections to set up to run a rollup report: Drill Down, Filter, and Questions & Reports.
These set the academic organizational context to view
Form—Use “Full Form” for all classes, except “Internship” classes
Term—Select one term or “All Terms”
Session—Select one term or “All Sessions” within the term
School—Select one School or “All Schools”
Department, Instructor, Subject, Number—Optional to further narrow down classes to include
These allow you to control which classes to include in the statistics by selecting certain course characteristics. You may set multiple filters; more filters will reduce the number of classes included. For example, you could set filters to include only undergraduate lecture courses taught online using ‘Level’, ‘Instruction Mode’ and ‘Type’. Or you could include only small 200 level classes with a service-learning component using ‘Class Size’, ‘Course Level’, and ‘Service Learning’.
Questions & Reports
You will need to experiment with these to familiarize yourself with the different outputs. After changing a setting, press “Create Report” to see the actual results.
Questions—Different classes, with different class characteristics, will often have different sets of questions asked. Thus, when you combine various classes you may choose to view results for only ‘Common’ questions shared by the selected classes, or to view ‘All’ question results. If you choose ‘All’ check the button.
Reports—Allows viewing one total result, or comparative results. See examples below.
- ‘Rollup’ refers to simple aggregation. For each question, the system combines all responses from all classes into one single result.
- ‘Comparison’ will calculate a result for each category, and display the compared means graphically. After choosing ‘Comparison’, you will be prompted to select which characteristic to use for comparison. For example, if Size was selected, it would present the means for Small, Medium, and Large classes.
Examples of the Rollup and Comparison report options are shown below. A summary of the filters is provided above each graph.
Rollup Report Example
One term and course was selected under ‘Drill Down’. Reports set to ‘Rollup’
Comparison Report Example
One term and course was selected under ‘Drill Down’. Reports set to ‘Comparison’. Then ‘Instruction Mode’ was selected. Means for all “In-Person” and “Internet” taught classes are displayed for two of the questions.
Use Case #4: An Instructor Results Summary Formatted for Annual Performance of P&T Reviews
The Instructor Summary report displays a summary of an instructor’s evaluations across courses within a selected time period (one semester, one year, 6 years, etc.). This report permits instructors and administrative users to view a summary of results for annual performance evaluations or other reasons. It is particularly helpful to spot trends or changes in results over time. The report can be output to Excel or PDF.
- Select Reports > Instructor Summary report.
- Select a single instructor then enter the start and end terms for the period you wish to select.
- Select which organization level to display as a comparison value. Selecting “Department” usually provides a more relevant comparison for the types of courses covered, even though there is a smaller “n” of classes included.
- It is recommended to include Total Enrollment and Response Rates, so that you can take into account results based on a very small number of responses, or a small proportional response rate.
Note that if an instructor teaches multiple sections of the same course during a semester, these will be combined into one overall number for the term.
Use Case #5: Monitor Response Rates for Individual Classes, a Department or a College
Status Tracking report allows you to see response rate graphics for a selected term institution-wide, by school, or by course.
Use the Reports > Status Tracking to open the Status Tracking page. First select the Term and Session to view. The pie chart gives you an immediate view over response overall for the session.
You can drill down to view response rates for different organizations by clicking on the particular School to view, then Department. It will then display response rates for all classes. Click on any of the table headings to sort the classes entry.
Use Case #6: Obtain a List of Questions used for Your Class or Area
You may easily obtain a copy of all the questions used for a group of classes. If you wish to make changes to those questions, please contact us at firstname.lastname@example.org
- Choose “Form Viewer” from the “Configuration” menu.
- Select the Form and the current Term.
- Select the characteristics that define the courses you wish to view–a particular school, department, , instructor, even as specific as a particular section.
- Click Update Display. The form is displayed below.