萝莉社

What is CES? CES is a course evaluation platform from Watermark. The evaluation portion of the platform is called "Course Evaluations and Surveys" and we shorten that to CES on our campus.

What are the benefits of CES? There are many benefits to using a modern course evaluation tool, including:

• Evaluations can be integrated into Blackboard.
• CES is easy for faculty and students to use.
• Results can be accessed online. Paper results are no longer necessary.
• Previous semesters' CES results can be accessed in the platform.
• Instructors will have access to training and a dedicated CES website.
• Response rates are likely to increase from those received with the electronic versions of the SPTEs.

Will in-person course evaluations still be offered?  No. All CES course evaluations will be handled electronically.

Is CES mobile friendly? Yes. The instrument can be used with cell phones, tablets, laptops, and desktop computers.

Why use Blackboard for course evaluations?  CES utilizes Blackboard to centralize all facets of the course evaluation process including communications to alert faculty and students to take action on evaluations, dashboards for both faculty and students to monitor activity, providing reports to faculty on completed evaluations and to administer the evaluations.  Having the CES components embedded within a central location where most instruction activity is being done is key to maintaining communications and performance.

What Blackboard Roles should be used for CES to run properly?

• The Instructor Role should only be used for those who directly teach the course.  The CES Evaluation will refer to these individuals as instructors of the course.
• If others need access to a Blackboard course, then other roles that can be used would be Course Builder or TA.
• If you use 鈥渢est student鈥� in a student role, when done testing please remove so CES won鈥檛 count this as a student.
• Any Blackboard Role questions can be directed to OIR.

Is there any change to Blackboard if a student does not click on the course evaluation link? Yes. On the last day of the administration period, the pop-up notifying students regarding course evaluations will no longer have the "Do It Later" button.  The pop-up will not go away until the student clicks on the survey button to go to the course evaluation.

Why did 萝莉社 switch from SPTEs to CES? SPTEs are programmed with FORTRAN and cannot be updated. CES allows us to adjust to new questions, offer new report layouts, and it is also compatible with Blackboard, 萝莉社's Learning Management System.

What are the notable changes between SPTEs and CES?

• The CES platform requires instructors to delete courses they do not want evaluated.  With SPTEs, evaluation was "opt-in" and with CES, evaluation is "opt-out."
• Evaluation requests will need to adhere to the specified deadlines. Late requests cannot be accepted.
• CES results will only be available at the end of the complete semester. This keeps 萝莉社 in compliance with KBOR policy regarding the use of a norm-based instrument.
• Prior SPTE results will not be integrated or accessible in the new platform.

Can SPTEs still be administered in the Fall 2024 semester? No. SPTEs fully retired after the Summer 2023 semester.

What is Manage Courses?  This is the beginning part of the course evaluation process.  When the Manage Courses portion becomes available, instructors will see what courses are available for course evaluations.  The instructor has the option to delete any courses they do not want evaluated.  The Manage Courses process may be available multiple times during the semester depending on what part-of-term the course falls under.

Why doesn't the Manage Courses Box appear on the Instructor Dashboard? It will only appear when the "Manage Courses" option is available according to your course(s) part-of-term.

How long is Manage Courses open for instructors?Instructors have 10 days from notification of the 鈥淢anage Courses Email鈥� to opt-out of CES.

If I do not want course evaluations this semester, do I still need to complete the course selection process? Yes. You will need to go to the Instructor Dashboard and delete all your courses listed there. Once a course is deleted, the students enrolled in that course will not be prompted to submit an evaluation. If instructors choose not to delete courses from their Instructor Dashboard, the system will automatically send evaluations to all enrolled students.

If I want course evaluations, do I need to pay attention to the Manage Courses email?  It is suggested that you do log in to the CES Instructor Dashboard to make sure the courses you expect to be there do appear.

What is the CES Main Evaluation? It is a core set of questions that will be sent to all courses that do not opt-out of CES.

How can I find the Main Course Evaluation Questions that are sent to students? While you are in "Manage Courses," you can click on the semester's project, and then click on "Preview" to view the questions.

What are the questions on the CES?

Below are the 萝莉社 Main Course Evaluation questions sent to students.  They are a core set of questions that will be sent to all courses that do not opt-out of CES.  You can also locate the questions while you are in Manage Courses on the CES Instructor Dashboard.  You can click on the semester's project, and then click on "Preview" to view the questions.

The scale for these questions is Strongly Disagree, Disagree, Undecided, Agree, Strongly Agree.

Please respond to the following statements about the course.
1.  Course materials prepared me for graded assignments.
2.  Organized in a way that helped me learn.

Please respond to the following statements about [Instructor Name].
1.  Conducted the course in a well-planned manner.
2.  Provided useful feedback on my coursework.
3.  Supported my efforts to succeed.

Open-ended Questions.
1.  In what way(s) did [Instructor Name] support or not support your efforts?
2.  Is there anything else you would like to share about the course?

Can I add questions to CES?  In the future development of CES, instructors will be able to add questions to their course evaluation.  The launch date of this option is still to be determined.

Are there demographic type questions on the evaluation?  No.  The CES does not ask demographic questions nor collect any demographic information.

Where do I find CES? You can access CES anytime in Blackboard by choosing "Tools" from the main menu and then choosing "CES." It is found on the Institution Page not on a course page which also has a tools option.

How will I be informed about CES as it relates to my classes? Direct CES information will be sent via emails through the platform from 萝莉社 Evaluations. Additional communication will be posted in , on the , or through emails from the SSRL staff. 

Is CES training/help available through 萝莉社? Yes. Instructors can access CES training on the website or by contacting Sandy.

How will I know about CES timelines and procedures? You will receive information directly from the CES platform at regular times throughout the term. Additional information will be posted in , the , and other emails. 

How long are course evaluations open to students?  CES will be open for students for varying lengths, depending upon the length of the course term:

• 1 to 4 week courses: 2 days
• 5 to 16 week courses: 10 days
• 24 week Accelerated Nursing courses: 10 days
• Summer 1 to 2 week courses: 2 days
• Summer 4 to 11 week courses: 7 days

Are there set dates and times for CES use? Yes. The CES Administrator programs assigned dates for each of the processes in CES. These dates will follow that pre-determined schedule, and they cannot be modified for individual instructors. The CES course evaluations will be sent to students at 12:00 am on the scheduled start date, and it will end at 11:59 pm on the scheduled end date.

How do I use the CES Instructor Dashboard? You access the CES instructor dashboard through Blackboard, or alternatively, you can access the CES instructor dashboard directly from the links provided in the emails you receive. 

How do I know which of my courses will be evaluated? Most, but not all, courses will be evaluated using CES unless the instructor opts out of the process. Instructors will opt out by going to the CES platform through the Instructor's Dashboard. From there, instructors have the ability to delete courses that they do not want to have evaluated. It is possible that not all courses will appear at the same time in Manage Courses. 

What courses are not eligible for the CES Main Evaluation? Courses that are appointment-based (eg: Directed Readings, etc.), research (eg: thesis hours), COOP, Intensive English, Badge, MBHL, EMBA, and weekend-only courses are not available for the CES Main Evaluation and will not appear in the Instructor Dashboard.

If my courses are merged in Blackboard, how will CES manage the course evaluation?  The CES option for parent/child (merged) courses is for data collection.  Any data collected on the child course would be recorded under the parent.  Therefore, the results will be combined.  When your courses are displayed, it should only show your parent course.  It will include the students from the child course.

Will my TA with indirect teaching be evaluated using this tool? No. CES will only be set up to evaluate instructors with direct teaching roles.

How are team taught courses handled when one instructor wants to use CES and the other wants to opt-out? If the course is team taught, the CES course evaluation will be sent to students with all instructors listed.  During the Manage Courses phase, all instructors for the course will need to communicate with each other regarding how they want to handle the course evaluation.  This is important because if one instructor opts out of CES then the course is deleted from the system and no evaluation will be sent to the students.  If only one of the instructors wants to be evaluated, you can change the role of the other instructors in Blackboard to Course Builder or another role. This ensures that the instructor still in the instructor role will be the only one evaluated.  If roles cannot be changed in Blackboard then information will need to be relayed to the students that they are only to select 鈥淚nstructor (name)鈥� when completing the course evaluation.

I am an instructor and a student.  How will CES work for me?  You will receive emails as both an instructor and as a student.  Each email will provide instructions relating to your specific role in the course.  Please note that if you do not complete an evaluation as a 鈥渟tudent鈥� before the end date, it will affect you logging into Blackboard as an instructor.

Can I, or a student, share the CES links we receive?  No.  Whenever someone receives a link from CES, the link only pertains to them.  Do not share the links.

What will students see when they log in to the CES system to complete an evaluation? Students will see a table that displays the completion status of an evaluation, including the date and time.  The table will also show what evaluations are available to complete.  In addition, students will see regular pop-up notifications in Blackboard during the CES evaluation time window. However, on the last day of the administration period, the pop-up will not go away until the student clicks on the survey button to go to the course evaluation.

How do my students access the evaluation? Students can access the evaluation through Blackboard and through links provided in an email sent during the CES administration window.

If a student submits an evaluation, can they retrieve it later? No. Evaluations cannot be retrieved or edited after submission.

If I give extra credit for completion of the CES and a student forgets to provide proof, can the CES Administrator provide that proof? No.

Why doesn't the Response Rate Tracker on my CES Instructor Dashboard show data? Once the semester's course evaluation project has started, the Response Rate Tracker will appear on your instructor dashboard. Data will be updated for each instructor according to when their course evaluation is open to students.

Why does the Response Rate Tracker state, "No Project Found"? If you do not have a course in the current semester's project, it will show this statement.

How do I increase my response rate?  The email titled 鈥淐ourse Evaluations Will Soon Be Available,鈥� includes helpful hints.  Here are some ideas.

• Designate time in class.
• Consider including language in your syllabus that addresses student evaluations.
• Let students know that you value their honest and constructive feedback, and that you use their feedback to make improvements to your courses.
• Remind students that evaluations are completely anonymous, and instructors do not see this feedback until after final grades have been submitted.
• When emails are sent alerting you to dates, inform students of these evaluation dates and state it is better to do it sooner rather than later.

How can I track my Response Rate?  Instructors may use the Response Rate Tracker in CES to track this information.  In addition, instructors will receive an email at the mid-point of the evaluation that will include a response rate count.

When will my CES results be available to me? Results will only be available at the end of the completed semester, no matter the part-of-term your course used. Holding results until the end of the semester complies with KBOR policy and allows for accurate norming. Results will become available the Friday after grades are due. Results can be accessed through the Instructor Dashboard under Project Results.

Will my CES results be in paper form, or sent to me electronically? The results will no longer be available in paper form. The only way to access CES results will be through the Instructor Dashboard. This is an example of a sample report with comments.

Are there restrictions on results? Yes. There will be no results when the response rate is 0%, or if the number of respondents is lower than 4.

Will comments be provided for courses that have a response rate below the threshold?  No.  Watermark Course Evaluations and Surveys software does not provide this option.

I had a 100% Response Rate.  Why did I not receive results?  The university policy states that no results will be provided for any course with less than 4 responses no matter the percentage.

Will it be stated somewhere that I did not have results for a particular semester?  Yes.  It will state it in the Project Results Box when you check the current semester鈥檚 results.  It will include a "No Courses Found" statement under Project Results. If you want to check on previous semesters, you will need to start in the Instructor Dashboard in CES.  Click on the Results Tab on the CES Menu Bar.  Select Project Results. A table will appear that will show the semester evaluations that you participated in.  Locate the one you need.  Click on the View icon.  It will let you know if you do or do not have results.

Will there be any benchmarks noted on the results? Yes. Results will include the mean, standard deviation, and median by university and by division. This benchmark data will be from the same semester as the evaluation and not include any other data.

Will I have access to the raw data? Yes. The raw data will be accessible from the results area in CES.

Will I have access to prior semester CES results? Yes. The semesters in which you participated in CES will show the semester鈥檚 project name under Project Results.  You can click on the link to retrieve those results.  If a semester is missing from the Project Results, either you did not participate that semester or there were no course results due to the result restrictions.

How is norming handled in CES? CES provides normed data that reflects the university and the college division for the semester represented in the report. Norms reset each semester.  While there are a multitude of norming techniques, the most common are hierarchical standardized composites and known-group-associations, both of which are in agreement with KBOR standards.  CES uses the latter in norming individual instructor scores against university and university college divisions.

Who will have access to my results? Only you have access to your results. If you need to share your results, you will need to send them to the appropriate individuals.

When will CES be used for annual FAR, T&P, and post-tenure review?  CES will be officially used in the Fall of 2023, and this use will fulfill requirements set by KBOR policies and university review policies.

Which of the reports am I supposed to submit for my T&P packet?  Best practice is to check with your department on their policy.  The Faculty Evaluation Alignment Committee suggests using the "Detailed Report With Comments."

Are there validity items (items added to measure attention) on the CES?  No.

Will I be able to see results from an individual student?  No. Evaluation results are anonymized in the platform. Even though you can see who has and hasn't submitted an evaluation, you can never track the results back to an individual student.

Do CES reports indicate how long students took to complete the survey? No.

How can I share my thoughts about the CES with the university? This CES comment form can be used to share anonymous comments or to ask questions that you want to have answered via email.

Who do I talk to if I have a question about CES?

• CES Process: David Wright or Sandra Ranney
• CES Policies: Faculty Senate Teaching Evaluation Task Force
• Blackboard: Office of Instructional Resources