Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
Loading...
For tutorial on how to navigate back to Course View, please take a look at Navigating the Dashboard.
The video view provide management insights, assessment and preferences for a specific video.
Below the video title, there are further details about the video duration, description and a link to the page:
In the Video Hub, the discussion of the video can be fully managed via the dashboard, all the common actions are supported:
Reply
Edit/Delete own comments
“Like” a comment - each learner's comment that you’ll like, will get “Educator’s Thumbs Up” badge (which can be used for grading).
Moderate - delete users' comments (in case needed)
At the top of the Discussion a quick summary of the remaining comments to review can be found:
Once the review is done:
Not-reviewed comments (the ones you haven’t read yet) will be highlighted in color:
You can decide how you want to review the comments.
Comments can be:
Manually reviewed - You can mark comments as read\ not-read, by clicking on the eye icon:
You can also mark all comments as read with a single click:
Automatically reviewed – Comments will be automatically marked as read after a few seconds:
Video comments can be exported, by clicking on the export icon in the discussion.
The export contains course and video information. All the comments are sorted by video time-tag and include common details such as author, date and sentiment.
This section provides you with highlights of participation content consumption and engagement for a specific video.
On the left we can see a radial bar representing how many of the users are participating in the video
Hovering the cursor over the bars provides details on the participation category - the percentage of the users who acted (Engaged\ Collaborated\ Noted, depends on the bar that is hovered).
For more details on the participation categories please refer to Course Insights.
In the above example: 93% of the learners collaborated and engaged in the video. 71% of the users added personal notes.
This means that most of the users took an active role in learning - by commenting in the shared environment, writing in their personal notes and engaging with others UGC.
The graph on the right provide insights about video consumption.
The triangle represents the top metrics of video consumption:
Avg. Completion Rate – Sum of percent watched in each view session divided by number of views. This metric provides user's dropout rate for each video.
Avg. Total Completion – The average of the aggregated video completion for all view sessions that the video participants had (video coverage).
Avg. Watch Time(%) - The average of the aggregated number of seconds each user has watched in all view sessions. The metric is shown in percentage for convenience.
A "perfect" watching experience would be indicated by an equilateral triangle (all edges should be the same, and as close to 100% as possible).
If one of the edges is significantly longer - you may want to pay attention to the video.
For example - In the Video Consumption image above:
The Avg. Watch Time is 167%, meaning: on average, viewers spent watching the video more than x1.5 than its duration.
The Avg. Completion Rate is 27%, meaning: on average, every time the video viewers played the video, they watched 27% of it (less than third of the video), which may indicate quick dropout.
The Avg. Total Completion is 43%, meaning: on average, all video viewers covered only 43% of the video not watching all of its content.
In addition, we can find the aggregated activity metrics made by all video participants:
Views – Number of times videos were viewed in this course. For more details, please refer to How Views are counted.
Engagement – Rating for user generated content creation and consumption for the course. For more details please refer to How engagement is measured.
Collaboration - Number of comments and replies in the course (by all course users).
Interactions - Number of Interactions in the course (for all course videos).
Interactions - Number of interactions such as quizzes (for all course users).
Notes - Number of personal notes in the course (by all course users).
The Users Activity table provides analytics of each user's activity in the video:
The table can be filtered by each column to quickly find the most active users in the video by the selected activity type. For example the most engaged users, or users that are sharing their knowledge by adding the most replies, or users with the highest\lowest Average Completion Rate, etc.
Extremely low activity of a user may indication for "at risk learner".
Last Activity - Date when the user was last active in the video.
Total Completion – Aggregated video completion for all view sessions the user had (video coverage).
Avg. Completion Rate – Sum of percent watched in each view session divided by number of views. This metric provides user's dropout rate for each video.
Watch Time(%) - Aggregated number of seconds the user has watched in all view sessions. The metric is shown in percentage for convenience.
Views - Number of times the user viewed the video.
Engagement - User's score for UGC creation and consumption in this video. For more details please refer to How engagement is measured.
Collaboration - Number of comments and replies the user added in the video.
Replies - Number of replies the user submitted.
Notes - Number of personal notes.
In the above example table we can see that Gili viewed the entire video (Total Completion 100%). However, each time she played it, she watched only a little - on average, she watched 31% of the video every time she played it (Average Completion Rate).
Note that the total amount of time she spent watching the video (Watch Time%) is 573%, meaning she watched it more than once, repeating on some pars.
Recommended further reading: How to use tables sorting for better insights?
To learn more about Total Completion, Avg. Completion Rate and Watch time, we highly recommend reading our Frequently Asked Questions.
The Activity Trends graph shows trends of key metrics over a period of time in the video. It allows to investigate how the users learn over time and identify important events throughout the video life cycle.
The key metrics of the trends are: Engagement (blue), Collaboration (green), Notes(orange) and Views(red).
Recommended further reading: Using the Activity Trends to Learn about Users Progress.
Might also interest you: How to use Activity Trends graph To
The Assessment tab provides details on the graded interactions activities such as quizzes.
Grades Overview of the activity:
The highest grade that was achieved in the video
The mean grade of all participants
The lowest grade that was achieved in the video
User Completion graph shows how many of the participants completed the activity:
Below the overview, you will find the quizzes results of all the users that participated in the activity:
Clicking on a user dives into the activity of that specific user, including the user's final grade, the number of completed interactions and the number of correct attempts.
At the bottom part you can also see the user's answers to each interaction.
Video preferences allows you to override the course defaults and set preferences specific to the video.
To learn more about preferences please refer to the Preferences section.
Annoto's Assessment Criteria Library is a robust feature designed to enhance the educational experience by providing a structured and consistent way to evaluate video-based content.
Here's a concise overview of its key components and benefits:
Key Components:
Pre-Defined Criteria: The library offers a set of pre-defined assessment criteria, making it easy for educators to apply standardized evaluations across different courses and videos.
Customizable Options: Users can tailor the criteria to suit specific course needs, ensuring assessments are relevant and targeted.
Reusable for All Courses: Criteria can be saved and reused across multiple courses, saving time and effort in the assessment setup process.
User-Friendly Interface: Designed with ease of use in mind, the interface allows educators to quickly set up and modify criteria, ensuring a hassle-free experience.
Enable you to quickly apply the criteria you created within the Assessment Criteria Library at the course level or on specific videos.
Learn more about how to use the Assessment Criteria in your course activities
These analytics can provide insights that can be used for grading, for identifying at-risk learners and for getting a general idea of what is the progress of each of the learners in the course.
Accessing the User View is done when clicking on a user's row in the Users Activity table in the Course view. The user view dives into the user and presents their activity throughout the course.
The overview section presents aggregated analytics regarding the activity of this user in all course videos.
The Overview includes a completion funnel as well as the user's videos consumption in the course.
The completion funnel sheds light on the user's total activity in the course
Watched Time - total number of seconds the user has watched in the course (for all course videos).
Total Videos - Number of videos in the course.
Watched Videos - Number of videos viewed by the user.
The video metrics (on the right of the Course Video Completion Funnel), provide insights on the user's video consumption habits.
Average Completion Rate -Sum of percent watched in each view session divided by number of views. This metrics helps answer the question of how well the user performs in terms of dropout.
Average Total Completion - Average Total Completion of all the watched videos. Total Completion is aggregated video completion for all view sessions (video coverage).
Average Watch Time - Average Watch Time of all the videos. Watch Time is aggregated number of seconds watched in all view sessions.
A "perfect" watching experience would be indicated by an equilateral triangle (all edges should be the same, and as close to 100% as possible).
If one of the edges is significantly longer - you may want to pay attention to the user.
For example - In the Video Consumption image above:
The Avg. Watch Time is 248%, meaning: on average, the learner watched the videos in the course more than x2 of their duration.
The Avg. Completion Rate is 2%, meaning: on average, every time the user played a video, this user watched only 2% of it (the user watched only a bit of the video every time they played it).
The Avg. Total Completion is 79%, meaning: on average, the user covered 79% of each video in the course.
In addition, we can find the aggregated activity metrics made by the user in the course:
Views – Number of times videos were viewed in this course by the user. For more details, please refer to How Views are counted.
Engagement – Rating for user generated content creation and consumption for the course. For more details please refer to How engagement is measured.
Collaboration - Number of comments and replies the user has submitted in all course videos.
Notes - Number of personal notes the user has submitted in all course videos.
The Activity in Course Videos table provides analytics about the user's activity in each video within the course.
The table can be sorted by each column to quickly find videos the user is most active on in the course by the selected category. For example: video the user is most engaged in, or video for which the user has the highest or the lowest Average completion rate, etc.
Last Activity - Date when the user was last active in the video.
Avg. Completion Rate – Sum of percent watched in each view session divided by number of views. This metric provides user's dropout rate for each video.
Total Completion – Aggregated video completion for all view sessions the user had (video coverage).
Collaboration - Number of comments and replies the user added in the video.
Replies - Number of times the user replied to a comment in the video.
Notes - Number of personal notes.
Thumbs Up Badges - Number of likes on comments the user received from Educators.
Duration - Video duration.
UGC stands for User Generated Content and includes:
Comments
Replies
Personal Notes
Engagement is measured as a score for creation and interactions users have with . Example of actions that contribute to the score: comment, reply, write a personal note, read reply, click on time-tag, like, etc.
Actions such as video play/pause are not counted as engagement.
View is counted as first play of the video in a session. If user plays/pauses the video number of times while watching, it is still counted as single view.
Total Completion is aggregated video completion for all view sessions a user had, it provides a metric for video coverage. This metric answers the question of how much of the the video a user has finished watching over time.
Average Completion Rate is sum of percent watched in each view session divided by number of views. A metric for determining how well the video performs in terms of dropout. This metric answers the question of how much of the video the users watch each time they view it.
Watch Time is aggregated number of seconds a user watched the video in all view sessions over time. Usually this metric is shown in percentage for convenience to be comparable to the completion metrics and to be comparable between the different videos.
Average Completion Rate side by side with Total Completion and Watch Time, provide comprehensive view on how users consume the video content, do they finish watching most of the videos at each play, do they watch it in many short sessions, do they watch same video segments multiple times, etc.
By Clicking on a column's title in any of the tables will sort it top to bottom.
Click on key metric (legend at the bottom of the graph) will toggle it (show/hide), adjusting the scales of the other metrics:
The toolbar at the top right of the graph allows:
The metric is shown in percentage for convenience to be comparable to the completion metrics and to be comparable between the videos in the table.
The list of courses to import data from is individual per user, and it contains courses that the user has previously visited.
Only courses that were visited by the user since this release (April 20th, 2023) are shown. If a user only visited the course prior to the release, they will not be in the list.
The solution is simple: all you need to do us visit the Annoto dashboard of the course that the data need to be imported from and then get back to the target course.
If you use Microsoft Excel to open the CSV files, everything works fine when the file contains just English characters. However, you may run into an issue when your CSV file also contains non-English characters (such as é, ç, ü, etc):
Microsoft Excel is unable to properly display UTF-8 compliant CSV files when they contain non-English characters.
To resolve this issue, one of the following approaches can be used:
On a Windows machine:
Method 1:
Open the CSV file using Notepad.
Click "File > Save As".
In the dialog window that appears - select "ANSI" from the "Encoding" field. Then click "Save".
That's all! Open this new CSV file using Excel.
Method 2:
Open Excel and click "File > New".
Click "Data" tab.
Then click "From Text" option and select the CSV file.
Excel will display "Text Import Wizard".
In step-1 of this wizard:
Select "Delimited".
In "File origin" field - select "UTF-8".
In step-2 of this wizard:
Select "Comma" checkbox (important).
Click the "Finish" button.
Excel will display your CSV file - including non-English characters - properly.
Method 3:
Open Excel and click "File > New".
Click "Data" tab.
Then click "From Text/CSV" option and select the CSV file.
In "File origin" field - select "UTF-8".
In "Delimiter", select "Comma".
Click "Load".
You will see the file with the correct characters.
On a Mac:
Method 2 can be used, or alternatively Use the "Numbers" application instead of Excel.
Welcome to the Annoto Dashboard!
The Annoto Dashboard provides full management and analytics capabilities in order to shed light on learners' video consumption and behavior within Annoto in-video collaboration widget, providing you with analytics and insights on their activity in the course.
The dashboard provides a number of views allowing to get a quick glance on the course activities and gradually dive into details up to insights on single user activity on a specific video.
The main views are:
Course View - contains course management hub, insights and preferences.
Video View - allows to manage the discussion, provides detailed insights, evaluate the assessment results and customize preferences for the specific video.
User View - provides detailed insights on specific user activities within the course.
Most of the main views contains the following tabs:
Look for and for icons in the dashboard to get quick information and links to the relevant details docs.
The Navigation Bar (at the top of the page) is bread-crumbs-style navigation system that indicates the view you are in and allows quick navigation.
To navigate into more specific view, simply click on one of the rows in the hub or on a row in any of the tables in the insights tab.
For example:
At the bottom of each table, you can find the controls bar:
On each Insights tab of the dashboard the date range controls allows to set the preferred period for the analytics.
The time period can be set by clicking on the date range. This will open a calendar in which you can choose your preferred dates (choose "from", "to" and click "apply") :
You can subscribe to be notified on new comments posted in your course directly from the dashboard.
Once you see "Following", you are subscribed and will receive email notifications for every new comment (or a reply) that was added in any of your course videos.
Your course Hub gathers all course content and allows you not only an overview of the course, but also the ability to see the activity in each video and manage it.
The controls at the top of the Hub card allows you to quickly search for videos by title, sort and perform common operations:
Videos can be sorted by:
Number of unread comments (number of comments not reviewed by you)
Last activity
Collaboration (number of comments)
Interactions (number of quiz questions)
A-Z (alphabetical order)
Each video item in the Hub includes:
Video title + Thumbnail
Number of Interactions (If there were any):
Number of comments (in grey) and unread comments (in red):
Date of Last activity in the video
An instructor has the ability to import data from one course to the other:
Course Preferences
All course comments that were written by the instructor
Course published Interactions
This was created in order to save instructors from doing the same work over and over.
That means that if you are teaching the same course in another semester – you can use the comments and Interactions you already used built-in time-tag, no need to write them again
Exporting & importing comments will be only of the instructor’s root comments.
Learners’ comments will not be imported – keeping a private discussion per course.
Replies will not be imported - as they are a part of the original course's discussion.
Comments from other instructors in the course will not be imported - to keep the privacy of each instructor.
Go to the course Hub:
Click on the 3-dots menu on the right side (Next to "Unrest Comments"):
Choose “Import data from another course”:
Choose the course you want to import from (you can search by title):
Choose what you want to import (by toggling) – Preferences/ Comments/ Interactions and click on the green Import button:
This is it! Everything you chose will be imported.
You can mark all the comments as READ, by choosing Review all Course comments:
Course Insights consist of 4 tabs, each sheds light on a different perspective of the activity:
Overview
Videos
Users Activity
Activity Trends
This tab provides you with highlights of participation and engagement in the course.
On the left we can see a radial bar representing how many of the users are participating in the course.
Hovering the mouse over the bars provides details on the participation category:
Active Users: Number of active participants in the course
Collaborated Users - Percentage of users that wrote at least one comment or a reply.
Noted Users - Percentage of users that wrote at least one personal note.
In the above example: 53% of the learners collaborated in the course. This indicates active learning!
The engagement in this example course is higher than collaboration. This means that the discussion created by 53% drove many more users to be engaged in the course and had meaningful interactions.
On the right side we can see general information about the course:
Active Videos – Number of active videos in this course.
Avg. Completion Rate – Sum of percent watched in each view session divided by number of views (for all the course users that watched all course videos). How well the the course videos perform in terms of dropout.
In addition, we can find the aggregated activity metrics made by all course participants.
Views – Number of times videos were viewed in this course. For more details, please refer to How Views are counted.
Engagement – Rating for user generated content creation and consumption for the course. For more details please refer to How engagement is measured.
Collaboration - Number of comments and replies in the course (for all course videos).
Interactions - Number of interactions (quiz questions) in the course (for all course videos).
Notes - Number of personal notes in the course (by all the course users).
The Courses Videos table provides analytics for each video within the course:
The table can be sorted by each column to quickly find top performing videos in the course by the selected category. For example the most engaging videos, or videos with highest Average completion rate, etc.
Last Activity - Date when the users were last active on the video.
First Activity - Date the video was added to this course (that we know of).
Users - Number of users that viewed the video.
Avg. Completion Rate – Sum of percent watched in each view session divided by number of views (for all the course users that watched the video). How well the video performs in terms of dropout (how much of the video the users watch each time they view it).
Avg. Total Completion – Average Total Completion of all users that watched the video. Total Completion of single user is aggregated video completion for all view sessions a user had (video coverage).
Avg. Watch Time(%) - Average Watch Time of all course users. Watch Time of single user is aggregated number of seconds watched in all view sessions. The metric is shown in percentage for convenience to be comparable to the completion metrics and to be comparable between the videos in the table (hovering the percentage shows the formatted time in seconds).
Collaboration - Number of comments and replies.
Interactions - Number of interactions.
Notes - Number of personal notes.
Duration - Video duration
The Course Users Activity table presents the activity of each user in the course.
The table can be filtered by each column to quickly find The most active users in the course by the selected activity type. For example the engaged users, or users that are sharing their knowledge by adding the most replies.
Last Activity - Date of the user's last activity in the course.
Avg. Total Completion – Average Total Completion of all the watched videos. Total Completion is aggregated video completion for all view sessions (video coverage).
Avg. Completion Rate – Sum of percent the user watched in each view session divided by number of views (for all the videos in the course). How well the user performs in terms of dropout (how much of the video the user watch each time he viewed it).
Avg. Watch Time(%) - Average Watch Time of all the videos. Watch Time is aggregated number of seconds watched in all view sessions.
Watched Videos - Number of videos out of the total course videos the user has viewed.
Collaboration - Number of comments and replies the user wrote in the course.
Replies - Number of replies the user submitted.
Notes - Number of personal notes added by the user.
ThumbsUp Badges - Number of likes on comments received from Educators.
If a user is not on the list, it means the user did not have the sorted type of activity.
The Activity Trends graph shows trends of key metrics over a period of time. It allows to investigate how the users learn over time and identify important events throughout the course life cycle.
The key metrics of the trends are: Engagement (blue), Collaboration (green), Notes(orange) and Views(red).
Course analytics data can be exported, and downloaded in CSV format
The export button is available at the top bar of the Course Insights.
Clicking on "Click to Export the Analytics Data in csv format" downloads a zip folder that contains the following CSV’s:
Overview – the highlights of the course.
Users – Course Users activity (with additional fields such as: user email, votes, last login date).
Videos – Course Videos.
The data in CSV files is formatted and optimized for custom analysis using software such as Microsoft Excel.
Use the Features cards and User Experience tab to choose the default preferences for all the course videos. You can manually set your preferred features or simply use one of the presets.
Not-reviewed comments might be at the last page, therefore if you are not using the sorting ability, it’s important to browse all the comments pages using the navigation bar at the bottom of the discussion:
Comments can be exported to a spreadsheet or a document!
Views - Number of times the user viewed videos in this course. For more details please refer to .
Total Completion - sum of of Watched Videos divided by number of videos in the course (how much of the course videos the user has finished watching).
Recommended further reading:
Views - Number of times the user .
Watch Time(%) - Aggregated number of seconds the user has watched in all view sessions. The metric is shown in percentage .
Engagement - User's score for creation and consumption in this video. For more details please refer to .
To learn more about completion metrics we highly recommend reading:
Recommended further reading:
Recommended further reading: .
Might also interest you:
Recommended further reading: .
- Zoom in on a specific part of the graph.
- move the graph while zoomed in.
- Zoom out to the original view.
- Drop down menu that allows to download the graph in different formats (csv, svg, png).
In the dashboard look for icons near tables, graphs or highlight cards. Hovering them will show a quick informative tooltip.
Hovering the mouse over the percentage shows the formatted time in seconds:
On the , click the Video page link: in the .
The toolbar at the top right of the graph has a drop down menu that allows to download the graph in different formats:
For tutorial on how to export all the course data, please refer to .
The exported CSV files are compliant with the standard. We do this to ensure that it works well when using different operating systems and different software packages to process these CSV files.
For exmple, the above navigation bar shows of a video called "Climate Change 101" in a course called "Annoto". Clicking on the course name will take you back to the .
In the , clicking on any of the video rows takes you to the discussion within the video.
In , clicking on a video row takes you to the of that specific video.
In the clicking on user row takes you to the of that specific user.
In order to subscribe to email notifications, all you have to do is click on Follow this Course button at the top right partof the dashboard:
New, not reviewed comments can always be spotted in the .
Clicking on a specific video will take you to to manage the discussion.
This is easily done within the dashboard of the course you want to import to, as you can see , or in the following instructions:
All duplicated comments will have the same as the original comments
Duplicating comments can be extremely useful in , , or - anywhere you added questions, comments or insights for your learners, and you want to use them again.
Once imported, all instructor's root comments will be added to all videos in the new course. If there is a comment you do not want in a specific video - simply this comment.
Engaged Users - Percentage of the engaged users. To learn more about which users are considered engaged, please refer to .
Views - Number of times the video was viewed. For more details please refer to .
Engagement - Rating for user generated content creation and consumption. For more details please refer to .
To learn more about Total Completion, Avg. Completion Rate and Watch time, we highly recommend to read:
Recommended further reading:
Clicking on any of the rows will dive into the of that specific video.
Views - Number of times user viewed videos in the course. For more details please refer to .
Engagement - Score for creation and consumption by the user. For more details please refer to .
Recommended further reading:
Clicking on any of the rows will dive in to the of that specific user.
Recommended further reading: .
Might also interest you:
Recommended further reading: .
May also interest you:
The files are encoded using UTF-8. If you encounter any issues with non-English characters, please follow our guide.
Please refer to section to learn more.
Hub
Enables management of the content
Insights
Provides analytics and insights about the content and the users
Preferences
The place to set features and UX for the course or specific video
Annoto is very flexible and can be fit to the needs of any use-case.
The Features and User Experience can be set for the required context (Site, Course or per specific video) via the Preferences Tab:
Setting preferences can be done on the following organizational levels:
Site preferences - any preferences that are set by the organization in the Admin dashboard are the default preferences for all courses and videos.
Course preferences - by default, the course preferences will be same as Site preferences. Modifying the course Features will create a copy of all the site preferences and override all the site preferences (so any future change to site preferences will not affect your course custom preferences). Same override is available for the User Experience.
If Course is using the Site defaults you will have the following indication at the top right corner of the preferences tab:
Clicking on this button will revert the custom course preferences to site preferences.
Video preferences - by default Video will have same preferences as the Course preferences it belongs to. Similar to Course preferences, video Features can be modified to fit the specific use case.
If Video is using the Course defaults you will have the following indication at the top right corner of the preferences tab:
Once preferences are changed the indicator will change to a button:
Clicking on this button will revert the custom video preferences to course preferences
Features tab includes all Annoto features that can be Enabled \ Disabled.
Some of the features include options:
Clicking on the Options button opens additional preferences that are related to the feature.
Once clicked, Course\ Video preferences can be set, either manually or by choosing a designated Preset:
Presets are ready-made sets of preferences, based on the most common use-cases of Annoto.
Selecting a preset is done from "Choose Preset" dropdown menu:
Collaborative Learning - Creating a discussion between video viewers. Great for: Guided Watching, Collaborative Learning, Learners' Interaction & Flipped Classroom.
Personal Notebook - Enables only Personal Notes and analytics on the videos. Great for Self-Learning
Analytics - Enables to see analytics and insights on the videos, without enabling the widget
Skills Assessment - Providing time-based feedback on a video. Great for Skills Assessment use-case.
Peer Review - Providing time-based feedback on a video. Great for Peer Review use-case.
Live Video Stream - Best for Live streaming
Disabled - All Annoto features are disabled
Once a preset is selected, click "Apply" to save the chosen preset preferences.
After selecting a preset, you can still change your preferences manually.
"Disabled" preset means you will not see the Annoto Widget, nor any info regarding course activity (no insights on content, users, engagement, etc.)
When enabled, videos include the Comments Space – the tab that enables a discussion between all video viewers.
Options
Voting type - Select the type of voting that will be enabled in the course (Likes, emotions, etc.):
Like - Enable to click on the red heart to "like" a comment:
Sentiment - Enable to vote with sentiments
Disabled - will not allow any voting
Sentiment – Enable using sentiments while commenting.
Closed Discussion - Once enabled, users will not be able to add new comments to the discussion
Mandatory participation - When enabled, users will see other users' comments only after they submit a comment
The comments space significantly increases viewers’ engagement and is used for many different use cases, such as: Guided Watching, Collaborative Learning, Skills Assessment, Peer Review, Flipped Classroom, and more
When enabled, videos include the Notes Space – the tab that enables users to manage their own private notebook.
Options
Export - Enable exporting one’s personal note to a spreadsheet or a document.
Sentiment – Enable using sentiments while writing a note.
Personal notes can be used for:
Private noting on the video (summarizing\ highlighting\ reflecting on the content)
Enable participants to add recorded comments. Recording can be self-recording (Camera) or screen recording.
Options
Max Duration – Set the maximum length of the recorded video comment (set in seconds). Duration can be set up to 360 seconds.
When enabled, videos include the People Space - the tab that enables users to see all course participants and their presence, search and also mention (@) uses
Enable participants to have 1*1 chat
Add various quiz questions in the Interactions Space, to get your learners engaged
Prevent fast forwarding the video to make sure all the video content is watched without skipping.
Stop and ask your viewers at specific time of the video
Allow users to react on the video to increase engagement and get feedback
Enable notification emails on new comments and replies in the discussion. When enabled, users can manage their notification preferences in the Annoto Widget
Enable users to write anonymously. When writing anonymously, only moderators will see user's details
Options
Apply to moderators- When enabled, moderators will not see who posted an anonymous comment, same as regular users
User Experience
Enables presets for managing the discussion in various modes:
Simple - Publish and Delete user's comment. Comment will become public in the discussion only after Published by the moderator.
Managed Q&A - Enables rich options for managing the discussion, with the option to publish answers to everyone or reply privately to a user.
Options
Publish action - when enabled, every comment will require approval. Once approved, it will be visible to all users.
Delete action - when enabled, once a comment is deleted, it will be deleted to all users, including the comment's author.
Dismiss action - when enabled, a comment can be dismissed, meaning: it will not be visible to anyone, including the moderators. The author will keep seeing the comment as pending approval.
Reply action - when enabled, replying to a comment will also approve it, meaning: it will be visible to all users.
Reply privately action - when enabled, a comment will have the option to be replied in a private chat. The comment will be marked as private for author and the moderators, and will not be visible to other users.
Enable the Annoto Insights Dashboard that provides you with extensive analytics of the activity - course\ videos\ participants
The analytics are visible for moderators only (not for learners)
Disabling analytics means you will not see any info regarding course activity (no insights on content, users, engagement, etc.)
Enable exporting the analytics from the dashboard to csv files. Exporting the analytics is for moderators only
Provides enhanced analytics on the videos, such as videos consumption and watch time
Enable adding badges in the discussion (such as: Educator's Thumbs Up)
Moderator Like – when enabled, moderator's vote will be presented as Educator's Thumbs Up (instead of a regular vote)
Enable participants to manage their info and to stay updated with all the latest activity in the videos they are following. Learn more
User Experience tab enables you to set the UX preferences that suit your use-case.
It includes 3 sections:
Widget
Player
Comments
The UX preferences will affect the level you are setting them: Course level or Video level.
Position - Enables you to set the positioning of the widget when it loads in closed mode:
Load state - Set the widget behavior once it loads: Open, closed or Peekaboo mode (Peekaboo means a minimized widget that hides after a few seconds if the user does not take action.)
Tabs - When enabled, the colorful tabs (that are enabled) will be shown in the widget. If disabled - switching between tabs will be done via the Annoto menu.
Video autoplay triggers - when enabled, video will automatically play after a comment or a note is submitted (depending on the setting)
Default Sorting - Choose the default way in which the comments will be sorted in the widget
Make sure to click SAVE CHANGES after the User Experience preferences are chosen
In some use-cases, only moderators would want to see the Annoto widget - to set the interactions, or to choose the exact time to hide the widget for the users.
Under Access Control, moderators can control who will see the Annoto widget (and when). This is set in the Annoto dashboard Preferences, within the User Experience tab, under Access Control:
Moderators can choose whether only moderators will view the widget:
Or if users will also see the widget:
By default, users can see the Annoto widget.
Having the ability of enabling/disabling preferences, allows to choose the set of features that best suit each course and/or video.
In case of enabling some of the Annoto spaces (Comments/ People/ Personal Notes) - the widget will include only the tabs that were enabled.
Here are a few examples of preferences settings, both from the dashboard side and how it looks in the widget:
Enabling Comments, People and Personal Notes tabs allows the users to enjoy all the different types of interactions: Having a group discussion, learning from one another, having 1*1 chats with fellow learners and the instructor and reflecting on the content in a private notebook.
Preferences in the dashboard:
How it looks in the widget:
In case viewers public discussion does not suit the needs of the video, only Personal Notes and People spaces can be enabled. This will allow the users to watch the video, have 1*1 chats and reflect on the content in their own Personal Notes.
Preferences in the dashboard:
How it looks in the widget:
Enabling only Personal Notes can be in case no viewers interaction is required. The Personal Notes will provide each learner the option to engage with the video and better learn from it.
Preferences in the dashboard:
How it looks in the widget:
Only Analytics enabled:
In case only analytics are enabled (a video with quizzes, for example, where learners interaction does not suit the needs of the video), the Annoto widget will not be shown, however the dashboard will present the analytics of the activity: users, views, completion analytics, etc.
Recommended prior reading material: .
Taking a closer look in the Activity Trends graph, can shed light on how users learn overtime.
In the above graph we can focus on the active actions users made in a course, such as comments and replies (collaboration) and see how these actions increased the engagement - not only in the days that the discussion took place, but also in the following days (as users got back to the video, read the comments and replies, clicked on the time tags, added notes etc.).
The Activity Trends graph helps us identify learning patterns by acknowledging dates that had extremely high activity (before\ during\ right after a lecture? before an exam?) and when there was low activity (semester break?). In case we spot low activity when it was not expected, perhaps a comment on some videos, an assignment or a task can re inspire learners to become active.
Let's take this user's activity for example:
From this user's activity trends graph, we can see that about two weeks after the course began (at around Aug 15th ), he increased his level of participation - adding comments (green) and taking notes (orange) on a regular basis. At some point, during course break (Oct 1st - Oct 15th), Hen's activity decreased a little - but not completely. Towards the end of the semester (starting the 2nd half of November), his level of collaboration decreased, however - he did remain engaged until the end of semester (end of November).
A user's engagement indicates active learning, meaning - the user did not only watch the video, but actually had a meaningful interaction with it - either by creating content and\or by consuming it.
The course includes 22 videos
Gili watched 4 of them – 123 times (for all 4 videos combined)
She finished 12% of the total course content of the 22 videos.
Gili got 3 "Educator's Thumbs up" in the course for the 10 Comments and replies she wrote (30% is not bad).
She has 102 engagement score indicating a high meaningful activity in the course.
3 of Comments were replies to others indicates level of collaboration and knowledge sharing.
She liked 9 comments written by others.
Finally, she wrote 12 personal notes which can be characteristic of learning (summarising, bookmarking, etc).
One of the greatest features of the tables in the dashboard is the fact that the columns can be sorted.
This way we can get a better understanding of “the top...” well.. everything!
It might be extremely interesting and caused a vigorous discussion by the learners. In this case you might be interested in taking a part of the discussion as well.
There might be a part in which the users (all of them, or specific learners) are struggling and it may be helpful to offer your help, provide a different explanation, or share examples.
Sorting the table by the “Users” column will order the videos by the number of users who watched it. It may be interesting to see which videos were not viewed by many users - is it because this video was added at the end of the semester? It's worth investigating further, maybe this video has high drop rate (See Sort By Average Completion Rate below).
Videos with low Avg. Completion rate - means users watched only a little of the video every time they viewed it. It might be worthwhile to understand why - was the video hard to understand? was it not engaging enough? was it too long?
Sorting within the users table also means filtering. Use this feature get a better idea of how many users participated in specific type of activity.
Let’s take a demo course as an example:
In the above example we see there are 19 users in the course, 47% of them collaborated. If we scroll down to the users table and sort by “Collaboration”, we will see exactly how many users collaborated and who they are:
Presence: Sort by Views to see only users that played at least one video. If someone is not on the list - he has not watched any of the course videos yet.
Sharing Knowledge:
The Thumbs up column indicates how many Thumbs Up (= Instructor’s “likes”) each learner received. This can be used as extra credit, or bonus points for the learners.
The Replies column can also serve as an indicator to learners who not only take an active part of the discussion, but are actually helping others (replying to other questions). This can also be used as extra credit, or bonus points for the learners.
Once exported, you will receive a zip that contains the following CSV’s:
Overview – the highlights of the course.
Users – Course Users activity (with additional fields such as: user email, votes, last login date).
Videos – Course Videos.
The exported Users table provides comprehensive analytics that can be used for grading, for example:
Participation - learners can be graded for the comments\ questions\ ideas\ answers & thoughts they are sharing:
Collaboration - for example: writing over 5 comments throughout the course grants extra credit
Replies - for example: writing over 3 meaningful replies throughout the course grants bonus points
Quality
Thumbs Up badges - for example: a learner that got more than 5 Educator's Thumbs Up gets extra credit
Once preferences are changed the indicator will change to a button:
Features are enabled / disabled using the toggle at the bottom left corner of each feature card.
Closed Notebook – Once enabled, users will not be able to add new notes
At the we can use the to learn about a specific user - his activity throughout the course and his learning habits. We can even see how his learning advanced in the course over time.
Recommended prior reading material: .
In the above example of (Gili Cohen's activity in "Demo" course):
In fact, every time she played a video, she only watched small portions (), 10% on average.
Recommended prior reading material: .
Sorting the table by the Collaboration column will place videos with most collaboration at the top. High level of collaboration might be an indicator that the video requires additional attention:
Sort by to see what videos were the ones that got the most “attention” from learners. Note that the most engaged video is not necessarily the one with the most collaboration, meaning: the content of the discussion is what increased the engagement (and not the number of comments) - might be interesting to take a deeper look in this video.
Recommended prior reading material: .
Attention: Sort by Views, if a user has a radical number of views (much more or much less than others), it might indicate on struggling with the content. Diving into , can shed more light by looking at metrics, especially The Average Completion Rate.
Learning: not only the users that collaborate are the ones that are learning - they are simply the ones that are “heard”. Note all the users that have high Engagement but low Collaboration and the ones that have written many personal Notes - they also had meaningful interactions, they just might be shy. Diving into , can shed more light by looking at metrics, especially at the ratio of Average Completion rate vs Total Completion.
Course analytics data can be exported, and dowloaded in CSV format. For more details please refer to :
If you need any additional information or have any questions, please contact us at
Recommended prior reading material:
Course Completion - learners can be graded based Views, Watched video and (available in ).
