Make Your Media More Interactive and Engaging

Have you ever wondered how to make your video accessible for people who have a hearing problem or speak a different native language? Have you ever wondered how your video can benefit visual learners who absorb and recall information best by reading as opposed to listening? Have you ever wondered how to give the audience the freedom to search across your video and jump to the exact keywords that interest them? You are not alone, we have been wondering about that for a while. Fortunately, we now have a solution … interactive transcript.

Interactive transcript provides the audience a new way to enjoy your media content. Similar to subtitles in many ways, interactive transcript is displayed next to the audio/video source. As the audience hears the words being spoken, they can also see matching words highlighted or underlined in the transcript. The entire transcript is clickable, users can click on any word and start to enjoy the audio/video from that exact point. They can also search the transcript and jump to the part that interests them. Interactive transcript provides users a much richer experience with media content.

1. Click on word "mammals", the video jumps to that point and starts to play from there.2. When "mammals" is spoken in the video, it's also highlighted in the transcript.3, Search "fish", all the parts that mention "fish" are highlighted in the transcript.

1. Click on word “mammals”, the video jumps to that point and starts to play from there.
2. When “mammals” is spoken in the video, it’s also highlighted in the transcript.
3, Search “fish”, all the parts that mention “fish” are highlighted in the transcript.

There are a nurmeous of interactive transcripts providers, of which 3PlayMedia and SpeakerText Captionbox are among the most popular. We ran a small pilot with 3Play Media’s service. We provided them audio/video files along with the transcripts, and they synchronized the text with the media using automated speech technology. The result has been very satisfying, except we find the price to be a bit high.

Can the price be a showstopper? If you are like me, a strong believer in OpenSource, you must be wondering if there is something like that available for free. Well, after some digging, voila! Pipwerks already published the API(s) for adding captions and interactive transcript for online videos. And it’s completely OpenSource. Now it’s time to roll up our sleeves and climb onto the shoulders of giants. Thanks to the EasyCaption and Kaltura API, I was able to help an Irish Studies professor build a repository (Irish Stories) to collect and share Irish Immigrants’ stories in a more interactive and engaging way. If you are interested, here is an example.  Please feel free to contact me at xiaojing.duan@nd.edu for any technical details.

IrishStory1IrishStory2