The Educause Blog Post:
Miller, Patrick, Duan, Xiajing (2018) “NGDLE Learning Analytics: Gaining a 360-Degree View of Learning” Educause Review.
Takeway:
One key part of the Next Generation Digital Learning Environment involves the need for a central repository for learning analytics.
Click here to zoom in and download the poster.
3 min trailer about the project
A cross-campus team composed of faculty and staff from Kaneb, OIT, and FYS were awarded the 2018 Apereo Teaching And Learning Award (ATLAS). This international award recognizes innovation and excellence in the use of Apereo tools (Sakai), which enhance teaching, academic collaboration, student engagement, and learning. The major goals of the award include:
-Promote excellent pedagogy and innovation in teaching and learning;
-Create a community of educators who want to share teaching and learning practices;
-Encourage greater faculty involvement in the Apereo community.
The Apereo Foundation (http://www.apereo.org/) is a non-profit organization, with members drawn from higher education on four continents. It’s core mission is to provide a framework to assist and facilitate educational organizations to work together to foster, develop, and sustain open source technologies and innovation to support learning, teaching, and research. Apereo also provides a common organizational umbrella for higher education open source software projects and communities. Many of Notre Dame’s peer organizations are part of Apereo. Those include Duke, Yale, Stanford, Brown, Princeton, and others.
Each year, the Foundation selects nominations for the ATLAS award (Apereo Teaching and Learning Award) from the open source community that demonstrate innovative teaching and learning using an open source learning tool. Those awards include recognition at the annual Apereo international conference and funding for those team members to attend the conference and present on the winning nomination.
Our proposal was on the Moreau First Year Experience which is a required, two-semester sequence that helps first-year students make a meaningful transition to collegiate life at Notre Dame by integrating their academic, co-curricular, and residential experiences. Apereo tools form the digital framework of our courses. Our open-source learning management system, Sakai, contains all resource materials for both students and instructors as well as weekly reading/viewings and short reflections; a real-time gradebook; and a seamless interface with midterm and final ePortfolios assignments. Apereo tools ensure an innovative and transparent learning environment for our students, instructors and course administrators.
For more information:
-Click here for the announcement and to learn more about the award.
-Click here for our award submission
-Click here to read the story on the Academic Technology @ Notre Dame Blog
The interdisciplinary cross-campus team included:
|
|
We also worked with Digication, our ePortfolio provider, to create an LTI that would connect Digication to Sakai. That work was funded by Digication and we assisted with testing. The LTI was released by Digication for use by the Apereo community.
Abbot, Kevin, Dawson, Maureen, Ambrose, G. Alex (2018) “How to Use Sakai and the Open Learning Record Warehouse with Learning Analytics to Empower First-Year Students to Thrive” Apereo Teaching & Learning Awards (ATLAS), Open Apereo Conference, Montreal, Canada.
Award Presentation Abstract
At Notre Dame, our goal is for all our freshmen students to thrive. According to U.S. News & World Report, Notre Dame ranks in the top 10 of national universities for freshman retention with a 98% retention rate. You might be wondering why we would be concerned with our students thriving since 98% of our freshman class succeeds. Our challenge is to engage those struggling 2% early enough to take action.
Our First Year Experience course was designed to help our students reach their highest potential. We maximized Sakai for the overarching structure of the course and Open Learning Record Warehouse for gathering data. These ensured that all resources were available to students, at no cost, throughout the semester; that student work would be evaluated promptly and fairly; that course design and student progress were transparent; and that data was gathered for learning analytics and research.
This session will walk you through how we designed and implemented the course, connected the data to the Learning Record Warehouse, how we used predictive analytics to move 83% of students identified as underperforming to thriving, and what is the best and earliest predictor of student success.
Shazia Afzal, Bikram Sengupta, Munira Syed, Nitesh Chawla, G. Alex Ambrose, and Malolan Chetlur. “The ABC of MOOCs: Affect and its inter-play with behavior and cognition.” In 2017 Seventh International Conference on Affective Computing and Intelligent Interaction (ACII), pp. 279-284. IEEE, 2017.
Click here to zoom in and download the poster.
Abstract—We report on a study of affective states of learners in a Massive Open Online Course (MOOC) and the inter-play of Affect, Behavior and Cognition at various stages of the course. Affect is measured through a series of self-reports from learners at strategic time posts during the period of study. Behavior is characterized in terms of a learners’ engagement, interactivity, impatience and reflectivity, which constitute a set of novel high-level features derived from the clickstream of learner interactions. Cognition is evaluated from the performance of learners on assessments that are part of the course.We discover that learners in the MOOC experience multiple
as well as mixed emotions as they go through the course, which we handle using the psychological dimensions of arousal and valence. This results in a set of emotional quadrants, whose co-occurrence analysis reveals a strong association with
cognition and specific behavioral characteristics demonstrated by the learner. These results advance our understanding of the experience of MOOC learners to a more holistic level across the key dimensions of affect, behavior and cognition. They
also have important implications for the design of the next generation MOOCs that can potentially leverage affect and behavior-aware interventions to drive greater personalization and eventually, improved learning outcomes.
Context:
Closing Plenary of the AAC&U’s 9th Annual Forum on Digital Learning and ePortfolios
Title:
Liberate Learning through Next Generation Assessment
Abstract:
The ability to authentically capture and assess student opinions and growth has always been a challenge. Polls, surveys, and focus groups are some of the most common ways for administrators to gather assessment data at an institutional level; however, these indirect sources only serve as proxy indicators of student voices and experiences. And while ePortfolios may provide better and more authentic direct assessment, they are usually not faster or easier. How can we merge the efficiency of the forms, polls, and surveys with the power of ePortfolios to have a faster, better, and a deeper look into our students’ expectations? We will provide an overview of our current text mining assessment methods for over 2000 students ePortfolio reflections given specific prompts. These methods will provide a counter-narrative to indirect surveys that liberate all of our students’ unique voices and allow us to better align their aspirations in the arena of higher education. And answer the questions…What does assessment in higher education actually do to the American dream? How can we move beyond efficient assessment to more effective assessment thereby liberating the learning and the learners?
Presenters:
G. Alex Ambrose, Program Director of ePortfolio Assessment, University of Notre Dame
Trunojoyo (Atun) Anggara, Academic Advisor and Educational Data Assessment Postdoctoral Fellow, University of Notre Dame
Access Slides:
Liberate Learning through Next Generation Assessment -AACU 2018 Closing Plenary
Citation:
Ambrose, G. Alex, Anggara, Trunojoyo (2018) “Liberate Learning Through Next Generation Assessment” Association of American Colleges & Universities, 9th Annual Forum on Digital Learning and ePortfolios Closing Plenary. Washington, D.C
U.S. State Department, U.S. Agency for International Development (USAID) (Awarded 2016) “University of Notre Dame Partnership with Afghanistan’s Balkh University to Design, Train Deliver, & Assess a new Master’s Degree in Finance & Accounting” [$1.15 million]
More Information:
For the Notre Dame News press release see: “Notre Dame partners with Balkh University in Afghanistan to develop master’s program under $1.15 million USAID contract” (2016)
For the Mendoza Business Magazine (Spring 2018) faculty spotlight article see: “Equal Parts Hope and Learning” by Joe Holt associate professional specialist in Management & Organization.
For the USAID press release (2018) see: Success Story: Afghan Professors Explore a New Finance and Accounting Model in China
For a write up in the Notre Dame Initiative for Global Development (NDIGD) Annual Review (2017) see: Building the Capacity for Balkh University Faculty
Quote:
As a result of my involvement in this project in Afghanistan over the last 2 years, I have had the opportunity to come full-circle more than 10 years later from combat operations in Baghdad as an Infantry Platoon Leader. Soldiers are committed to serving a higher mission. What has been gratifying to me as a veteran working at Notre Dame is to be able to continue that duty to the mission of liberating the people of Afghanistan.This international development project has given me the opportunity “to heal, unify, and enlighten” (from ND’s mission) through education. Empowering a University in Afghanistan to not only help develop the nation’s first master’s degree but do so in the area of Accounting to fight corruption with modern teaching methods allows “learning to become service to justice.” It has been amazing to see our University mobilize across the corners of campus in support of this mission —faculty from Mendoza Business College, administrators from Executive Ed, program officers from the Initiative for Global Development, faculty developers from the Kaneb Center for Teaching and Learning, language experts from the Center for the Study of Languages and Cultures, IT infrastructure experts, legal counsel, and librarians. I am proud that 17 years after the war started in Afghanistan, the University Notre Dame is still committed to working in solidarity with the people of Afghanistan for the greater common good. I have seen first hand that the military may seek to destroy terrorists but education is the best chance at destroying terrorism. –Alex Ambrose, Professor of the Practice, Kaneb Center for Teaching Learning & Retired Captain US Army Infantry.
Ambrose, G. Alex, Abbott, Kevin, Lanski, Alison (2017) “Under the Hood of a Next Generation Digital Learning Environment in Progress” Educause Review.
Key Takeaways
*A first-year experience course at the University of Notre Dame offered the opportunity to develop and test a next generation digital learning environment.
*As a guiding framework for the digital architecture of the new FYE course, the design team followed the five dimensions of an NGDLE described in an ELI report to close the gaps between current learning management tools and digital learning environments.
*The FYE course required innovating beyond the supplemental course-level learning management system to create a more holistic NGDLE in order to fully support the teaching, learning, and student success missions of the program.
*Because they used an open-source LMS, they had a flexible hub with a campus support staff that could quickly, inexpensively, and safely begin to innovate at scale without high vendor cost or long development times.
Clark, G. Chris, Ambrose, G. Alex, Mettetal, Gwynn. Sullivan, Robin, Pedersen, David (2016) “Digital badges and educational development” Professional & Organizational Development (POD) Annual Conference, Louisville, KY.
Clark, G. Chris, Ambrose, G. Alex (2017) “Unbundling with Digital Badges: A Personalized Approach to Faculty Development” Educause Conference: ELI Annual Meeting, Houston, Texas.
Clark, G. Chris, Ambrose, G. Alex, Mettetal, Gwynn. Sullivan, Robin, (2017) “Digital badges and educational development” Event co-sponsored by the Teaching with Technology: Special Interest Group of the Professional and Organizational (POD) Network and the State University of New York Center for Professional Development (CPD) Webinar recording: Video
University Business Magazine “Badge breakthroughs: Micro-credentials awarded for in-demand skills give employers deeper detail about a student’s abilities” (2017)
University Business Magazine “Higher ed’s digital showcase: How colleges and universities use ePortfolios to promote the work of students and institutions” (2016).
Ambrose, G. Alex, Anthony, Elizabeth, & Clark, G. Chris (2016) “Digital Badging in the MOOC Space” Educause Review. http://er.educause.edu/articles/2016/11/digital-badging-in-the-mooc-space
Key Takeaways
*Over the past year, the University of Notre Dame’s Kaneb Center for Teaching & Learning and the Office of Digital Learning designed five different Credly Open Badges across three edX MOOCs and issued them to 233 learners around the globe.
*Each MOOC for which the team piloted badges had different goals and requirements for awarding badges, and each pilot taught the team different lessons about the badges’ value to students.
*Analysis of the data gathered for each pilot helped the team settle on recommendations for future use of badges in MOOCs.
On May 11-12, 2016 The REAL Design Lab in the Kaneb Center for Teaching & Learning at the University of Notre Dame hosted the AAEEBL 2016 Midwest Regional Conference with a theme about how digital portfolios and badges could work together. To see the conference details, program schedule, and published slides click here.
One of the big problems we have seen so far with early conference badging is that they turn out to be what Chris Clark calls “warm-body” badges. These badges don’t have any meaning or value besides “I have been there and got the t-shirt.”
The conference committee and badge design team had a goal to model good quality and practice with conference badging. In addition, we wanted to recognize and motivate presenters to “micro-publish” their presentations so we could share their work with a larger community that could not attend the conference. So we created the AAEEBL Midwest Regional Conference Presenter Badge.
Click here to see verified page on Credly.
To read the presenter reflections and view their slides you can either click on the evidence link in their digital badges above or see our badge directory of presentation materials here
To look under the hood and see how we pulled this off see the concept map below:
Click to zoom in
This hack of using LinkedIn Pulse (blog post) turned out be an effective platform for participants to share their public reflections, publish their slides (using Slideshare which was just bought out by LinkedIn) and also gave them a place to showcase their earned digital badge.