Welcome to the Innovatank 

Evaluator FAQ Page

x

Challenges – FAQs

WHAT IS A CHALLENGE AND WHO CREATES IT?

A challenge is a case study that is created by professors or Innovatank.  It can be a compilation of videos and text and innovators are asked to work to find solutions for the issue(s) at hand.

HOW IS A CHALLENGE SET UP?

There are 3 main steps to for setting up a challenge in Innovatank.

  1. Enter basic details of the challenge
  2. Build an evaluation template
  3. Set up the repository page

Create a Challenge

Create a Challenge

WHAT IS THE DIFFERENCE BETWEEN A PRIVATE AND PUBLIC CHALLENGE?

A Private Challenge allows professionals to grant access to specific participants.  A Public Challenge is open to all members of
Innovatank.

WHAT IS THE DIFFERENCE BETWEEN A RESEARCH AND STAGGERED TIME CHALLENGE?

Research format challenge has a start date and an end date. Innovators have the full duration to submit the solutions. The administrator can add a buffer(keeping the challenge open for last minute participants to submit their solution).

Staggered Time format allows innovators to attempt the challenge in a specific time slot between the specified start date and end date of a challenge. For example: You can host the challenge from Jan 1 until Jan 3. The innovator(s) would have a specific time period(with timer) within that time period to do the work.  Example 3 hours from the time they start working till submission time.

WHO CAN BE AN EVALUATOR ON A CASE/CHALLENGE?

An evaluator can be a professor, a member of the community who is an expert on the subject matter, a profession from the business marker related to the subject matter, a member of the Innovatank team etc.

WHAT IS THE LAST EVALUATION DATE?

The Last Evaluation Date is the last day judges or other evaluators can give feedback on a case.

X

Evaluator Access – FAQs

HOW CAN I REQUEST EVALUATOR ACCESS IN INNOVATANK?

Please send an email to support@innovatank.com

HOW CAN EVALUATORS REQUEST ACCESS TO THE DETAILS OF A CHALLENGE AND THE SUBMISSIONS?

Evaluators are initially granted a username and password to Innovatank where they have access to all the available active challenges.  An evaluator can submit a request by clicking on Request Access button below the challenge.  This request is sent to the administrator on the challenge who will then approve or not the request.

HOW CAN I KNOW IF MY REQUEST TO A CHALLENGE AND THE SUBMISSIONS HAS BEEN ACCEPTED?

The Request Access button below the challenge will change to Request Granted.

x

Evaluating Challenges- FAQs

HOW DO I KNOW A CHALLENGE IS CLOSED FOR SUBMISSIONS?

There will be a key icon below the challenge.

HOW CAN I VIEW THE SUBMISSIONS?

Click on the solution icon(key) below the challenge and you will see the submissions.  If you wish to download the documents, click on the download all icon.

WHO DECIDES IF THERE SHOULD BE 1 OR MORE EVALUATORS ON A CHALLENGE/CASE?

The professional/administrator on the challenge decides if they want a single or multiple evaluators on a challenge.

CAN INNOVATORS' (PARTICIPANTS) NAMES BE MADE ANNONYMOUS TO EVALUATORS?

Yes, the professional who is in charge of the challenge can make the names of the participants anonymous.

DO PROFESSIONALS TAKE PART IN THE APPROVAL PROCESS?

Professionals go back to the challenge for the final approval of grades and ranks.  They can make changes to marks if needed, but need to add the justifications (ex cheating).

HOW DO I BEGIN THE FEEDBACK PROCESS?

Once the challenge has ended, or you have set the evaluation date to start, you can follow these options:

If you are using Peer to Peer – students will see the challenge evaluation pop up on their dashboard. You can also submit an evaluation. Click on go to evaluation.

If you are not using Peer to Peer – you can click on go to evaluation and provide feedback and grades.

IS THERE A MAXIMUM NUMBER OF EVALUATORS ON A CASE/CALLENGE?

No, the organizer(professional) who created the case can pick the number of evaluators/solution.

WHAT IS THE AGGREGATION PROCESS?

The aggregation process is the compilation of evaluations, marks, ranks on a challenge anonymously when there are 2 or more evaluators before sending the Executive Summary evaluation for final approval.

WHO IS IN CHARGE OF AGGREGATING EVALUATIONS?

The head evaluator oversees the aggregation process.  The head evaluator is the evaluator from a panel of judges or group or evaluators on a challenge who clicks on the Aggregate Evaluations button.

AT WHAT POINT ARE RESULTS OF A CHALLENGE FULLY PUBLISHED?

Once the administrator has added their feedback, ranking, comments, and final approval they forward the results to the administrator at Innovatank.  Innovatank sends innovators (participants) notifications with their scores and ranks.