Deadlines for submission of the assignment:

  • Home assignment: Let Johanna know when the assignment is due. Exam office will create a Flow for you about two weeks before the deadline. You can then upload your assignment directly to the Flow.

    • You can start creating the assignment in WISEflow before the Flow is created. Once the Flow is created, you can then add your assignment to the Flow.

    • Assignment period: 2 weeks, starting at 09:00 and ending at 14:00 on the due date.

      E.g, due date on 2026-10-14, then the assignment period is from 2026-09-30 09:00 to 2026-10-14 14:00.

    Hjemmeeksamen, oppgave- og mappeinnlevering

  • Skoleeksamen: final exam

    • Prepare your laptop for exams in WISEflow: LINK

    • Do a demo test in WISEflow: LINK

WISEflow Introduction

Useful resources:

Research Stage Typical AI Use Declare Scrutiny Rationale
Idea Generation & Brainstorming Generating questions, refining hypotheses, exploratory prompts No None Doesn’t affect reproducibility; responsibility lies in final design
Literature Discovery AI-assisted search, summarization, citation discovery Optional None Equivalent to advanced search tools; indirect impact
Study Design & Methods Drafting protocols, suggesting methodologies, design support Yes (high-level) Moderate Methods shape reproducibility; final decisions must be human-led
Data Collection AI-assisted instruments, automated capture, preprocessing Yes Moderate–High Data provenance must be transparent for downstream validity
Data Cleaning & Preprocessing Outlier detection, normalization, missing data handling Yes High Materially affects results; must be reproducible
Statistical Analysis & Modeling AI-assisted tests, model selection, parameter optimization Yes (explicit) High Core analytical risk; requires reproducibility assurances
Code Generation / Debugging Writing analysis scripts, simulations, pipelines Yes (conditional) High Code must be reviewed, tested, and rerunnable
Results Interpretation AI-assisted explanation of findings, trend identification Optional Moderate Concern only if AI substitutes for scholarly judgment
Figure & Image Generation Creating plots, visualizations, illustrations Yes (if data-derived) Moderate Data-linked visuals must be traceable and reproducible
Writing, Editing & Translation Drafting, clarity, language editing, translation No None Doesn’t affect data or methods; stylistic policing is inappropriate

Log in portal: https://europe.wiseflow.net/author/

Begrunnelse skal vĂŚre i WISEflow (IKKE Fagpersonweb lengre)

Workflow overview:

  1. Flows are generated by the exam office.

    Eksamenskontoret oppretter en Flow. NĂĽr den er opprettet, legger Johanna meg til som forfatter, slik at jeg kan laste opp oppgaven direkte i Flowen.

    Flowen blir vanligvis opprettet cirka to uker før innleveringsfristen.

    When the flow is created, you will receive an email notification from WISEflow.

  2. The course responsible (me) adds Assignments to the flow.

    Click the corresponding flow to add your published Assignment.

Q: Do I need to create a FLow myself?
A: No. The exam office will create a Flow for you and add you as an author. You can then upload your assignment directly to the Flow. Besides, the Flow creation function is NOT available for course responsible’s WISEflow page.

WISEflow Document: Creating a Flow

Q: What are flow types?

A: Flow Types are different forms of assessments.

  • FLOWassign: Commonly used for home assignments. Participants view/download the set assignment from WISEflow and then work outside of the system to create their submission. Participants then upload their paper as a PDF (main paper must be in pdf format).

    If enabled, their submission can be supplemented with Appendix Material where NO specific file type is required. Assessors can then provide feedback and provide grades within the system. Participants can view their provided feedback/grades within WISEflow.

    I don’t need to set up group submission. It is done by the exam office. I just need to add the assignment to the flow.

    • Support working in groups ← Need to set this up manually; NOT enabled by default.

      Basic settings tab > Details > Set “Group type” to “Group submission”.

      • Students are able to form groups themselves within WISEflow.

      • Each group must make a group submission.

        Only one member of the group needs to make the submission. Once submitted, the submission is attributed to each participant in that group. Assessors will mark just the one submission; the scores and feedback will be attributed to each participant in the group.

    Navigation and Basic Settings of a Flow

    Students: Form a Group and Submit a Group Paper

    Advanced settings for FLOWassign

  • FLOWmulti: Final exams.

Group Type

  • No Group Type: Participants are not supposed to submit in groups. All participants will submit separately. This is set as a default on the licence.

  • Groups Submission: The participants on the flow need to form groups. Each group makes a joint submission. Each group member can submit and withdraw on behalf of the entire group, and only one paper can be submitted. Participants will receive feedback via the marking tool and there will be only one similarity report.

  • Individual Submissions: The participants on the flow need to form groups. Each participant submits individually.

  • Group with shared submission and individual grading: The participants on the flow need to form groups. Each group makes a joint submission. Annotations and feedback comments are common to the group but each participant receives an individual grade.

Manage Groups

Click on Manage Groups to get to the group setup.

❷: Group Settings. Set minimum and maximum numbers of group members that should be in a group to be defined.

See Managing Groups for more details.

Create assignments / exams

FLOWassign

  • File-based assignment → For home assignment

    1. Authoring tab > Click “Assignments (legacy)”

    2. Click “New Assignment”.

      Enter the title of the the assignment and any optional description and tagging information, then click Next.

      Click “File based assignment” and click “Create”.

    3. Edit the assignment.

      You have now successfully created a shell to which you can either upload your file and any appendix material, or import existing files from the content bank. There are several different options available from this screen.

      1. Header bar displays the title, and any tags. These can be edited by selecting the pen icon.
      2. Tools: Delete, edit, copy and focused screen modes available.
      3. Publish assignment (unavailable until file has been added).
      4. Add assignment either by local upload or by importing from the content bank.

    4. Publish the assignment.

      Once you publish the assignment, it will appear in the list of “Published assignments” and a reference ID will be generated.

    5. Add the assignment to the flow.

      When you have received the “Associated flows” email notification, you can add the assignment to the flow.

      1. add the Assignment itself.
      2. add the Marking guidance (sensorveiledning) for the assignment.

      No additional settings are required. No group settings etc.

FLOWmulti

FLOWmulti Assignment → For school exam

For FLOWmulti, you need to create a Flow Version to generate a reference ID. See HERE for details.

Flowmulti How-to

FLOWmulti Workflow Overview

  1. You can find the flows that you have been associated with from the overview page.

  2. Choose your flow.

    ❸: Add an assignment by entering the reference ID.

Assignment List

Click “Go to assignment” to see the list of assignments that you have created.

Only the ones you have published have “Latest flow version”.

You can preview the assignment by clicking the triangle dropdown button. You can choose “Preview as participant”.

Assignment Overview

⓵ Title and description of the assignment

⓸ Add or edit author group(s).

⓺ Create a current flow version of your assignment or view list of all flow versions. Click “Flow versions”, a dialog box will pop up which allows you to create a new flow version.

  • The dialog says “you need an immutable version”, which means that it is fixed, finalized version.

    Note: If there are errors in your assignment, the green button will grey out and you won’t be able to create a flow version until the errors are fixed.

⑨ Manage and re-order your items.

See HERE for description of the other buttons.

Item Overview

“Item”: Each item represents one section, usually containing several questions related to one topic.

Cover page

This is where you add meta information about the assignment, such as course code, date and time, and other instructions for participants.

Go into the target assignment Overview page → Click the tool icon to edit the assignment settings.

Toggle on “Information page” to add a cover page for the assignment.

Formula Sheet

Add the formula sheet to one of the items in the assignment. Insert as pdf resource. When students click the link, it will open in a separate tab.

Q: Do I need to insert in every item?
A: NO. Only need to attach it to the first item. It will then open in a separate tab that students can open when needed.

Co-authors

Follow the steps below if you need to design the assignment with other colleagues.

Add Coauthors to an assignment

  1. Create an author group

    Click “Author groups” in the Assignment Overview page > Click “New author group”

  2. Add Co-Authors to the group

    ⓻ Existing coauthors will show here.

    Click “+ Co-author” to add co-authors.

    ⓵ Search for the authors you want to add to the author group.

    ⓶ The tick box is to select the authors you want to add. → Have to check the box to add the author to the group.

    ③ To remove the existing authors added to the author group.

    ⓸ Cancel or Confirm your current amendments to authors associated with this group.

  3. Select the author group in the assignment settings

    Click the pencil icon ✎ to edit the author group.

    Choose the relevant author group by ticking the box before it.

ref: WISEflow Document: Using Author Groups

Question Types

Useful resources:

Question Editor Overview. Click HERE to see what these bottons stand for.

‼️ 6 Delete the item. ← NEVER USE THIS! This delete the whole item, including all the questions in it. There is no undo function. You cannot delete a question from the question editing page. You have to exit to the item overview then click the trash bin icon next to the question to delete.

11 Template: Once a question is copied to the clipboard, use template functionality to save the question as a template. This can then be used repeatedly to insert a commonly used question into an item.

Scoring

More options > Score section

② Penalty point(s): Set a penalty for incorrect answers. This setting is sensitive to the scoring types. E.g., for Exact Match type, if the participant answers any of the responses incorrectly, the pre-defined penalty point(s) will be deducted for the question.

⑤ Scoring type:

  • Exact match: point(s) are only awarded if the question is answered exactly as defined in the correct response schema.
  • Partial match: the points are split between the correct answered as defined by the correct response schema (e.g. 2 points is split between two responses so they each give 1 point). → Use this when you have multiple correct responses available for the question.
  • Partial match per response: when the question has multiple responses available, point(s) are awarded for each response as defined by the correct response schema.
  • Partial Pairwise Per Response (Only on Order Type questions): Entities are compared in pairs to determine the score.

Stimulus

The text, image, or video that is presented to the participant before they answer the question.

After a question group, use a horizontal line to separate from the next question.

<hr style="height: 3px; background-color: black; border: none;">

Type math

MathML is more robust in WISEflow than LaTeX. Many macros are not supported in LaTeX equation editor preview, eg \hat and \widehat. But when you preview the question in WISEflow, it will be displayed correctly.

MathML preview is more robust, use LaTeX to MathML to convert LaTeX to MathML.

Tricks for typing latex in the question editor:

  • Use \( and \) for inline math
  • Use $$ and $$ for display math

Note that the math might NOT be rendered immediately, but when your focus moves out of the question editor, it will display correctly.

Maths Essay

For open-response questions with formula support, use “Maths Essay”, which supports math symbols.

Set up Maths Essay question

  • For “Symbols”, choose “Basic” and “Greek letters”.

    There aren’t many available Greeks, but should be sufficient for most cases.

    Check HERE for different symbol groups.

    If you want to add more Greeks, add a “Custom group”. Then you can choose from a comprehensive list of symbols.

    • Label: name of the group, e.g., “More Greeks.”
    • Title: text at the bottom of the keypad to describe the group; more descriptive than the label, e.g., “More Greek Letters.”

Question Preview

When you click the formula button $\sqrt{x}$, the formula editor will pop up.

Refs:

Marking Overview

  • Re-marking: when you receive appeal requests, you can see the appeals here.
  • Grade justifications: when students ask for explanation of grades, you can upload your justification here. You can also see the history of your justifications.

Refer to Flow Page Overview for page layout.

Go to each exam, an overview of the marking progress and grade distribution will be displayed.

  • Apply scaled grades: Based on the thresholds you set in the grade scaler, convert the marks to A–F grades.

    When you click this button, it will bring up a pop-up window. Tick the check box to confirm the bulk action and click Confirm.

  • Submit All (#): Submit any grades that are ready to be finalised. Once submitted, they cannot be changed unless unlocked by the manager.

Grade Statuses:

  • Marking progress

    • No progress yet: no marking steps have yet been taken.
    • Grade inputted: a final grade has been entered.
    • Grade submitted: a final grade has been submitted.
    • Grade Finalised: a final grade has been agreed upon with co-assessors or approved by a reviewer.

  • Custom scores: Displays the number of scores that have been manually entered.

    There won’t be any custom scores if the exam is all multiple-choice questions. If the exam has open-ended questions, the custom scores will be displayed here.

  • Inputted grade: A final grade has been entered but NOT yet submitted.

    At this stage, the grades are still personal and not shared with co-assessors. You can still change the grade.

  • Pending grade: A final grade has been submitted, but it is awaiting co-assessor agreement or reviewer approval.

    Once you submit the grade, the pending grade will show.

  • Submitted grade: A final grade has been submitted and finalised.

    When you reach agreement with your co-assessor, the grade will show here.

  • Conflicted grade: When there is discrepancy between the co-assessors’ grades, the grade will show as conflicted.

    When there is more than one assessor and marker agreement is the selected marking model, a warning will appear in this column is the markers are in conflict with each other and need to reconcile their final grades.

See HERE for the meaning of the other columns.

Offline Marking

Bulk download

Click “Offline marking” to start exporting the submissions.

  1. Package Content

    • Structure of the submissions
      • As separate folders: each folder per student. ← If you plan to import back the marked submissions into WISEflow, choose this option.
      • All files in one folder: Easy to import into GoodNotes, print in bulk

    • Include coversheet: The coversheet is used by WISEflow to identify the student when you import the marked submissions back into WISEflow. If you don't want to import back, you can choose not to include the coversheet. The contents are of no use to me.

    • Choose whether to include marking guidance; the Assignment itself; a grade sheet; rubics

  2. Filter Submissions

    Choose to download a subset of submissions.

  3. Export

    A summary of your package content will be displayed. If you need to make any changes, navigate back to the previous steps. If you are ready to export, click on the button “Generate package.”

    If takes a moment for the zip file to be generated. Once the package is ready, you will see a green button “Download ZIP file”. Click the button to download the zip file.

If you intend to import the marked submissions back into WISEflow, don’t change folder names or the structure. Choose “As separate folders” and “Include coversheet” when exporting.

Q: Where is the sensorveiledning (grading guidelines)?
A: Choose “Marking Instructions” at the top of the exam page → Scroll down to find “Marking Material”

Q: How to set grading scales?
A: To add the thresholds, click the Personal setup button on the flow page and then Grade scaling (from scores):

A grade scaler window will pop up. You can adjust the thresholds for each grade and click Save when you are done.

Solutions

I write solutions in Quarto. Previously in LaTeX, but Quarto is

  • more flexible (easy to customize with lua filter)
  • more concise easier to read (\textbf vs ** for bold; bullet lists are more concise than \begin{itemize} \item... \end{itemize})

  • more organized

    Use a project yml to manage shared preambles.

Tips for writing solutions:

  • Use $$ and $$ for display math, and \( and \) for inline math. → So that when you copy the solution to WISEflow, it will be displayed correctly.

  • Use nested lists for sub-questions. This way, when you add or delete a question, the numbering will be automatically updated.

    Otherwise, if all questions are numbered at the same level, with stimulus breaking the questions, the numbering will not be updated automatically correctly.