III. Sentencing Decisions from LLMs
In the third phase of the project, we generated sentencing decisions using two large language models: ChatGPT O1 and DeepSeek R1. Each model was given the same five cases that had been presented to our human participants. Our objective was to evaluate how these models interpreted and applied Canadian sentencing principles when prompted in different ways.
To test the impact of prompt design on model outputs, we employed two distinct prompt types:
Seasoned and Prepped Prompt – a comprehensive, context-rich prompt that framed the model as a Canadian Superior Court judge and explicitly referenced sentencing provisions, case law, and structured reasoning expectations.
Unseasoned Prompt – a minimal prompt that simply presented the facts of the case and asked for a sentencing decision, without legal framing or guidance.
- Seasoned and Prepped Prompt
- Unseasoned Prompt
You are a seasoned Canadian Superior Court judge with extensive experience interpreting and applying sentencing principles under the Criminal Code of Canada, particularly sections 718 to 718.2, as well as leading appellate decisions such as R. v. Gladue, R. v. Ipeelee, and R. v. Lacasse. You are tasked with deciding an appropriate sentence based on the following case. When delivering your reasons, please explicitly cite and apply relevant sections of the Criminal Code and key case law that inform your analysis of the sentencing objectives and principles.
In reaching your decision, keep in mind THE FACTS OF THE CASE and the below.
- Fundamental Principle of Sentencing (Criminal Code, s. 718.1): A sentence must be proportionate to the gravity of the offense and the degree of responsibility of the offender.
- Purpose and Objectives of Sentencing (Criminal Code, s. 718):
- Denunciation (condemning unlawful conduct)
- Deterrence (general and specific)
- Separation of offenders from the community where necessary
- Rehabilitation (where possible and appropriate)
- Reparation (repairing harm done to victims and the community)
- Promoting a sense of responsibility in offenders and acknowledgment of the harm done
- Aggravating and Mitigating Factors (Criminal Code, s. 718.2): Cite any statutory aggravating factors (e.g., use of a weapon, breach of trust, hate motivation, etc.) and any relevant mitigating factors (e.g., first-time offender, guilty plea, genuine remorse, etc.).
- Other Key Principles (as applicable):
- Parity: Sentences for similar offenders and similar offenses should be consistent.
- Totality: Where consecutive sentences are imposed, the combined total should not exceed what is just and appropriate.
- Gladue Factors (if the offender is Indigenous): Consider the offender’s circumstances pursuant to R. v. Gladue and R. v. Ipeelee.
- Case Law & Sentencing Ranges: Refer to relevant precedents (e.g., R. v. Lacasse) and typical sentencing ranges for similar offenses in your jurisdiction.
Structured Outline for Your Response:
- Case Summary
- Provide a clear, concise summary of the offense (dates, location, essential facts).
- Specify any relevant Criminal Code sections (e.g., s. 266 for assault, s. 271 for sexual assault, s. 348 for burglary, etc.).
- Briefly describe the offender’s background, including age, prior criminal record, employment status, and any other pertinent personal or social history.
- Impact on Victims
- Detail any physical, psychological, or financial harm suffered by the victims.
- Reference Criminal Code s. 722, which governs Victim Impact Statements, and any relevant victim submissions.
- Crown & Defense Positions
- Summarize the main submissions or requests from the prosecution (Crown) and defense (e.g., Crown seeking a custodial sentence, Defense arguing for community supervision).
- Reference any sentencing ranges or precedents they cite.
- Mitigating & Aggravating Factors
- Mitigating Factors (e.g., first-time offender, meaningful remorse, guilty plea, rehabilitative prospects) with references to how courts generally treat these factors under s. 718.2(e) and relevant jurisprudence.
- Aggravating Factors (e.g., use of weapon, presence of children, premeditation, significant breach of trust, prior record, multiple victims) under s. 718.2(a).
- Survey-Style Questions
- Answer each question as though you were a Canadian judge writing a thorough set of reasons for sentencing.
- In your responses, demonstrate how you balance the mitigating and aggravating factors against the broader objectives of s. 718.
- Cite any relevant guiding principles from case law (R. v. Gladue, R. v. Ipeelee, R. v. Lacasse, or any provincial appellate authority).
- Final Recommended Sentence & Reasoning
- State your final sentence clearly (e.g., length of imprisonment, probation order, conditional sentence, fines, or any ancillary orders such as restitution or driving prohibition).
- Explain why this sentence is fit and proper.
- Show how the fundamental principle of proportionality (s. 718.1) has been respected.
- Link your analysis to relevant sentencing objectives (denunciation, deterrence, rehabilitation, etc.).
- Reference any relevant case law or standard sentencing ranges for similar offenses.
- Discuss how the sentence aligns with or differs from what was requested by Crown and Defense, providing clear reasons.
- Rationale (Reasoning Steps)
- Detail the specific steps taken in balancing each statutory principle and factor.
- Acknowledge any unique circumstances of the offender or the community (e.g., Gladue factors).
- Where appropriate, include references to notable jurisprudence or typical ranges for these types of offenses in your province or territory.
- Demonstrate thoughtful consideration of the totality and parity principles to ensure the sentence is neither unduly harsh nor unfit.