Technical appendix · Run-level evidence
Behind every
headline number.
The recovered measurements, exact model responses, methods and failed trials. Historical comparisons stay separate from the current application evidence.
This appendix combines archived model and embedding comparisons with a newly measured 12-request lesson-generation run. Exact timestamps remain in the downloadable measurements. The downloadable files preserve measurement precision while excluding credentials, private infrastructure logs, and private student records. Original immutable archives remain the audit authority.
A · Model selection
Qwen3.5-4B versus 9B.
| Task | 4B time | 9B time | 4B / 9B full checks |
|---|---|---|---|
| Exact standard + provenance | 23.80 sec | 50.53 sec | Needs review / Needs review |
| Components + relationships | 27.04 sec | 71.19 sec | Needs review / Needs review |
| Discover a standard by meaning | 26.45 sec | 41.10 sec | Needs review / Pass |
| Recognize a nonexistent code | 8.22 sec | 13.08 sec | Needs review / Pass |
One matched pass with four tasks per model. 4B was faster in all four; 9B passed two full machine-check sets and 4B none. The check lists are strict diagnostics, not educator ratings. Token lengths and tool paths differed.
4B · A-exact · 23.801 sec
Prompt
What does the Learning Commons say for Kansas grade 3 Mathematics standard 3.NF.2? Give its statement, identifier, framework, provider, author, license, and attribution. Distinguish this complementary source from district Knowledge.
Generated answer
Based on the provided Learning Commons data, here are the details for Kansas Grade 3 Mathematics standard 3.NF.2: **What the evidence shows** * **Statement:** "Understand a fraction as a number on the number line; represent fractions on a number line diagram." [1] * **Identifier:** 67e0a81f-eafc-574f-b960-62024f547acd [1] * **Framework:** Kansas Mathematics Standards [1] * **Provider:** Learning Commons [1] * **Author:** Kansas State Department of Education [1] * **License:** CC BY-4.0 [1] * **Attribution:** "Knowledge Graph is provided by Learning Commons under the CC BY-4.0 license. Kansas Mathematics standards provided by Kansas State Department of Education available at https://drive.google.com/file/d/1n51F44Tl6malnJZVhGCabKhfKSqsiarU/view." [1] **What it may mean** The Learning Commons entry confirms that the Kansas State Department of Education adopted the standard 3.NF.2 as part of the Kansas Mathematics Standards framework. The Learning Commons acts as the structured repository for these standards, providing the specific identifier and linking them to the official Kansas framework. The attribution explicitly notes that while Learning Commons hosts the data, the Kansas Mathematics standards themselves are provided by the Kansas State Department of Education. **Questions or uncertainties** * The data indicates a "hasChild" relationship between the standard and two specific components (3.NF.2.a and 3.NF.2.b), but the prompt asks for the standard statement generally. The Learning Commons data breaks the standard down into specific components (a and b) which are listed as "Component" type entities with slightly more detailed descriptions than the parent "Standard" statement. * The Learning Commons data does not contain specific student performance data or local curriculum documents (District Knowledge) to compare against, so no conflict or alignment with local district practice can be verified from this source alone. **Next steps** * If you need to verify how this standard is implemented in your specific district curriculum (District Knowledge), you would need to consult your local curriculum documents or uploaded files, as the Learning Commons data provided here is the authoritative state framework data, not the district-specific implementation. * If you need to see the specific breakdown of components (3.NF.2.a and 3.NF.2.b) to plan instruction, the Learning Commons data provides the detailed descriptions for those components. **Sources** * Learning Commons OpenAPI response (id="1") [1]
Failed checks: caseIdentifierUUID carried into answer
6937 input tokens · 580 output tokens · HTTP 200
4B · B-components · 27.041 sec
Prompt
What is the canonical Kansas Mathematics standard 3.NF.2, and what Learning Commons learning components and graph relationships are linked to it? Include the relevant source identifiers.
Generated answer
### What the evidence shows The Kansas Mathematics standard **3.NF.2** is defined as: "Understand a fraction as a number on the number line; represent fractions on a number line diagram." [1] This standard is structured hierarchically within the Learning Commons graph: - It is a direct child of the **Cluster** "Develop understanding of fractions as numbers." [2] - It has two direct child **Components**: - **3.NF.2.a**: "Represent a fraction 1/b on a number line diagram by defining the interval from 0 to 1 as the whole and partitioning it into b equal parts. Recognize that each part has size 1/b and that the endpoint of the part based at 0 locates the number 1/b on the number line." [2] - **3.NF.2.b**: "Represent a fraction a/b on a number line diagram by marking off a lengths 1/b from 0. Recognize that the resulting interval has size a/b and that its endpoint locates the number a/b on the number line (a is the countable units of 1/b that determines the place on the number line)." [2] - It has a **hasStandardAlignment** relationship to the CCSS standard **3.NF.A.2**, which shares the same description and grade level (3rd grade). [2] - It is supported by a single **Learning Component** from Achievement Network: "Understand a fraction as a number on the number line." [2] ### What it may mean - The standard is fully adopted by Kansas and is part of the broader "Develop understanding of fractions as numbers" cluster, which limits Grade 3 expectations to fractions with denominators 2, 3, 4, 6, and 8. [2] - The alignment to 3.NF.A.2 indicates a 100% overlap in shared learning components (Jaccard = 1.0), suggesting the Kansas standard is fully aligned with the CCSS for this topic. [2] - The single learning component from Achievement Network suggests that instructional resources for this standard are currently limited to one provider in the Learning Commons graph. ### Questions or uncertainties - The graph shows only one learning component supporting the standard; it is possible additional components exist outside the Learning Commons graph or are not yet linked. - The "notes" field in the Cluster specifies limited denominators for Grade 3, but the standard description does not explicitly restrict the components to those denominators—this is an implied constraint from the cluster context. ### Next steps - Verify whether additional learning components for 3.NF.2 exist outside the Learning Commons graph. - Review the instructional materials associated with the single learning component (from Achievement Network) to ensure alignment with the full scope of 3.NF.2.a and 3.NF.2.b. - Consider expanding the Learning Commons graph to include more diverse learning components if the current single source is insufficient for comprehensive instruction. ### Sources - [1] Learning Commons standard data for 3.NF.2. - [2] Learning Commons components and relationships data for 3.NF.2.
Failed checks: canonical CASE UUID in answer; relationship types described
7383 input tokens · 679 output tokens · HTTP 200
4B · C-discovery · 26.453 sec
Prompt
Using Learning Commons, find the Kansas grade 3 Mathematics standard about representing fractions on a number line. I do not know its code. Give the code and source evidence you found.
Generated answer
Based on the Kansas State Department of Education (KSDE) standards and the Learning Commons framework, here is the information regarding fractions on a number line for Grade 3. ### What the evidence shows The specific standard in the Kansas Grade 3 Mathematics curriculum that addresses representing fractions on a number line is: * **Standard Code:** **3.NF.A.2** * **Standard Statement:** "Understand a fraction $1/b$ as the number of parts in a partition of a whole that is equal to $1$ whole, and understand a whole number $n/b$ as a multiple of $1/b$. Use fraction notation to name a fraction. Draw a diagram of a fraction $a/b$ to show the part and whole. Use fraction notation and visual models to describe the relationship between a fraction and a whole number." * **Key Components:** This standard explicitly requires students to **draw a diagram of a fraction $a/b$** and to **use fraction notation and visual models** to describe relationships. In the context of the Learning Commons and KSDE implementation, "diagram" and "visual model" for this standard specifically include number lines. ### What it may mean This standard indicates that by Grade 3, students are expected to move beyond simple "part of a whole" models (like area models) to understand fractions as points on a continuum. * The requirement to "draw a diagram" implies the use of a number line is a formal, expected skill, not just an optional activity. * The standard connects the concept of a fraction ($a/b$) directly to the number line, establishing the number line as the primary visual model for understanding fraction magnitude and equivalence in this grade level. ### Questions or uncertainties * **Specific Diagram Requirements:** While the standard mandates drawing diagrams, the specific rubric or assessment item within the Learning Commons that explicitly labels a "number line" as the required diagram type for *3.NF.A.2* is not always explicitly detailed in the standard text itself (it often relies on the "visual models" component). However, the Learning Commons explicitly categorizes number lines under this standard's visual modeling requirements. * **Grade 3 vs. Grade 4 Distinction:** In some interpretations of the Common Core (which Kansas follows), the explicit instruction to "draw a number line" is sometimes emphasized more heavily in Grade 4 (3.NF.A.3). However, the Kansas Learning Commons aligns **3.NF.A.2** with the expectation to use number lines to represent fractions $a/b$, often preceding the more complex work of comparing fractions on a number line found in 4.NF.A.2. ### Next steps If you are developing instruction or assessments for this standard: 1. **Align Instruction:** Ensure your Grade 3 curriculum explicitly teaches students to draw number lines for fractions $a/b$ as the primary method for visualizing these fractions. 2. **Check Assessments:** Verify that any summative or formative assessments for 3.NF.A.2 include tasks requiring students to draw a number line representing a specific fraction (e.g., $1/2$, $3/4$). 3. **Differentiate:** Monitor students who struggle with the abstract concept of a number line; provide concrete manipulatives (like fraction strips) alongside the number line to bridge the gap between physical objects and the abstract line. ### Sources * **Kansas State Department of Education (KSDE) Standards:** Specifically the Grade 3 Mathematics Standards document. * **Kansas Learning Commons:** The structured educational evidence and framework for Kansas Mathematics. * **Standard Code:** 3.NF.A.2 (Kansas Grade 3 Mathematics).
Failed checks: Learning Commons source payload present; discovered standard code in answer; discovery supported by tool payload
1545 input tokens · 780 output tokens · HTTP 200
4B · D-unknown · 8.220 sec
Prompt
Find Kansas Mathematics standard 3.NF.999 in Learning Commons. If the exact standard does not exist, say so clearly and do not invent its statement or attribution.
Generated answer
Based on the provided context, the exact standard **3.NF.999** does not exist in the Learning Commons database. The search for this standard returned zero results, indicating that no matching standard was found in the system [1]. **Next Steps:** * Verify the standard code. The suffix "999" is typically used as a placeholder or error code in many standards frameworks (e.g., 3.NF.A.1 is the actual standard). It is possible the intended standard was 3.NF.A.1 or a similar code, but "999" specifically is not listed. * If you have the correct standard code (e.g., 3.NF.A.1), please provide it so I can search for that specific standard.
Failed checks: no unsupported alternative standard codes
1925 input tokens · 166 output tokens · HTTP 200
9B · A-exact · 50.527 sec
Prompt
What does the Learning Commons say for Kansas grade 3 Mathematics standard 3.NF.2? Give its statement, identifier, framework, provider, author, license, and attribution. Distinguish this complementary source from district Knowledge.
Generated answer
Based on the provided Learning Commons data, here are the details for the Kansas Grade 3 Mathematics standard **3.NF.2**:
### What the evidence shows
* **Statement Code:** 3.NF.2
* **Statement:** "Understand a fraction as a number on the number line; represent fractions on a number line diagram."
* **Identifier (Standard):** 67e0a81f-eafc-574f-b960-62024f547acd
* **Framework:** Kansas Mathematics Standards
* **Provider:** Learning Commons
* **Author:** Kansas State Department of Education
* **License:** https://creativecommons.org/licenses/by/4.0/
* **Attribution Statement:** "Knowledge Graph is provided by Learning Commons under the CC BY-4.0 license. Kansas Mathematics standards provided by Kansas State Department of Education available at https://drive.google.com/file/d/1n51F44Tl6malnJZVhGCabKhfKSqsiarU/view." [1]
### Distinguishing Learning Commons from District Knowledge
The data explicitly distinguishes this source from local district knowledge in the following ways:
1. **Authorship:** The Learning Commons entry lists the **Kansas State Department of Education** as the author, indicating it is a state-level standard rather than a locally created district policy.
2. **Source Nature:** The attribution statement clarifies that the Knowledge Graph is provided by Learning Commons, while the actual standards content comes from the State Department of Education.
3. **Conflict Resolution:** If your local district has a different version of this standard (e.g., a modified statement or a different framework name), that local knowledge takes precedence for describing your specific curriculum. The Learning Commons data serves as a complementary reference for the state standard, not as a definition of your local practice.
### Important Context from the Data
The data also reveals the internal structure of this standard within the Learning Commons framework:
* **Cluster:** There is a parent cluster labeled "Develop understanding of fractions as numbers" (Identifier: 1ee6e81d-3b9d-5950-97a3-c88370dcb577) which includes a note that Grade 3 expectations are limited to fractions with denominators 2, 3, 4, 6, and 8 [1].
* **Components:** The standard 3.NF.2 is broken down into two specific components:
* **3.NF.2.a:** "Represent a fraction 1/b on a number line diagram by defining the interval from 0 to 1 as the whole and partitioning it into b equal parts. Recognize that each part has size 1/b and that the endpoint of the part based at 0 locates the number 1/b on the number line." [1]
* **3.NF.2.b:** "Represent a fraction a/b on a number line diagram by marking off a lengths 1/b from 0. Recognize that the resulting interval has size a/b and that its endpoint locates the number a/b on the number line (a is the countable units of 1/b that determines the place on the number line)." [1]
* **Alignment:** The standard aligns with the Common Core State Standard **3.NF.A.2** with a Jaccard similarity of 1.0, indicating they share the exact same set of learning components [1].
*Note: This analysis relies solely on the provided Learning Commons JSON data. If your local district has modified this standard, those local modifications would supersede the state-level description provided above.*
Failed checks: caseIdentifierUUID carried into answer
6937 input tokens · 794 output tokens · HTTP 200
9B · B-components · 71.192 sec
Prompt
What is the canonical Kansas Mathematics standard 3.NF.2, and what Learning Commons learning components and graph relationships are linked to it? Include the relevant source identifiers.
Generated answer
Based on the provided context, here is the information regarding the canonical Kansas Mathematics standard 3.NF.2 and its associated Learning Commons data:
### What the evidence shows
The canonical standard **3.NF.2** is defined as: "Understand a fraction as a number on the number line; represent fractions on a number line diagram." This standard is part of the **Kansas Mathematics Standards** framework [1][2].
The data identifies the following specific Learning Components and Graph Relationships linked to this standard:
1. **Learning Component:**
* **Identifier:** `524bcfce-6e7e-571a-b3fe-db64d70d72a7`
* **Description:** "Understand a fraction as a number on the number line" [2].
2. **Graph Relationships:**
* **Relationship 1 (Cluster Link):** A `hasChild` relationship connects the standard to a Cluster.
* **Target (Cluster) Identifier:** `1ee6e81d-3b9d-5950-97a3-c88370dcb577`
* **Description:** "Develop understanding of fractions as numbers."
* **Note:** "(Grade 3 expectations in this domain are limited to fractions with denominators 2, 3, 4, 6, and 8.)" [2].
* **Relationship 2 (Component Link):** A `hasChild` relationship connects the standard to a Component.
* **Target (Component) Identifier:** `257b2ea1-9719-5f57-979d-0c1dc8061ffe`
* **Description:** "Represent a fraction 1/b on a number line diagram by defining the interval from 0 to 1 as the whole and partitioning it into b equal parts. Recognize that each part has size 1/b and that the endpoint of the part based at 0 locates the number 1/b on the number line."
* **Statement Code:** `3.NF.2.a` [2].
* **Relationship 3 (Component Link):** A `hasChild` relationship connects the standard to another Component.
* **Target (Component) Identifier:** `18da348d-a738-5cae-93ab-46ef8bc0e864`
* **Description:** "Represent a fraction a/b on a number line diagram by marking off a lengths 1/b from 0. Recognize that the resulting interval has size a/b and that its endpoint locates the number a/b on the number line (a is the countable units of 1/b that determines the place on the number line)."
* **Statement Code:** `3.NF.2.b` [2].
* **Relationship 4 (Alignment Link):** A `hasStandardAlignment` relationship connects the standard to a CCSS standard.
* **Target (CCSS Standard) Identifier:** `40edda9b-7aed-5802-8bff-d566f71df50d`
* **Description:** "Understand a fraction as a number on the number line; represent fractions on a number line diagram."
* **Alignment Details:** The relationship indicates an evidence-based crosswalk derived from measurable overlap of deconstructed skills (Jaccard index = 1.0, shared LC count = 1). It does not imply sequence or dependency, only shared content [2].
### What it may mean
* The standard 3.NF.2 is hierarchically structured within the Kansas framework, branching into a broader cluster ("Develop understanding...") and two specific components regarding the mechanics of representing fractions on a number line (partitioning 1/b and marking off a/b).
* There is a strong content alignment (Jaccard = 1.0) between the Kansas standard 3.NF.2 and the CCSS standard 3.NF.A.2, suggesting they cover the exact same set of learning components.
* The Learning Component `524bcfce-6e7e-571a-b3fe-db64d70d72a7` (Understanding fractions as numbers) is a direct support for the standard 3.NF.2 [2].
### Questions or uncertainties
* The context does not provide the full text of the CCSS standard 3.NF.A.2, only the identifier and a description that matches the Kansas standard.
* The context does not list any other relationships (e.g., `hasPrerequisite`, `hasSuccessor`) for this specific standard, only the four listed above.
### Next steps
* If you need to verify the specific wording of the CCSS standard 3.NF.A.2 or explore other relationships not listed in the provided graph data, you may need to query the Learning Commons API for those specific entities or consult the official Common Core State Standards document referenced in the attribution statement [2].
### Sources
* [1] `server:learningcommons-openapi/get_standard_standards__code__get`
* [2] `server:learningcommons-openapi/get_standard_components_standards__code__components_get`
Failed checks: canonical CASE UUID in answer; relationship types described
7383 input tokens · 1161 output tokens · HTTP 200
9B · C-discovery · 41.097 sec
Prompt
Using Learning Commons, find the Kansas grade 3 Mathematics standard about representing fractions on a number line. I do not know its code. Give the code and source evidence you found.
Generated answer
Based on the search results from the Learning Commons hybrid search for "representing fractions number line," here is the specific standard you are looking for:
**Standard Code:** 3.NF.2
**Standard Description:**
"Understand a fraction as a number on the number line; represent fractions on a number line diagram."
**Source Evidence:**
This information comes from the top-ranked result in the provided data, which includes the following details:
* **Statement Code:** 3.NF.2
* **Description:** Understand a fraction as a number on the number line; represent fractions on a number line diagram.
* **Jurisdiction:** Kansas
* **Grade Level:** 3
* **Statement Type:** Standard
* **Provider:** Learning Commons
* **Author:** Kansas State Department of Education
* **Attribution Statement:** Knowledge Graph is provided by Learning Commons under the CC BY-4.0 license. Kansas Mathematics standards provided by Kansas State Department of Education available at https://drive.google.com/file/d/1n51F44Tl6malnJZVhGCabKhfKSqsiarU/view. [1]
**Note on Related Components:**
The search also identified two specific components that support this standard, which provide further instructional detail:
1. **3.NF.2.a:** "Represent a fraction 1/b on a number line diagram by defining the interval from 0 to 1 as the whole and partitioning it into b equal parts. Recognize that each part has size 1/b and that the endpoint of the part based at 0 locates the number 1/b on the number line." [1]
2. **3.NF.2.b:** "Represent a fraction a/b on a number line diagram by marking off a lengths 1/b from 0. Recognize that the resulting interval has size a/b and that its endpoint locates the number a/b on the number line (a is the countable units of 1/b that determines the place on the number line)." [1]
**Uncertainties/Conflicts:**
The search results also returned a standard with code **3.NF.3** ("Explain equivalence of fractions, and compare fractions by reasoning about their size...") [1]. While this is a related standard within the same cluster (3.NF), the specific phrasing "representing fractions on a number line" aligns most directly and explicitly with **3.NF.2**. There is no conflict in the data, as 3.NF.2 is the primary standard and 3.NF.3 is a distinct component/standard within the same domain.
Failed checks: None in this machine-check set; educator review still required.
9133 input tokens · 567 output tokens · HTTP 200
9B · D-unknown · 13.076 sec
Prompt
Find Kansas Mathematics standard 3.NF.999 in Learning Commons. If the exact standard does not exist, say so clearly and do not invent its statement or attribution.
Generated answer
The exact Kansas Mathematics standard **3.NF.999** does not exist in the Learning Commons. The search for this specific standard code returned no results, indicating it is not available in the database [1]. Please note that standard codes typically follow a specific format (e.g., Grade Level.Domain.Standard Number). The number "999" is not a standard designation within the Kansas Mathematics framework. If you are looking for a specific concept related to fractions in Grade 3 (Domain NF), please provide the correct standard code or describe the concept, and I can help you locate the relevant standard or explain the concept based on general educational knowledge.
Failed checks: None in this machine-check set; educator review still required.
1925 input tokens · 137 output tokens · HTTP 200
B · Embedding runtime
400 responses. All available to inspect.
| Measure | Ollama comparison | OVMS / Intel NPU |
|---|---|---|
| Successful requests | 200 / 200 | 200 / 200 |
| First request | 1.242 sec | 3.197 sec |
| Median after first | 0.908 sec | 0.665 sec |
| Empirical p95 | 1.221 sec | 0.685 sec |
| Whole-workload throughput | 1.471 requests/sec | 1.483 requests/sec |
| Whole-host CPU activity ≈ | 89.8% | 3.7% |
| Peak embedding cgroup charge | 2.015 GiB | 5.515 GiB |
| One-minute idle cgroup charge | 2.005 GiB | 5.214 GiB |
The frozen sequence contains 10 repeated historical short inputs, then 10 cycles of seven synthetic queries and 12 synthetic document chunks: 200 requests per backend, 20 unique texts. Order and input hashes matched. No swap, OOM, failed safety guard or required-service failure was recorded.
Cosine similarity of paired outputs ranged 0.99732–0.99883, median 0.99814. Seven synthetic queries retained the same top-three documents. This does not qualify vector stores for mixing between runtimes or establish broad retrieval accuracy.
The first request is reported separately from the median of the remaining 199. Empirical p95 uses the nearest-rank 95th percentile over all 200 latencies per condition. Overall throughput is completed requests divided by the recorded workload duration. No randomization or repeated A/B pass was performed.
Earlier observations of 11–12 GiB OVMS embedding charge were not reproduced in this sequential comparison; the cause remains unresolved. Device/shared/cgroup memory views overlap. The selected path remained OVMS/NPU; no consumer cutover or reindex was performed.
Expanded application measurements
Twelve lesson requests.
Three teaching scenarios.
We exercised the current application’s real local model with three fictional Grade 3 lesson requests: introduce one half, compare thirds and fourths, and correct unequal intervals. Each scenario ran four times, interleaved and submitted one at a time.
| Teaching scenario | Completed | Median | Observed range |
|---|---|---|---|
| Introduce one half | 4 / 4 | 35.858 sec | 35.828–36.694 sec |
| Compare thirds and fourths | 4 / 4 | 49.069 sec | 49.042–49.802 sec |
| Correct unequal intervals | 4 / 4 | 35.832 sec | 35.638–36.105 sec |
Measured through the deployed application’s preparation and inference adapter, with the same Qwen3.5-4B INT4 OpenVINO model and generation settings. Includes source preparation and model response validation; excludes browser, sign-in and saving. The aggregate depends on this scenario mix. A single run with four samples per scenario does not establish a service guarantee or multi-user capacity.
The appliance’s services and configuration were unchanged afterward. Draft completion is separate from lesson quality. A spot-check again found suggestions for unavailable materials; educators still need to review the content and teacher instructions.
Download all 12 measurements ↓C · Earlier product workflow baseline
Creation, revision and the busy guard.
Current application pass: 16 submissions, eight completed model responses, eight expected busy rejections, zero transport or adapter errors. The two serial fixed-input samples were 41.876 and 41.728 seconds. Functional create and revision took 42.046 and 49.084 seconds with different context lengths.
Measurements imported the exact deployed application modules and used one shared LiveAssistant with the existing one-active-generation policy. HTTP authentication, browser rendering, network travel and saving were excluded. Both functional answers introduced materials beyond the whiteboard-only instruction; performance completion does not establish instructional acceptance.
D · Preserved failures and missing evidence
Keep the unsuccessful trials visible.
The initial model comparison failed on a timed-out 9B request after completing four 4B responses. Its classification remains failed; those samples are not pooled with the later matched non-thinking trial. The initial embedding preflight stopped on a controller schema-key mismatch before mutation. Failed-trial extracts are included separately.
No historical 29B comparison was located. 9B reached a stable ready/idle state in a separate bounded characterization after transient loading pressure, so an earlier loading abort should not be presented as proof that 9B cannot run. No long-duration 9B production qualification or current supported-user count is established.
E · Downloads and audit trail
Raw detail, in usable formats.
| File | What is included |
|---|---|
| cpu-baseline-comparison.csv | Idle baseline and both workload windows, aggregate CPU tick deltas and sampled duration |
| cpu-baseline-comparison.json | Exact calculation method, source hash and original timestamps |
| expanded-lesson-summary.json | Expanded run summary, settings, scenario statistics and method |
| expanded-lesson-requests.csv | All 12 lesson requests, timestamps, timing, tokens and hashes |
| expanded-lesson-responses.json | Exact synthetic inputs, model payloads and all 12 generated lesson drafts |
| embedding-requests.csv | All 400 requests, inputs, timestamps, hashes, dimensions and timing |
| embedding-vectors.json | All 400 returned vectors at retained precision |
| embedding-telemetry.json | All 838 host/resource samples, CPU counters, NPU counters, memory and pressure |
| model-comparison.csv | Eight matched model responses, tokens, latency and failed checks |
| model-requests-and-answers.json | Exact prompts, full answer text, tool-operation names and individual machine checks |
| model-configuration.json | Model identities, generation controls and comparison limits |
| failed-trials.json | Separate failed initial model trial and failed embedding preflight |
| application-requests.csv | All 16 current application submissions, including eight busy rejections |
| application-requests-and-answers.json | Current test inputs, model payloads, generated output and structure checks |
| summary.json | Computed timing summaries and documented resource findings |
| manifest.json | Source hashes and SHA-256 hashes of every export |
| README.txt | Methods, file definitions, scope and attribution |
Exact study identifiers and timestamps are preserved in the downloaded audit manifest and measurement files. Standards provenance: Learning Commons v1.13.1; Kansas State Department of Education; Achievement Network; CC BY 4.0.
Questions about the measurements?