feat(jev): add TypeSafe decision integration by waleedlatif1 · Pull Request #8103 · simstudioai/sim

waleedlatif1 · 2026-09-21T08:07:18Z

Summary

Add native Jev Choice, Score, Noul, and batch evaluation tools with a TypeSafe API-key block. Jev uses the System One decision API, so it is exposed as an integration rather than a chat model.
Validate native requests and responses, project model-bound secrets through the shared executor, and retain probabilities, confidence, and token usage.
Add the official TypeSafe SVG and brand color, JSON-generation helpers, workflow templates, structured suggested skills, and generated catalog/docs metadata.

Type of Change

New feature

Testing

56 Vitest tests pass across Jev and the shared wand sanitizer, covering all four operations, workflow execution, invalid inputs/responses, exact batch answer IDs/types, and resolved-secret projection.
App type-check, lint, lint:check, all 47 audits, API validation, block registry, canvas sentences, and docs manifest checks pass.
Visually checked the official SVG in light, dark, and brand-tile contexts.
13 live API checks pass through the shared tool executor and workflow block handler: all four operations, structured state/instructions/rubrics, object and serialized batches, pinned/latest/preview models, and invalid-key handling.

Checklist

Code follows project style guidelines
Self-reviewed my changes
Tests added/updated and passing
No new warnings introduced
I confirm that I have read and agree to the terms outlined in the Contributor License Agreement (CLA)

vercel · 2026-09-21T08:07:22Z

The latest updates on your projects. Learn more about Vercel for GitHub.

1 Skipped Deployment

Project	Deployment	Actions	Updated
docs	Skipped		Sep 21, 2026 4:17pm UTC

waleedlatif1 · 2026-09-21T08:07:53Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-21T08:07:57Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

greptile-apps · 2026-09-21T08:11:45Z

Confidence Score: 5/5

The PR appears safe to merge; no actionable new defects or outstanding previous findings remain.

Summary

Adds TypeSafe AI’s Jev as a native decision integration.

Provides Choice, Score, Noul, and batch Evaluate tools with validated request and response contracts.
Projects model-bound secrets through the shared executor and retains probabilities, confidence, model, and token-usage metadata.
Registers the Jev block, TypeSafe branding, documentation, generated tool metadata, workflow templates, and suggested skills.
The changes since the previous review refine the Noul canvas sentence; both previously reported issues are resolved.

Diagram

%%{init: {'theme': 'neutral'}}%%
flowchart LR
  W[Workflow Jev block] --> O{Selected operation}
  O -->|Choice| C[Choice request]
  O -->|Score| S[Score request]
  O -->|Noul| N[Yes/no request]
  O -->|Evaluate| E[Batch questions]
  C --> P[Validate and build System One payload]
  S --> P
  N --> P
  E --> P
  P --> T[TypeSafe System One API]
  T --> V[Validate response shape]
  V --> R[Workflow outputs: decision, probabilities, confidence, model, usage]

_{Reviews (5) · Last reviewed commit: "fix(jev): clarify empty Noul canvas sent..."}

cubic-dev-ai

All reported issues were addressed across 25 files

_{Reply with feedback, questions, or to request a fix.

Fix all with cubic | Re-trigger cubic}

waleedlatif1 · 2026-09-21T08:22:20Z

@greptile

waleedlatif1 · 2026-09-21T08:22:21Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-21T08:22:27Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 25 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{Re-trigger cubic}

waleedlatif1 · 2026-09-21T16:01:17Z

@greptile

waleedlatif1 · 2026-09-21T16:01:18Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-21T16:01:25Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

No issues found across 25 files

Confidence score: 5/5

Automated review surfaced no issues in the provided summaries.
No files require special attention.

_{Re-trigger cubic}

waleedlatif1 · 2026-09-21T16:09:54Z

@greptile

waleedlatif1 · 2026-09-21T16:09:55Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-21T16:10:03Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 25 files

_{You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Fix all with cubic | Re-trigger cubic}

waleedlatif1 · 2026-09-21T16:17:56Z

@greptile

waleedlatif1 · 2026-09-21T16:17:57Z

@cubic-dev-ai review this PR

cubic-dev-ai · 2026-09-21T16:18:04Z

@cubic-dev-ai review this PR

@waleedlatif1 I have started the AI code review. It will take a few minutes to complete.

cubic-dev-ai

All reported issues were addressed across 25 files

_{You've manually re-run cubic several times on this PR. Each manual re-review checks the full PR again and counts toward your usage quota. To preserve your usage limits, we recommend letting cubic automatically review new commits.

Fix all with cubic | Re-trigger cubic}

feat(jev): add TypeSafe decision integration

901ded6

vercel Bot deployed to Preview September 21, 2026 08:09 View deployment

greptile-apps Bot reviewed Sep 21, 2026

View reviewed changes

Comment thread apps/sim/tools/jev/evaluate.ts Outdated

cubic-dev-ai Bot reviewed Sep 21, 2026

View reviewed changes

Comment thread apps/sim/tools/jev/choice.ts

Comment thread apps/sim/tools/jev/evaluate.ts Outdated

Comment thread apps/sim/tools/jev/shared.ts

Comment thread apps/sim/tools/jev/shared.ts

fix(jev): validate batch answers against requested questions

7b37534

vercel Bot temporarily deployed to Preview September 21, 2026 08:21 Inactive

cubic-dev-ai Bot reviewed Sep 21, 2026

View reviewed changes

improvement(jev): refine criteria helpers and suggested skills

5ad36fc

vercel Bot temporarily deployed to Preview September 21, 2026 16:01 Inactive

cubic-dev-ai Bot reviewed Sep 21, 2026

View reviewed changes

greptile-apps Bot reviewed Sep 21, 2026

View reviewed changes

Comment thread apps/sim/blocks/blocks/jev.ts

fix(jev): sanitize generated JSON inputs

e3b4b5f

vercel Bot temporarily deployed to Preview September 21, 2026 16:09 Inactive

cubic-dev-ai Bot reviewed Sep 21, 2026

View reviewed changes

Comment thread apps/sim/blocks/blocks/jev.ts Outdated

fix(jev): clarify empty Noul canvas sentence

b3fc80d

vercel Bot temporarily deployed to Preview September 21, 2026 16:17 Inactive

cubic-dev-ai Bot reviewed Sep 21, 2026

View reviewed changes

Comment thread apps/sim/blocks/blocks/jev.ts

waleedlatif1 mentioned this pull request Sep 21, 2026

feat(typesafe): add Jev decision integration #8119

Closed

10 tasks

Conversation

waleedlatif1 commented Sep 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Type of Change

Testing

Checklist

Uh oh!

vercel Bot commented Sep 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 21, 2026

Uh oh!

greptile-apps Bot commented Sep 21, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Confidence Score: 5/5

Summary

Uh oh!

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

waleedlatif1 commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot commented Sep 21, 2026

Uh oh!

cubic-dev-ai Bot left a comment • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

This branch was previously deployed

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

waleedlatif1 commented Sep 21, 2026 •

edited

Loading

vercel Bot commented Sep 21, 2026 •

edited

Loading

greptile-apps Bot commented Sep 21, 2026 •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading

cubic-dev-ai Bot left a comment •

edited

Loading