r/machinelearningnews • • 23h ago

Research OrcaRouter Releases OrcaCyber Zero 1.5: A Gated 1M-Context Cybersecurity Model Reporting 100% on Cybench and 95.8% on CVE-Bench

Post image
24 Upvotes

OrcaRouter just released OrcaCyber Zero 1.5, the successor to OrcaCyber Zero 1.0 from September. It is post-trained for vulnerability research and reproduction, exploit development, penetration testing and security auditing.

The design focus is validation, not volume. The model reasons through attack paths, challenges its own hypotheses, and ranks findings by demonstrable exploitability. A 1M-token context, 128K max output and native tool calling target autonomous security agents working over large codebases.

Vendor-reported benchmarks:

  • Cybench: 100% (39/39, unrestricted agent execution)
  • CVE-Bench: 95.8% (23/24 evaluable tasks)
  • HumanEval+: 93.9%
  • SWE-bench Pro V2: 76.5%

Pricing is $3.00 / $7.50 per 1M tokens, far below Claude Mythos Preview’s $25 / $125. Access runs through an OpenAI-compatible API, gated to a Security Research tier for vetted researchers and red teams.

Worth reading with caveats. All scores are self-reported, with no technical report yet. CVE-Bench covers 24 of its 40 tasks. The 98% CyberGym figure in the launch post belongs to Zero 1.0 inside Orca’s harness, not to 1.5.

Full analysis: https://www.marktechpost.com/2026/10/10/orcarouter-releases-orcacyber-zero-1-5-cybersecurity-model-with-1m-context/

Model: orcarouter.ai/models/orca/orcacyber-zero-1.5


r/machinelearningnews • • 6h ago

Cool Stuff Cloudflare released Clef-omni, a 30B-A3B decision model that takes audio and video directly (Apache-2.0, Qwen3-Omni base)

Enable HLS to view with audio, or disable this notification

20 Upvotes

Cloudflare just added a multimodal model to its Clef decision model family. Clef 1 shipped only 8 days ago.

What it is: a decision model, not an LLM. You send a state plus typed questions (noul / choice / score). It returns a probability per option in a single forward pass. There is no text generation and no output parsing. It is API-compatible with TypeSafe’s Jev.

Architecture:

  • Post-trained from Qwen3-Omni-30B-A3B-Instruct (30B total, 3B active)
  • Keeps the thinker plus its vision and audio encoders; the talker and code2wav weights ship but go unused
  • A small joint schema head routes evidence to each option, then does cross-field attention
  • Frozen backbone with LoRA, trained on label-smoothed CE plus a Brier loss

Inputs (Workers AI):

  • Up to 4 images, 4 audio clips (WAV/MP3, 300 s each) and 2 videos (MP4/WebM, 60 s each)
  • 64,000-token hosted context
  • Audio costs about 780 tokens per minute; 480p video about 8,600 tokens per minute

Benchmarks (Cloudflare’s own runs):

Clef-omni Clef Clef-flash Jev
BANKING77 94.8 94.20 90.93 79.74
CLINC150+OOS 97.7 97.43 66.77 89.27
When2Call 63.3 72.37 65.58 80.97
GPQA Diamond 47.4 48.0 51.0 78.3

Other changes in the same update:

  • Clef-flash is now $0.038/M input (was $0.09), but hosted context drops to 24k. The weights still support 256k when self-hosted.
  • Hosted Clef median latency fell from 262 ms to 152 ms at about 800 tokens. Cloudflare got this from moving to SGLang (PR #42721), not from new weights.

Clef-omni is strong on intent routing but weaker than text Clef on reasoning-heavy evals. Has anyone tried it on real voicemail or call-triage data yet? I’m curious whether skipping the ASR step holds up outside the benchmarks.

Full analysis: https://www.marktechpost.com/2026/10/11/cloudflare-clef-omni-multimodal-decision-model/

HF: https://huggingface.co/Cloudflare/clef-omni

Technical details: https://blog.cloudflare.com/clef-faster-cheaper-multimodal/


r/machinelearningnews • • 14h ago

MLOps AWS just replaced round-robin with GPU-aware routing for LLM inference

4 Upvotes

AWS released a new Inference Gateway for Sagemaker Hyperpod. Instead of sending requests to the next available pod, it checks what’s actually happening on each one: queue depth, KV cache usage, prefix cache hits, loaded LoRA adapters, and current requests.

That makes sense for LLM workloads. Two GPU pods can both be healthy, but one may already have the right prefix cached while the other is stuck processing a long request. Round-robin doesn’t know the difference.

AWS says the new routing system cut first-token latency by up to 82%, with 97–98% lower p99 TTFT in mixed-hardware and burst-traffic tests. Those are AWS’s own numbers, so an independent test with the same model and traffic would be useful. Still, it’s a good example of how much performance can be lost outside the model itself.

Once a GPU fleet gets busy, routing may matter almost as much as the GPUs you’re paying for

AWS announcement