A technical result can support an experiment without supporting a purchase or launch. This companion decision note turns five research topics into evidence requests for the next commitment.
The findings below are reported by the researchers in the cited studies. The evaluation questions are practitioner interpretation, not measured Hyperion client outcomes.
TransitLM — evidence for the next decision
TransitLM learns route generation from more than 13 million route-planning records covering four Chinese cities. It takes origin and destination coordinates and learns to associate them with transit stations. The reported evaluation concerns generated route quality; it does not show that a service can discard current timetables, disruption information or geographic validation.
Evidence request: Test invalid routes, service changes and transfer to the intended city before considering a passenger-facing trial.
RTPurbo — evidence for the next decision
RTPurbo targets a small group of retrieval attention heads and trains a compact indexer to select relevant context. The authors report substantial prefill and decoding speedups with near-lossless accuracy in their long-context experiments. These are model, hardware and workload results; they do not demonstrate real-time performance or lower operating cost for an arbitrary application.
Evidence request: Measure complete response latency, peak memory and task quality on the actual hardware and context distribution.
LatentOmni — evidence for the next decision
LatentOmni combines textual reasoning with audio-visual latent states, feature-level supervision and synchronized position information. The paper reports advantages over explicit text-based reasoning on its audio-visual benchmarks. It does not test industrial sensor fusion, predictive maintenance or real-time control, and the results should not be presented as evidence for those applications.
Evidence request: Test whether answers change appropriately when the relevant audio or visual evidence is removed or altered.
PhysX-Omni — evidence for the next decision
PhysX-Omni studies generation of rigid, deformable and articulated 3D assets. Its dataset and benchmark evaluate geometry, scale, material, affordance, kinematics and function. An asset representation and benchmark score do not establish accurate dynamics, compatibility with a chosen simulator or acceptance for a robot-training pipeline.
Evidence request: Validate exported assets in the intended engine, checking contact, scale and failure behavior against independent references.
CUSP — evidence for the next decision
The revised CUSP paper evaluates scientific forecasting across research events, disciplines and forecast tasks. Its findings distinguish scientific reasoning from predicting feasibility, mechanisms and timing: the tested models show substantial forecasting weaknesses and overconfidence. Additional information from before the cutoff helps without closing the gap. This is evidence about the specified forecasting tasks, not every form of technology scouting.
Evidence request: Separate a model's explanation of a technology from a forecast, and require dated evidence and explicit uncertainty for investment decisions.
Write the commitment boundary
For the selected candidate, record the decision owner, the smallest useful test, the unresolved failure modes and the result that would stop further investment. Keep source-supported capability separate from proposed operational value.
