Tasks by category

Algorithms, data structures, bug-fixes, and API/systems implementation, graded against hidden test suites the agent never sees.

Structural and numerical solvers (FD/FE, contact dynamics) in C++, checked against multi-binary hidden references.

Provision, diagnose, and guardrail cloud infrastructure (AWS), verified against the deployed state.

RTL / digital-logic design checked under hardened simulation and formal-equivalence harnesses.

Quantitative reasoning across math, physics, and the natural sciences with deterministic, checkable answers.

Interactive simulation and game-logic tasks graded on exact state transitions and rule fidelity.

Vulnerability discovery, exploitation, and remediation verified against a concrete security objective.

Real-world bug-fix tasks distilled from open-source issues (esbuild, klauspost/compress, rust-lang/semver), graded against each project's own tests.

Train and tune models to a target metric on real engineering datasets, graded on held-out performance against a solved-reward threshold.

Physics-informed and surrogate modeling: PDE forecasting and CFD/FEA prediction, graded on quantitative predictive accuracy.

Modeling and statistical inference on real datasets (federated learning, event studies), graded against held-out ground truth.

Bias-correction and outlier-robust analysis in R: recover trustworthy estimates from messy data, checked against reference results.

Applied product analytics: causal impact and decision analysis on real product datasets (R).

Population PK/PD modeling with nonlinear mixed-effects: fit drug-exposure models and recover the correct parameters.