Cover image

One Stack, Many Crossings: What AMD’s Real2Sim2Real Pipeline Changes for Robotics Infrastructure

TL;DR for operators Robot-learning infrastructure is usually discussed as if the central choice were the model or accelerator. The operational loop is broader: collect or generate experience, simulate behavior, train a policy, validate it, move it onto a robot, observe failures, reconstruct relevant environments, and repeat. Qing Yang and colleagues’ Real2Sim2Real for Vision-Language-Action Manipulation: An AMD ROCm-Based Pipeline1 is best read as evidence that many of those stages can be kept inside one ROCm + PyTorch-oriented software environment. The authors generate demonstrations in Genesis, fine-tune SmolVLA-450M, validate it in simulation, and deploy it to a physical Franka arm. They also connect real-scene reconstruction, synthetic-data generation, and reinforcement-learning workloads to the broader stack. ...

September 8, 2026 · 7 min · Zelina
Cover image

More Synthetic Data Wasn’t Better

TL;DR for operators Catalog teams often need more labeled examples before an attribute extractor works reliably in a new category or marketplace. Producing additional product-like text is not the difficult part. The training record has to change the intended attribute while leaving unrelated product information coherent. Negri, Martínez Gómez, Balanya, and Rajaram test a controlled generation pipeline built around that requirement.1 In their downstream experiment, synthetic-only training reached 60.48% attribute-extraction accuracy, almost identical to 60.79% for original-only training. But the best tested configuration was 75% original + 25% synthetic, at 68.82%. Accuracy declined as the synthetic share rose to 50% and 75%. ...

September 4, 2026 · 6 min · Zelina
Cover image

Three Loops Toward Self-Improvement

TL;DR for operators Model teams encounter three distinct constraints after a base model exists. New proprietary knowledge may remain accessible through retrieval without becoming reliably encoded in the weights. High-quality unique training text eventually becomes scarce even when additional training compute is available. Improvements to the training recipe still depend heavily on humans proposing, implementing, and testing experiments. ...

September 4, 2026 · 7 min · Zelina
Cover image

Wrong Code, Right Data Budget

TL;DR for operators If verified circuit-training data are scarce, exhaustive validation of every generated design may not be the best use of the next unit of data-engineering budget. In one experiment, a curated 22-circuit synthetic corpus reached 48.49% F1-Micro and 42.82% F1-Macro with a frozen circuit encoder, outperforming the original 22 verified circuits on both metrics and a 110-circuit raw generated corpus on F1-Micro. ...

September 4, 2026 · 7 min · Zelina
Cover image

Synthetic Data Can Make the Model Worse

TL;DR for operators A team with authoritative domain documents but little labeled training data has an attractive option: ask a capable model to manufacture question-answer pairs, then fine-tune a smaller open model on them. The operational risk is assuming that domain relevance makes those examples safe training material. In this paper, a simple synthetic-data pipeline moved LLaMA 3.1 8B backward on open-ended legal QA: its LegalMC4 score fell from 43.0% to 35.4%. A more structured pipeline raised the same score to 55.4%. Across both LLaMA 3.1 8B and Gemma 3 12B, that structured treatment improved all four tested German legal benchmarks.1 ...

September 3, 2026 · 7 min · Zelina
Cover image

Synthetic Data Needs an Evidence Contract

TL;DR for operators Synthetic data should have a defined job before anyone scales its production. For model training, the relevant test is whether generated examples add nonredundant learning signal and improve held-out performance without unacceptable regressions. For consumer research, the test changes: statistically diverse text is not enough if the business claim concerns what real customers believe. ...

September 3, 2026 · 8 min · Zelina
Cover image

Synthetic Experience, Real Transfer: Build the Test Before You Scale the Data

TL;DR for operators Synthetic data should not be budgeted as a cheaper substitute for human examples. It should be treated as infrastructure for producing controlled training experience. The operational sequence is: generate tasks that can actually be executed and scored; verify and repair them before spending compute on trajectories; choose a training objective that reinforces the capability you want rather than merely reproducing successful-looking behavior; and test the resulting model outside the environment in which that experience was generated. ...

September 3, 2026 · 8 min · Zelina
Cover image

Train the Agent Before the Sandbox Exists

TL;DR for operators A team can have stable API contracts before it has an executable sandbox, populated user state, and reliable integration infrastructure. The usual assumption is that serious multi-step agent training must wait, because later API responses need to reflect what earlier calls changed. ESAT challenges that sequencing. Lee et al. generate stateful training trajectories from API specifications without the target environment, then validate and filter the interactions before training.1 On AppWorld, training with ESAT-S52 trajectories generated from 52 synthetic applications independent of AppWorld improves Task Goal Completion by 8.4 to 47.0 percentage points across evaluated models and usually outperforms training on trajectories collected inside the real AppWorld environment. ...

September 3, 2026 · 7 min · Zelina
Cover image

When More Problems Stop Helping: RL Data Scaling Becomes an Allocation Problem

TL;DR for operators A post-training team with a fixed compute budget has several ways to spend it: add more verified problems, generate variants of existing problems, increase difficulty, or expose the model to structurally different tasks. The usual accounting metric—number of training problems—does not tell the team which choice produces the most useful learning experience. ...

September 3, 2026 · 8 min · Zelina
Cover image

When the Research Workflow Becomes Training Data

TL;DR for operators A team with an expensive research workflow faces a recurring choice: keep paying for the full workflow on every report, or use it to teach a cheaper system how to reproduce much of its behavior. O-Researcher shows why the second option is plausible.1 With the same GPT-5 model, changing research execution from sequential to parallel raises the reported Overall score from 42.92 to 49.60, while Comprehensiveness rises from 40.59 to 49.61. Workflow structure itself is contributing capability. ...

September 3, 2026 · 7 min · Zelina