ArchBench Dynamic Service Generation

Dynamic Service Generation: Generate IoT services dynamically from task descriptions and runtime context.

3rows
f1primary metric
2026-05-06sampled

Metadata

ID
archbench_dynamic_service_generation
Category
Software Engineering
Release
2026-03-18

Metrics

Precision, Recall, F1, F3, Tokens (lower is better)

Latest Results

Rows ranked by f1. ArchBench paper: https://arxiv.org/abs/2603.17833. CLI: https://github.com/sa4s-serc/archbench-cli.

Rank Subject F1 Model Match Provenance Sampled
1 DeepSeek-V2.5 0.88 — Imported 2026-05-06
2 GPT-4o-mini 0.87 — Imported 2026-05-06
3 CodeQwen1.5-7B 0.83 — Imported 2026-05-06