Open source software

CityFlow

Traffic Simulator ยท WWW'19

A multi-agent reinforcement-learning environment for large-scale city traffic scenarios, orders of magnitude faster than SUMO for training RL-based signal control.

SimulatorMARLTraffic

Honor of Kings Arena

MARL Benchmark ยท NeurIPS'22 D&B

A competitive multi-agent reinforcement-learning environment built on Tencent's Honor of Kings MOBA game, designed to benchmark generalization across heroes, lineups, and opponents.

MARLGame AIBenchmark

Instructional Agents

GenAI for Education ยท EACL'26 Main

A multi-agent LLM system that reduces teaching-faculty workload by automating instructional design โ€” lecture plans, slides, quizzes, and course material generation.

LLM AgentsEducationEdTech

IntelliLight

Traffic Signal Control ยท KDD'18

A reinforcement-learning approach for intelligent traffic-light control โ€” one of the earliest deep-RL methods for adaptive signal control on real-world road networks.

RLTraffic Signal

RL_Signals

Community Resource

A curated hub of papers, datasets, simulators, and tutorials covering reinforcement learning for traffic signal control โ€” the go-to reading list for newcomers to the area.

RLTraffic SignalAwesome List

LibSignal

Traffic Signal Control ยท MLJ

A unified open library for traffic signal control with reproducible RL baselines across simulators (CityFlow, SUMO), standardized benchmarks, and cross-simulator evaluation.

RLBenchmarkTraffic Signal

PyDimension

Scientific ML ยท Nature Communications'22

Dimensionless learning โ€” data-driven discovery of dimensionless numbers and scaling laws from scarce experimental measurements, combining physics priors with sparse regression.

Scientific MLPhysicsDiscovery

PromptGAT

Sim-to-Real Transfer ยท AAAI'24

Prompt-to-Transfer: closing the sim-to-real gap for traffic signal control by conditioning a grounded action transformer on natural-language prompts.

Sim-to-RealPrompt LearningTraffic

CoMAL

Multi-Agent LLM ยท SDM'25

Collaborative Multi-Agent Large Language Models for mixed-autonomy traffic โ€” coordinating CAVs and human-driven vehicles via LLM-based negotiation and planning.

Multi-Agent LLMMixed-AutonomyTraffic

CityFlowER

Traffic Simulator

An efficient and realistic traffic simulator with embedded machine-learning vehicle-behavior models, bridging the gap between rule-based speed and data-driven realism.

SimulatorEmbedded MLTraffic

Open-TI

LLM Agent ยท IJMLC

Open Traffic Intelligence โ€” an augmented-language-model agent that turns natural-language instructions into traffic analysis, simulator control, and signal-policy actions end-to-end.

LLM AgentTrafficTool Use