Investigate rewriting simulation in C++ and removing sim code from frontend and gym environment

[duyminh1998]

Description

Explore the feasibility and potential benefits of rewriting the simulation layer in C++ and removing the existing simulation logic from both the frontend and the gym environment.

Purpose

• Understand how a native C++ implementation could impact performance and maintainability.
• Determine what architectural changes would be required in the frontend and gym to integrate with a C++ simulation.

Questions

1. What are the performance gains of a C++ implementation versus the current setup?
2. How would data be passed between the C++ simulation and the frontend/gym layers?
3. What build, deployment, and tooling changes would be necessary for a C++-based simulation?
4. Are there any known libraries or frameworks that could simplify this transition?

Additional Context (optional)

• Consider potential codebase complexity and maintainability.
• Look into existing examples or case studies of similar rewrites to inform best practices.

[duyminh1998]

The entire RL ecosystem built around StarCraft II is a good example, e.g. pysc2, sc2client-proto, and alphastar.

[duyminh1998]

also see https://github.com/Panopticon-AI-team/panopticon/tree/15-create-a-server for previous work