Use Redis for the communication between Server and Engine

[MarceloRGonc]

Part of OPS-2396.

Additional Notes

• Save the requests to the engine in cache
• Save the responses from the engine in cache
• Save the run progress requests in cache

[linear]

OPS-2396 Change the server's communication with the engine to use redis

[Copilot]

Pull Request Overview

This PR introduces Redis-based communication between the Server and Engine components, replacing direct HTTP request/response data exchange with a cache-based approach using body access keys.

• Replaces direct request/response body transmission with Redis cache storage and retrieval
• Implements BodyAccessKeyRequest pattern for referencing cached data via access keys
• Adds body converter module registration to both server API and engine components

Reviewed Changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated no comments.

Show a summary per file

File	Description
packages/server/worker/src/lib/engine/call-engine.ts	Implements request body caching before engine calls and response retrieval using access keys
packages/server/api/src/app/app.ts	Registers the body converter module for Redis-based request/response handling
packages/engine/src/main.ts	Updates EngineRequest schema to include requestId and use Type.Unknown for engineInput
packages/engine/src/lib/services/progress.service.ts	Modifies progress update requests to use cached request bodies via access keys
packages/engine/src/lambda-handler.ts	Updates lambda handler to retrieve request body from cache and return response keys
packages/engine/src/engine-executor.ts	Changes engine executor to cache response data and return access keys instead of direct responses
packages/engine/src/api-handler.ts	Updates API handler to work with cached request bodies and return access keys

---

_{Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.}

[maor-rozenfeld]

Test the two types of deployments

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarQube Cloud