Rest Gateway

class asset.Inventory | None = None, registry: asset.Registry | None = None, feeds: io.Importer | None = None, processes: int | None = None, loop: asyncio.AbstractEventLoop | None = None, server:[[applications.Starlette, ...], None] =, **options)[source]

Bases: Gateway

Serving gateway implemented as a RESTful API.

The frontend provides the following HTTP endpoints:






Retrieve the Engine-provided performance metrics report.



Prediction request for the given application. The entire request body is passed to the Engine as the layout.Request.payload with the declared content-type indicated via the .encoding and any potential query parameters bundled within the .params.

inventory: asset.Inventory | None = None

Inventory of applications to be served (default as per the platform configuration).

registry: asset.Registry | None = None

Model registry of project artifacts to be served (default as per the platform configuration).

feeds: io.Importer | None = None

Feeds to be used for potential feature augmentation (default as per the platform configuration).

processes: int | None = None

Process pool size for each model sandbox.

loop: asyncio.AbstractEventLoop | None = None

Explicit event loop instance.

server:[[applications.Starlette, ...], None] =

Serving loop main function accepting the provided application instance (defaults to


Additional serving loop keyword arguments (i.e. Uvicorn settings).

The provider can be enabled using the following platform configuration:

 provider = "rest"
 port = 8080
 processes = 3


Select the rest extras to install ForML together with the Starlette/Uvicorn support.