beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-04-23 17:55:42,205 WARNING services.py:2168 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-04-23 17:55:43,378 INFO worker.py:2004 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2052: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=4642) INFO 2026-04-23 17:55:45,742 proxy 172.17.0.2 -- Proxy starting on node 93a35afb036612978b4fe8b2757f718bc42342c6f75c5599a5de5339 (HTTP port: 8000).
INFO 2026-04-23 17:55:45,812 serve 3836 -- Started Serve in namespace "serve".
(ServeController pid=4644) INFO 2026-04-23 17:55:45,856 controller 4644 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4644) INFO 2026-04-23 17:55:45,856 controller 4644 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4642) INFO 2026-04-23 17:55:45,809 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ProxyActor pid=4642) INFO 2026-04-23 17:55:45,860 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4642) INFO 2026-04-23 17:55:45,866 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f429bbefd60>.
(ServeController pid=4644) INFO 2026-04-23 17:55:45,960 controller 4644 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4642) INFO 2026-04-23 17:55:49,790 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[RoutePattern(methods=['POST'], path='/'), RoutePattern(methods=['GET', 'HEAD'], path='/docs'), RoutePattern(methods=['GET', 'HEAD'], path='/docs/oauth2-redirect'), RoutePattern(methods=['GET', 'HEAD'], path='/openapi.json'), RoutePattern(methods=['GET', 'HEAD'], path='/redoc')])}.
INFO 2026-04-23 17:55:49,932 serve 3836 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,147 mnist_classifier_MNISTClassifier yxa49nzn 88dd1649-24cd-4a2b-aed1-a8a007169748 -- POST / 200 495.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,150 mnist_classifier_MNISTClassifier yxa49nzn a3d723b5-49b1-4ac6-a230-b6c77a279e0c -- POST / 200 494.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,151 mnist_classifier_MNISTClassifier yxa49nzn c4de6954-0deb-42f6-bfb2-622cc90c5827 -- POST / 200 494.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,152 mnist_classifier_MNISTClassifier yxa49nzn 7531e2e0-03a4-4f97-bd3d-ec0cbae4e5b5 -- POST / 200 495.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,154 mnist_classifier_MNISTClassifier yxa49nzn 8b38d8e5-11dc-4525-961d-d018358ad30a -- POST / 200 494.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,155 mnist_classifier_MNISTClassifier yxa49nzn f53871dc-99a2-4722-bec8-9c2533f6bbf1 -- POST / 200 494.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,159 mnist_classifier_MNISTClassifier yxa49nzn e2a72899-a553-4356-b993-fae7d4a1d204 -- POST / 200 497.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,162 mnist_classifier_MNISTClassifier yxa49nzn 742d9962-09bc-4cb7-8ecd-8f2ed99a89d2 -- POST / 200 499.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,164 mnist_classifier_MNISTClassifier yxa49nzn e19c63ae-495e-4311-8c5f-706512960240 -- POST / 200 501.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,164 mnist_classifier_MNISTClassifier yxa49nzn c6f6f473-b202-46c1-9f9c-68a091798369 -- POST / 200 500.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,166 mnist_classifier_MNISTClassifier yxa49nzn a7aa18e4-f9fe-4598-8c82-84cd1e173e47 -- POST / 200 502.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,167 mnist_classifier_MNISTClassifier yxa49nzn 49040394-5ccd-4c83-8f9f-ce0a336bf90d -- POST / 200 501.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,168 mnist_classifier_MNISTClassifier yxa49nzn 646f6425-9318-49ed-8d3d-22f425f682b2 -- POST / 200 501.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,171 mnist_classifier_MNISTClassifier yxa49nzn a0ad6aa4-8447-485b-82b8-2e8e8a97857b -- POST / 200 503.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,221 mnist_classifier_MNISTClassifier yxa49nzn ba6bbf78-9615-4279-9dda-edb7d6188546 -- POST / 200 553.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,223 mnist_classifier_MNISTClassifier yxa49nzn d106ab92-e4cf-48b3-ac47-6eed7719bd14 -- POST / 200 553.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,224 mnist_classifier_MNISTClassifier yxa49nzn 0703550c-ffed-42bc-a9d4-9fc1fa44a387 -- POST / 200 554.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,230 mnist_classifier_MNISTClassifier yxa49nzn 58879e36-4110-4d19-ab19-80de64bc7ad4 -- POST / 200 558.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,230 mnist_classifier_MNISTClassifier yxa49nzn f74c2ad2-3a1e-4600-a314-8c985dc4ed3b -- POST / 200 561.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,230 mnist_classifier_MNISTClassifier yxa49nzn fb1a94f4-175e-4f90-a682-cb55e28d6019 -- POST / 200 557.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,231 mnist_classifier_MNISTClassifier yxa49nzn 8d0d05da-01dd-4959-9900-ffe165690dd7 -- POST / 200 558.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,232 mnist_classifier_MNISTClassifier yxa49nzn 15b6ba14-1100-4f52-8d8e-26247c381a58 -- POST / 200 558.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,233 mnist_classifier_MNISTClassifier yxa49nzn 516de903-049f-4797-bb67-5f13c7570965 -- POST / 200 559.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,246 mnist_classifier_MNISTClassifier yxa49nzn 8f4bae31-e7df-4850-a76d-b4190863fbf4 -- POST / 200 571.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,340 mnist_classifier_MNISTClassifier yxa49nzn d955a059-9c53-4070-a2cc-27c4a876030c -- POST / 200 665.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,342 mnist_classifier_MNISTClassifier yxa49nzn fd112056-0403-49ee-a0b5-9366e7a8b17e -- POST / 200 666.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,344 mnist_classifier_MNISTClassifier yxa49nzn 42be1108-83d0-4f6b-85c6-b3eb805d3e28 -- POST / 200 664.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,345 mnist_classifier_MNISTClassifier yxa49nzn e0ea3fe3-2467-4f43-b1d0-76b35aa88d0f -- POST / 200 664.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,346 mnist_classifier_MNISTClassifier yxa49nzn 3e3b6140-a2be-4595-9bd2-ac92b07b1b61 -- POST / 200 664.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,347 mnist_classifier_MNISTClassifier yxa49nzn 178359cf-3b2d-42ab-a385-476e230c8be9 -- POST / 200 662.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,352 mnist_classifier_MNISTClassifier yxa49nzn 44159f9c-acb2-4f3e-b134-d6e70caba4d3 -- POST / 200 666.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,353 mnist_classifier_MNISTClassifier yxa49nzn 358bd306-2047-441d-87a8-d2a94fb95157 -- POST / 200 666.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,355 mnist_classifier_MNISTClassifier yxa49nzn 814cc059-0dcb-4e83-8130-fc0e55ba181b -- POST / 200 668.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,355 mnist_classifier_MNISTClassifier yxa49nzn d6f7ecab-d85f-4374-9034-1a4281879661 -- POST / 200 668.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,355 mnist_classifier_MNISTClassifier yxa49nzn 864e9071-76f9-45ea-8cbf-586c3e010af2 -- POST / 200 666.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,356 mnist_classifier_MNISTClassifier yxa49nzn 0c56d2af-c74b-4203-b82a-51edede09adb -- POST / 200 666.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,357 mnist_classifier_MNISTClassifier yxa49nzn 08544f71-ce95-48dd-a1b6-2f07e1f9798c -- POST / 200 664.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,357 mnist_classifier_MNISTClassifier yxa49nzn 050fab22-9bd7-4107-ac24-0cd4fea08fa2 -- POST / 200 664.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,359 mnist_classifier_MNISTClassifier yxa49nzn 49e7a85f-485c-4904-94b7-1ec3112ed818 -- POST / 200 664.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,360 mnist_classifier_MNISTClassifier yxa49nzn 1e13aadd-5a64-4510-98cb-f3d0ea72b9b3 -- POST / 200 662.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,360 mnist_classifier_MNISTClassifier yxa49nzn 9974783b-c31f-48ee-9af5-6d0f2acd2164 -- POST / 200 662.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,360 mnist_classifier_MNISTClassifier yxa49nzn 89f53159-89bb-4d5e-93d3-5545a40ef3e6 -- POST / 200 662.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,360 mnist_classifier_MNISTClassifier yxa49nzn 9eb21aba-195b-4ff7-843a-8c04f52942bd -- POST / 200 658.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,361 mnist_classifier_MNISTClassifier yxa49nzn 1a0e7f17-4590-4543-9e99-849e6f363b83 -- POST / 200 658.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,362 mnist_classifier_MNISTClassifier yxa49nzn 3a46c8ba-3495-47aa-8ab3-1c95f23f7cf2 -- POST / 200 658.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,363 mnist_classifier_MNISTClassifier yxa49nzn ffe84cbc-b5bb-44fb-be35-cf5dd76ef882 -- POST / 200 660.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,364 mnist_classifier_MNISTClassifier yxa49nzn 6d04d3ae-41da-450a-bd8c-549ee7eebf45 -- POST / 200 535.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,365 mnist_classifier_MNISTClassifier yxa49nzn 1ac95f94-014f-4ee9-89b0-a8cfc6ef5da1 -- POST / 200 533.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,365 mnist_classifier_MNISTClassifier yxa49nzn a87ea9fc-c323-4b24-84df-9319711ab7a6 -- POST / 200 533.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,366 mnist_classifier_MNISTClassifier yxa49nzn c10c8a07-dd8c-4eb7-a616-50c2e79d3703 -- POST / 200 524.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,367 mnist_classifier_MNISTClassifier yxa49nzn afa92941-f9e0-49b9-88a7-5cc4e4254973 -- POST / 200 535.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,368 mnist_classifier_MNISTClassifier yxa49nzn 480442c9-2f2b-4dd8-9b12-2ca6a714ee79 -- POST / 200 535.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,369 mnist_classifier_MNISTClassifier yxa49nzn c32c6baa-bfb1-461b-81b5-183efcb10d7a -- POST / 200 535.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,369 mnist_classifier_MNISTClassifier yxa49nzn a5bff41c-2d50-4a62-924c-3a426ee16828 -- POST / 200 535.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,370 mnist_classifier_MNISTClassifier yxa49nzn e37fb95f-e441-4f79-9300-3ddb2a9ee0b0 -- POST / 200 534.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,371 mnist_classifier_MNISTClassifier yxa49nzn 00e9ac78-c3cf-4f4a-86f3-84b6b9fb5e3a -- POST / 200 535.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,372 mnist_classifier_MNISTClassifier yxa49nzn d4ebc483-a2f7-449b-88a0-5d26ccc7e4aa -- POST / 200 535.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,372 mnist_classifier_MNISTClassifier yxa49nzn 3effa771-f1c8-4a82-af9c-62f676d48a92 -- POST / 200 533.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,381 mnist_classifier_MNISTClassifier yxa49nzn bb8ad76b-9842-4135-8c89-663ec70f9161 -- POST / 200 541.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,381 mnist_classifier_MNISTClassifier yxa49nzn e8f73218-431a-41ee-9105-03b543338bfb -- POST / 200 539.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,381 mnist_classifier_MNISTClassifier yxa49nzn 8477585d-70e5-4556-9e2b-306b9eab6d88 -- POST / 200 539.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,382 mnist_classifier_MNISTClassifier yxa49nzn de9c5933-8ebe-4d12-b302-22e15f0090c4 -- POST / 200 537.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,383 mnist_classifier_MNISTClassifier yxa49nzn aba7849e-ad45-499e-9485-e8bc11ea3669 -- POST / 200 538.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,383 mnist_classifier_MNISTClassifier yxa49nzn b10cb89d-69e5-4ede-80d7-f2c95bc00840 -- POST / 200 537.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,384 mnist_classifier_MNISTClassifier yxa49nzn 7a72eff3-2793-451f-ab67-f6a992ed2b3b -- POST / 200 536.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,384 mnist_classifier_MNISTClassifier yxa49nzn 4b57315f-204c-40eb-86d8-35458e090103 -- POST / 200 536.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,384 mnist_classifier_MNISTClassifier yxa49nzn f5fd4887-a4d2-4db5-8ae2-7986c26c8519 -- POST / 200 536.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,384 mnist_classifier_MNISTClassifier yxa49nzn a6cc0568-4237-49aa-999a-328bd961b92b -- POST / 200 535.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,385 mnist_classifier_MNISTClassifier yxa49nzn 12402b95-1fd9-4ae3-aba3-6a8612d824a2 -- POST / 200 535.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,385 mnist_classifier_MNISTClassifier yxa49nzn df8b777d-eafb-42a5-89c8-d759e0d41255 -- POST / 200 535.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,385 mnist_classifier_MNISTClassifier yxa49nzn 2fffa8cb-e52f-47ea-923e-ed6c3525ac17 -- POST / 200 535.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,385 mnist_classifier_MNISTClassifier yxa49nzn 762a8791-4f82-4f67-a65a-aa7a035b208f -- POST / 200 531.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,385 mnist_classifier_MNISTClassifier yxa49nzn a4ef5a08-708c-4b83-b151-79c3963f361f -- POST / 200 530.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,386 mnist_classifier_MNISTClassifier yxa49nzn bda0ccae-9cc2-491f-a004-e8882a87453a -- POST / 200 530.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,386 mnist_classifier_MNISTClassifier yxa49nzn 2332b0f4-5965-4567-b25c-c7d100f5115d -- POST / 200 528.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,429 mnist_classifier_MNISTClassifier yxa49nzn 726bf59f-30a3-418e-bf37-477f9abe83ed -- POST / 200 571.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,430 mnist_classifier_MNISTClassifier yxa49nzn c3710a48-b765-43a8-ac8d-1867ac6d8746 -- POST / 200 572.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,436 mnist_classifier_MNISTClassifier yxa49nzn f216b13f-2a68-40c2-8b26-abc61c7a41f3 -- POST / 200 575.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,437 mnist_classifier_MNISTClassifier yxa49nzn fe8c0436-6f2b-4621-abf5-f29c113ddcc2 -- POST / 200 576.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,438 mnist_classifier_MNISTClassifier yxa49nzn 3b810dff-11f2-4043-bd76-d4e62167542b -- POST / 200 575.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,439 mnist_classifier_MNISTClassifier yxa49nzn 9e5d03da-f29b-428e-935f-03c2d3e1bc7a -- POST / 200 574.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,440 mnist_classifier_MNISTClassifier yxa49nzn 8ef3fa10-284b-4b35-8771-a83b5b2a37b4 -- POST / 200 575.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,440 mnist_classifier_MNISTClassifier yxa49nzn 00c745d1-ecb5-4332-83a7-d2cac2f5db18 -- POST / 200 575.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,441 mnist_classifier_MNISTClassifier yxa49nzn f687e443-9564-48d2-bb39-7cd52038ebaa -- POST / 200 575.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,442 mnist_classifier_MNISTClassifier yxa49nzn e9d46e38-5fee-4524-ac0e-ca31dd221532 -- POST / 200 575.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,442 mnist_classifier_MNISTClassifier yxa49nzn caf912eb-8b17-46b3-b39e-be68d8719063 -- POST / 200 575.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,442 mnist_classifier_MNISTClassifier yxa49nzn 40ac5277-f1ab-463d-8fec-a162cdcab265 -- POST / 200 575.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,442 mnist_classifier_MNISTClassifier yxa49nzn dc544600-561a-4fbb-b0f7-3dc90c61bf01 -- POST / 200 574.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,443 mnist_classifier_MNISTClassifier yxa49nzn 2ffcc0bb-24c3-4422-b4ab-d620ea66ec7e -- POST / 200 573.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,443 mnist_classifier_MNISTClassifier yxa49nzn a86c3b4a-8b0a-4195-b0d1-adaf5264547a -- POST / 200 573.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,443 mnist_classifier_MNISTClassifier yxa49nzn c7969edc-a9fb-491b-8e59-c44f40b2b339 -- POST / 200 572.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,443 mnist_classifier_MNISTClassifier yxa49nzn c1204943-c0da-4f97-8945-35710571e13e -- POST / 200 572.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,444 mnist_classifier_MNISTClassifier yxa49nzn 5663bff0-a415-49c0-b120-7664093fbd68 -- POST / 200 570.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,444 mnist_classifier_MNISTClassifier yxa49nzn e75d67ab-d2fd-46a3-ad84-a9d5209e6ce9 -- POST / 200 570.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,444 mnist_classifier_MNISTClassifier yxa49nzn f2dcc10a-0cff-48ad-99bf-6d4414b44485 -- POST / 200 570.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,445 mnist_classifier_MNISTClassifier yxa49nzn d78ef2a6-d039-4d1a-bac3-5bbdcd3cbfb0 -- POST / 200 570.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,446 mnist_classifier_MNISTClassifier yxa49nzn 065d49ac-5995-45e0-b150-9869c04d2b06 -- POST / 200 570.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,446 mnist_classifier_MNISTClassifier yxa49nzn 528e357f-9403-4261-a560-459837b1d910 -- POST / 200 570.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,446 mnist_classifier_MNISTClassifier yxa49nzn a165f52b-ff21-4222-87a9-b6874048fbf2 -- POST / 200 570.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,448 mnist_classifier_MNISTClassifier yxa49nzn a1d5430f-8fe8-4930-959b-60cf98a994b1 -- POST / 200 571.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,448 mnist_classifier_MNISTClassifier yxa49nzn 632a81cd-fbd4-4ec0-b2be-bc9a564f359d -- POST / 200 289.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,448 mnist_classifier_MNISTClassifier yxa49nzn 52b8d6ce-1a82-4f5a-b65e-d6aa8bfbad60 -- POST / 200 289.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,449 mnist_classifier_MNISTClassifier yxa49nzn e393fd00-f4c2-4218-9b94-68fd8a55cf57 -- POST / 200 290.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,450 mnist_classifier_MNISTClassifier yxa49nzn f2054b97-3b96-446d-b8da-ed46e299f79f -- POST / 200 290.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,450 mnist_classifier_MNISTClassifier yxa49nzn 2333061c-47db-4191-bc32-2cb27ad6df29 -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,450 mnist_classifier_MNISTClassifier yxa49nzn 5028bccf-cd79-45ac-a4d9-bc7052d37117 -- POST / 200 284.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,451 mnist_classifier_MNISTClassifier yxa49nzn 11bcf7aa-0e3a-4730-aa89-62cc6ee653fc -- POST / 200 284.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,452 mnist_classifier_MNISTClassifier yxa49nzn c0bb8c6b-b3fa-4527-91d3-6dcb83fe9db1 -- POST / 200 279.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,453 mnist_classifier_MNISTClassifier yxa49nzn f7b33dc7-595d-42e6-9e6d-c28b4d785076 -- POST / 200 275.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,454 mnist_classifier_MNISTClassifier yxa49nzn 8c9a2f4c-4c9c-4cc1-9948-88fb32470349 -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,460 mnist_classifier_MNISTClassifier yxa49nzn 11b81647-2872-42a1-9784-6d0a64f5dcd4 -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,460 mnist_classifier_MNISTClassifier yxa49nzn b186a334-6512-4b25-8d80-2879ae34d34c -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,461 mnist_classifier_MNISTClassifier yxa49nzn b3111f4d-fdd9-4bb7-aa4d-fd59c8817518 -- POST / 200 276.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,461 mnist_classifier_MNISTClassifier yxa49nzn 07284112-7e56-4335-939d-8b12825c4520 -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,461 mnist_classifier_MNISTClassifier yxa49nzn 851c034e-1bb4-4fbe-a133-86c678b772e0 -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,462 mnist_classifier_MNISTClassifier yxa49nzn b36fb01c-82a9-4958-83af-35e99b84ad1a -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,463 mnist_classifier_MNISTClassifier yxa49nzn 32735775-4f0d-486e-9db9-8b734a1f858c -- POST / 200 245.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,463 mnist_classifier_MNISTClassifier yxa49nzn 5550e7da-4527-4813-80d1-888ee3fc3fa0 -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,464 mnist_classifier_MNISTClassifier yxa49nzn 24621f5a-2f74-454d-9e77-cca2e3345c04 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,464 mnist_classifier_MNISTClassifier yxa49nzn be41a614-f3a4-49c5-8c99-110f35a112a2 -- POST / 200 213.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,465 mnist_classifier_MNISTClassifier yxa49nzn 74203b18-242a-4bea-887b-c27427b4aa52 -- POST / 200 213.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,466 mnist_classifier_MNISTClassifier yxa49nzn 6749369b-f371-4504-8ced-68d41d9ca62d -- POST / 200 208.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,467 mnist_classifier_MNISTClassifier yxa49nzn 2e751b95-5ce2-4618-904d-400f7b4d8533 -- POST / 200 207.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,468 mnist_classifier_MNISTClassifier yxa49nzn cb6d948c-785c-4683-be58-c0c9686e8d68 -- POST / 200 208.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,616 mnist_classifier_MNISTClassifier yxa49nzn b55886f5-d720-4cd5-a8c0-8e28f9e5a601 -- POST / 200 258.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,619 mnist_classifier_MNISTClassifier yxa49nzn 719091b9-48ec-4978-a612-ef9effc31eca -- POST / 200 260.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,620 mnist_classifier_MNISTClassifier yxa49nzn 609f141d-b2cd-4d3c-88e5-99e8796aa0a4 -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,621 mnist_classifier_MNISTClassifier yxa49nzn ffee48be-d3f8-4cc1-8e02-a632a503cfc6 -- POST / 200 262.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,630 mnist_classifier_MNISTClassifier yxa49nzn f7ef0611-dff1-41e8-ac8c-e7154f7eaf6c -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,633 mnist_classifier_MNISTClassifier yxa49nzn 30b1de67-77cd-4e10-bbc8-f1f76a83f8a5 -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,635 mnist_classifier_MNISTClassifier yxa49nzn ec2a3efc-2a19-4924-919b-81ee02be1828 -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,636 mnist_classifier_MNISTClassifier yxa49nzn 842a489d-32fc-4bdd-a604-38f15ee6b481 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,636 mnist_classifier_MNISTClassifier yxa49nzn e1021f11-b980-41c5-bfc2-4c0dcedad4cc -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,636 mnist_classifier_MNISTClassifier yxa49nzn db56a71d-a663-441c-b655-9b74f79648bc -- POST / 200 249.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,637 mnist_classifier_MNISTClassifier yxa49nzn e57b43ae-d832-4913-8944-ad386c68b5f6 -- POST / 200 247.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,639 mnist_classifier_MNISTClassifier yxa49nzn d36276c9-47de-4787-8689-ee9c8476d9c8 -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,641 mnist_classifier_MNISTClassifier yxa49nzn e93bdc95-ef82-4336-ab4c-335487fb8325 -- POST / 200 247.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,642 mnist_classifier_MNISTClassifier yxa49nzn d12ffa99-5db7-4569-94b0-60b79eaf8173 -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,642 mnist_classifier_MNISTClassifier yxa49nzn 9dce5733-7098-4a43-88cd-73e21fda10b5 -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,643 mnist_classifier_MNISTClassifier yxa49nzn f96e2068-e5fe-4c95-aa68-9890955cd5b1 -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,643 mnist_classifier_MNISTClassifier yxa49nzn 00cce477-80d0-4af2-b231-828e8add6226 -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,644 mnist_classifier_MNISTClassifier yxa49nzn e4e5d306-2fe0-4d1a-b5ee-d6e352668c40 -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,646 mnist_classifier_MNISTClassifier yxa49nzn 5af55cb4-c425-4800-aed2-b5f58813a7f0 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,647 mnist_classifier_MNISTClassifier yxa49nzn baf920a2-5234-40eb-a4f3-d223b44d6606 -- POST / 200 249.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,648 mnist_classifier_MNISTClassifier yxa49nzn 560d4240-fdd9-4dd6-9867-34dafb0e1053 -- POST / 200 249.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,649 mnist_classifier_MNISTClassifier yxa49nzn a1adb98c-0dbf-4e29-9f70-b51e78fa0e16 -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,649 mnist_classifier_MNISTClassifier yxa49nzn c47d6215-2ba2-4a83-aef9-d33ebf9bc61d -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,651 mnist_classifier_MNISTClassifier yxa49nzn 2da4c087-647e-485c-8fdd-b5a853ada5d3 -- POST / 200 247.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,651 mnist_classifier_MNISTClassifier yxa49nzn 13363b3a-4b66-4558-bcfb-7f602d0afce1 -- POST / 200 242.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,651 mnist_classifier_MNISTClassifier yxa49nzn b229826c-efb9-4751-ba32-6f51430273e1 -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,651 mnist_classifier_MNISTClassifier yxa49nzn 57378dac-b1c2-4d96-8271-9e24fafc9768 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,651 mnist_classifier_MNISTClassifier yxa49nzn fd9f87df-7485-4356-8ee9-7bbe11788492 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,761 mnist_classifier_MNISTClassifier yxa49nzn 0ede9ad0-1017-47c5-ad8d-ec01a3537a2a -- POST / 200 342.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,762 mnist_classifier_MNISTClassifier yxa49nzn 7187bbb1-d5b8-4ae4-a113-3faaa0be175e -- POST / 200 343.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,763 mnist_classifier_MNISTClassifier yxa49nzn fce70eae-7347-40be-8661-649eb3f76eb7 -- POST / 200 344.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,764 mnist_classifier_MNISTClassifier yxa49nzn 4df8d245-b68d-495c-951e-a380f1da78c6 -- POST / 200 325.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,765 mnist_classifier_MNISTClassifier yxa49nzn bc5af0a8-70a9-420d-b7a3-d14b9e299279 -- POST / 200 320.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,766 mnist_classifier_MNISTClassifier yxa49nzn 90343680-db49-421b-aae0-03f49e13a74c -- POST / 200 303.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,767 mnist_classifier_MNISTClassifier yxa49nzn 4a3c56fc-9e99-40bf-a98d-6c29261fef39 -- POST / 200 301.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,767 mnist_classifier_MNISTClassifier yxa49nzn 9147a8d6-192a-49ff-87ba-add8290e5798 -- POST / 200 301.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,768 mnist_classifier_MNISTClassifier yxa49nzn c931c724-92bf-4de6-8b23-a7ae1f5cb450 -- POST / 200 296.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,769 mnist_classifier_MNISTClassifier yxa49nzn 190a21e1-a5e9-49dd-8b78-50ce8c9b274b -- POST / 200 296.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,769 mnist_classifier_MNISTClassifier yxa49nzn 0d7ef497-777f-4057-8ad6-8ed402c9b934 -- POST / 200 296.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,769 mnist_classifier_MNISTClassifier yxa49nzn 3370e8e4-3526-40ff-9822-cf2349bd99e6 -- POST / 200 293.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,770 mnist_classifier_MNISTClassifier yxa49nzn 6a5adb9a-e742-4222-ab96-fc2235bd063a -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,771 mnist_classifier_MNISTClassifier yxa49nzn 8297c260-3b14-41b6-a00a-170e02000fce -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,771 mnist_classifier_MNISTClassifier yxa49nzn e78c057e-5aa6-4fd3-851e-90c9cd9c1041 -- POST / 200 293.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,771 mnist_classifier_MNISTClassifier yxa49nzn c04be22d-c65f-4630-8aa6-2ca57dbc381d -- POST / 200 292.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,772 mnist_classifier_MNISTClassifier yxa49nzn bab25390-c8e8-4a35-a339-7e1ed07b6cbe -- POST / 200 292.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,772 mnist_classifier_MNISTClassifier yxa49nzn edc033cd-c9b8-4bf3-a593-b40a65b7369a -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,773 mnist_classifier_MNISTClassifier yxa49nzn 7f857da6-ca24-4cb8-9f5e-b6208884d7ce -- POST / 200 289.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,774 mnist_classifier_MNISTClassifier yxa49nzn 68bd7fe3-91f4-4f54-ac9c-2c509139c944 -- POST / 200 287.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,776 mnist_classifier_MNISTClassifier yxa49nzn 144cda4c-1713-44e4-be5e-d94c454e469e -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,777 mnist_classifier_MNISTClassifier yxa49nzn 029bb28e-cd24-4dd5-9bf8-a528e5ccdcf0 -- POST / 200 287.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,777 mnist_classifier_MNISTClassifier yxa49nzn 0ee7b273-7063-4c88-a2e6-a2fb74a1d616 -- POST / 200 287.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,777 mnist_classifier_MNISTClassifier yxa49nzn ba29fcba-3983-443d-b048-0e4970d25101 -- POST / 200 285.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,777 mnist_classifier_MNISTClassifier yxa49nzn cf459c65-3dda-4614-892e-fc9c7656f09a -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,778 mnist_classifier_MNISTClassifier yxa49nzn 8f0cca50-0955-40a1-b50a-a733fa6014a9 -- POST / 200 276.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,784 mnist_classifier_MNISTClassifier yxa49nzn be9ed6ff-f44a-4ef8-9d33-af2ecc11d1d8 -- POST / 200 280.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,786 mnist_classifier_MNISTClassifier yxa49nzn 8c85fc28-d41c-4d70-a671-7575670cd27b -- POST / 200 276.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,787 mnist_classifier_MNISTClassifier yxa49nzn 54b18a78-d14a-4da9-805f-b3b81fee341d -- POST / 200 276.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,787 mnist_classifier_MNISTClassifier yxa49nzn 1de6debb-14c4-46c6-a414-5ee946697792 -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,787 mnist_classifier_MNISTClassifier yxa49nzn 5d0c2b55-d1ea-407e-ac54-fde02a845d58 -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,788 mnist_classifier_MNISTClassifier yxa49nzn d6455cf4-e133-4283-b318-4985dd3a2d30 -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,791 mnist_classifier_MNISTClassifier yxa49nzn 98933b0c-1e2b-47bb-aa8f-8fa10b4e48d6 -- POST / 200 272.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,792 mnist_classifier_MNISTClassifier yxa49nzn 4c736553-f0e8-44cd-b2e7-e7d203c84073 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,792 mnist_classifier_MNISTClassifier yxa49nzn e8f4fa3a-5536-4330-94de-7ce810a8569e -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,792 mnist_classifier_MNISTClassifier yxa49nzn 3be1a05e-97ec-4133-89ed-8fc4474376f3 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,792 mnist_classifier_MNISTClassifier yxa49nzn 91ac09d1-014a-4a4e-86f4-9bfb1f581b4f -- POST / 200 266.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,793 mnist_classifier_MNISTClassifier yxa49nzn 6ee3c51a-af00-4c4e-a240-09170fcba854 -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,793 mnist_classifier_MNISTClassifier yxa49nzn c360da15-1d0f-48bc-bcb3-4362e6525b9a -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,793 mnist_classifier_MNISTClassifier yxa49nzn 1d51508f-b69b-4764-9f88-39a5909ff64f -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,793 mnist_classifier_MNISTClassifier yxa49nzn d2c16576-7831-4117-bafd-97c3a1734afe -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,794 mnist_classifier_MNISTClassifier yxa49nzn 33a2533c-d35d-46e2-9960-f1bc5135c7b2 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,794 mnist_classifier_MNISTClassifier yxa49nzn 8104f942-512d-4ff1-9e8f-43976527e7a3 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,794 mnist_classifier_MNISTClassifier yxa49nzn 9528c6bd-eec4-442b-abfa-c598ce3ddc7c -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,794 mnist_classifier_MNISTClassifier yxa49nzn 6e6e1179-d38c-4f0a-97f7-ada7ca5adaa7 -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,794 mnist_classifier_MNISTClassifier yxa49nzn 8535a5f7-2940-4a5d-a639-1a75a399e2e9 -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,795 mnist_classifier_MNISTClassifier yxa49nzn 18c088d2-0f4f-4768-bea1-1e635d44ce36 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,795 mnist_classifier_MNISTClassifier yxa49nzn 34558aa9-88a2-4bd1-a4e4-b2e4b9c57325 -- POST / 200 252.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,795 mnist_classifier_MNISTClassifier yxa49nzn c8c20541-a24e-4103-baeb-5056f97fcd55 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,795 mnist_classifier_MNISTClassifier yxa49nzn 71243fd0-0d5b-4dcd-8125-236a3215a342 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,795 mnist_classifier_MNISTClassifier yxa49nzn 5f590eaf-b928-4650-8250-d965a43242bc -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,795 mnist_classifier_MNISTClassifier yxa49nzn 2802dc26-238c-40ff-a4e7-a5261aab1fb4 -- POST / 200 251.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,795 mnist_classifier_MNISTClassifier yxa49nzn af116c97-5e28-4f18-8916-c673b8f5608d -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,796 mnist_classifier_MNISTClassifier yxa49nzn 1ff6c6ee-46ba-4312-b557-d5cacf0c71d7 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,796 mnist_classifier_MNISTClassifier yxa49nzn 3fee8d5f-8de8-4bfe-a1fa-1e4bd566246f -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,796 mnist_classifier_MNISTClassifier yxa49nzn 58a053c6-82af-4521-a236-7d3a720eb5c0 -- POST / 200 246.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,796 mnist_classifier_MNISTClassifier yxa49nzn 0badeeeb-842e-4036-939f-f398eb9f7fb1 -- POST / 200 239.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,797 mnist_classifier_MNISTClassifier yxa49nzn 1f0e9aa9-ed31-4341-b2c6-d2cab9ea949b -- POST / 200 232.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,805 mnist_classifier_MNISTClassifier yxa49nzn 3e0b55ea-7d6b-49dd-b1e2-6c8b15305926 -- POST / 200 239.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,806 mnist_classifier_MNISTClassifier yxa49nzn 24739802-aff2-4cf2-b8d4-9de95307da86 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,806 mnist_classifier_MNISTClassifier yxa49nzn b32594b2-b448-4e53-8df0-866ba9bae4eb -- POST / 200 240.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,806 mnist_classifier_MNISTClassifier yxa49nzn e4baa2de-822f-46ee-8dd3-40aa3d426dd7 -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,807 mnist_classifier_MNISTClassifier yxa49nzn 7a3c2f10-4e98-4680-b377-4ed9f208e442 -- POST / 200 239.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,808 mnist_classifier_MNISTClassifier yxa49nzn db62356a-a976-434c-a076-b81eb5de3322 -- POST / 200 169.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,809 mnist_classifier_MNISTClassifier yxa49nzn 8cdb4dc5-3fce-4438-ae0a-dc16d677b1a9 -- POST / 200 157.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,810 mnist_classifier_MNISTClassifier yxa49nzn 5b5793ef-b28c-4452-981e-1d83dd596cb5 -- POST / 200 157.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,810 mnist_classifier_MNISTClassifier yxa49nzn c17ae593-876e-414f-b692-78e8a92f68d3 -- POST / 200 154.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,810 mnist_classifier_MNISTClassifier yxa49nzn 8bb84071-c08a-45f6-9983-7cd8eca8e959 -- POST / 200 152.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,811 mnist_classifier_MNISTClassifier yxa49nzn cc4228eb-e9c2-41ee-8add-b110b19340b3 -- POST / 200 151.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,811 mnist_classifier_MNISTClassifier yxa49nzn f14342ea-1127-4662-8f74-c4ed0a70ebac -- POST / 200 150.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,811 mnist_classifier_MNISTClassifier yxa49nzn 05040fb1-5cf2-44e6-b9f5-8fd91aa4468c -- POST / 200 148.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,811 mnist_classifier_MNISTClassifier yxa49nzn e3339e29-bbc0-4068-a6ff-52f53954cbbb -- POST / 200 144.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,811 mnist_classifier_MNISTClassifier yxa49nzn 06c7b234-3325-416c-9f35-0f27da3f8803 -- POST / 200 147.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,811 mnist_classifier_MNISTClassifier yxa49nzn 18cf0202-4f76-45ac-bd8e-3a5da04dc0c8 -- POST / 200 146.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,812 mnist_classifier_MNISTClassifier yxa49nzn 3ae6f911-f7ae-407d-a492-173ae025e1ec -- POST / 200 143.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,812 mnist_classifier_MNISTClassifier yxa49nzn 240613dc-562b-46fb-a39f-ccbfdaa3fdaa -- POST / 200 143.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,812 mnist_classifier_MNISTClassifier yxa49nzn 0f505e92-c8df-408d-bfac-7194b915b52f -- POST / 200 143.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,812 mnist_classifier_MNISTClassifier yxa49nzn b0689cf7-d823-416f-ac9c-d82cf22743d1 -- POST / 200 143.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,812 mnist_classifier_MNISTClassifier yxa49nzn 50b4eeda-590f-42cf-92db-ba76bef93b1e -- POST / 200 143.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,812 mnist_classifier_MNISTClassifier yxa49nzn 2ef032c2-e095-492d-b99d-4394fae9b2e6 -- POST / 200 143.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,812 mnist_classifier_MNISTClassifier yxa49nzn 22c6c0c0-c061-4624-86b1-d67600d4de1b -- POST / 200 143.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,813 mnist_classifier_MNISTClassifier yxa49nzn dd242daa-9cd3-4da8-a20c-20f7caa49028 -- POST / 200 143.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,813 mnist_classifier_MNISTClassifier yxa49nzn 341ed1ac-96ab-41b4-a6de-6b1c466b05b7 -- POST / 200 142.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,813 mnist_classifier_MNISTClassifier yxa49nzn 6b9a3715-75e4-4255-b391-1e60626908d9 -- POST / 200 141.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,814 mnist_classifier_MNISTClassifier yxa49nzn 45e9769b-a7e9-40f1-9303-e8523ff39079 -- POST / 200 141.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,814 mnist_classifier_MNISTClassifier yxa49nzn ea097353-41e4-4e05-8aca-0ed49f9924c6 -- POST / 200 141.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,814 mnist_classifier_MNISTClassifier yxa49nzn c37f7db8-4a45-49aa-bd46-30fde6b802f1 -- POST / 200 138.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,821 mnist_classifier_MNISTClassifier yxa49nzn d5465f51-5476-4789-a764-43fd379ae8a5 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,822 mnist_classifier_MNISTClassifier yxa49nzn 3dd5c079-9029-4a5e-aab3-8e2d9463e150 -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,823 mnist_classifier_MNISTClassifier yxa49nzn faceaeb3-7391-40d9-af80-8e9b1dfdf65b -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,823 mnist_classifier_MNISTClassifier yxa49nzn e077f757-5d31-4f93-8bb2-a1f206398227 -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,824 mnist_classifier_MNISTClassifier yxa49nzn de871a72-4869-4efe-8fe1-2d8713f3f84e -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,824 mnist_classifier_MNISTClassifier yxa49nzn b29fb30e-7648-4c16-98b8-46328631a79b -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,824 mnist_classifier_MNISTClassifier yxa49nzn e731fc9f-95d8-4e54-b9fe-a0ded15c96ce -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,825 mnist_classifier_MNISTClassifier yxa49nzn ed4ad9ca-51f2-47a9-8720-b52bade35fd1 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:51,825 mnist_classifier_MNISTClassifier yxa49nzn be9174ed-0dc2-4189-95f5-fa3b9ea048f8 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,005 mnist_classifier_MNISTClassifier yxa49nzn 01b1a9c2-f133-41af-97f4-988bb33b9571 -- POST / 200 326.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,018 mnist_classifier_MNISTClassifier yxa49nzn 6ba4b10f-4056-44b8-9b8d-320cbc0c7ad4 -- POST / 200 337.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,020 mnist_classifier_MNISTClassifier yxa49nzn f3576e57-9103-46f2-857b-25699f3f1c5b -- POST / 200 339.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,021 mnist_classifier_MNISTClassifier yxa49nzn 48a8d728-ffe7-4c27-b44c-9348c838531b -- POST / 200 339.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,171 mnist_classifier_MNISTClassifier yxa49nzn 26b78182-7089-47e2-b97b-5387507d8060 -- POST / 200 395.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,172 mnist_classifier_MNISTClassifier yxa49nzn 400ea712-7910-4b1d-abff-7c2c5cccf5d5 -- POST / 200 388.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,172 mnist_classifier_MNISTClassifier yxa49nzn 5d7d788b-972a-41d6-a8f7-348bd19ca55b -- POST / 200 407.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,173 mnist_classifier_MNISTClassifier yxa49nzn 61718146-fc8b-4643-ac6f-1ae23bc51785 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,174 mnist_classifier_MNISTClassifier yxa49nzn 4ee7aa78-520a-4bf9-8354-47d4c386a239 -- POST / 200 376.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,174 mnist_classifier_MNISTClassifier yxa49nzn 52ad42ff-8f4f-4b8c-a276-ae6862d92425 -- POST / 200 377.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,175 mnist_classifier_MNISTClassifier yxa49nzn 94c27db2-d5ad-4e3a-bdcf-4c5eb4c49dfb -- POST / 200 348.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,175 mnist_classifier_MNISTClassifier yxa49nzn 70373d40-351c-49e5-88fe-071eaa1c0ea4 -- POST / 200 339.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,176 mnist_classifier_MNISTClassifier yxa49nzn 2a82005f-a8f4-40d9-bf48-a898b1813400 -- POST / 200 343.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,177 mnist_classifier_MNISTClassifier yxa49nzn dab0b66f-f358-4e53-9c0a-a51f996c7128 -- POST / 200 342.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,177 mnist_classifier_MNISTClassifier yxa49nzn 03d7b564-a106-4d43-b531-755ba49aabf7 -- POST / 200 341.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,178 mnist_classifier_MNISTClassifier yxa49nzn b8ffb109-dba2-4ba1-95e3-567cf03fcc8d -- POST / 200 342.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,181 mnist_classifier_MNISTClassifier yxa49nzn 2995dc0c-efa2-4a91-82ac-8f3476184f90 -- POST / 200 343.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,181 mnist_classifier_MNISTClassifier yxa49nzn be77804c-3dd1-44cd-b0b9-55ccdade98ba -- POST / 200 341.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,181 mnist_classifier_MNISTClassifier yxa49nzn 03a1bdc1-79d4-41fb-8feb-9d8abc22af5b -- POST / 200 343.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,182 mnist_classifier_MNISTClassifier yxa49nzn b9125872-4f8c-45db-97f4-5410ea072ba0 -- POST / 200 341.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,182 mnist_classifier_MNISTClassifier yxa49nzn e7b3e801-da6d-48a1-9040-e29e3c053a20 -- POST / 200 341.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,183 mnist_classifier_MNISTClassifier yxa49nzn 2ae15671-79c8-4a45-9fd7-b7887186044e -- POST / 200 343.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,183 mnist_classifier_MNISTClassifier yxa49nzn a734875f-b037-4591-923d-ca2cc04a16b6 -- POST / 200 341.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,183 mnist_classifier_MNISTClassifier yxa49nzn a59f7981-a27d-4736-9de1-a4aed265d3df -- POST / 200 340.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,184 mnist_classifier_MNISTClassifier yxa49nzn 2205e53c-a853-4f58-8599-36da6cb51114 -- POST / 200 338.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,184 mnist_classifier_MNISTClassifier yxa49nzn ddf4dd2c-0312-42a5-9521-a3ac264d0fe0 -- POST / 200 338.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,184 mnist_classifier_MNISTClassifier yxa49nzn 25a11b77-4078-47c2-a358-80b6c2ee7342 -- POST / 200 338.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,185 mnist_classifier_MNISTClassifier yxa49nzn 0897b474-894b-43c9-b0f6-bb223fd2ad77 -- POST / 200 196.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,185 mnist_classifier_MNISTClassifier yxa49nzn 9c1e348c-165b-4481-8508-57c539c96c02 -- POST / 200 196.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,185 mnist_classifier_MNISTClassifier yxa49nzn 144cb02d-7d7c-4845-afb3-63b3cb8bce1c -- POST / 200 192.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,185 mnist_classifier_MNISTClassifier yxa49nzn b0a722db-b27d-4e9f-862b-a28cc025234d -- POST / 200 192.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,186 mnist_classifier_MNISTClassifier yxa49nzn 4a21915d-2373-4d0f-8906-bfd55be98750 -- POST / 200 192.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,186 mnist_classifier_MNISTClassifier yxa49nzn 8cba816c-a5a1-425d-ba2c-a9032d5ff51e -- POST / 200 192.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,186 mnist_classifier_MNISTClassifier yxa49nzn 84b0550a-6c60-4733-8aa2-2dbb2eb9cddb -- POST / 200 192.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,186 mnist_classifier_MNISTClassifier yxa49nzn a446464f-3411-4b61-9ad4-731aaa81ecb6 -- POST / 200 192.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,187 mnist_classifier_MNISTClassifier yxa49nzn 683eab1a-1c2c-4cc2-8739-abb46d331c44 -- POST / 200 192.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,187 mnist_classifier_MNISTClassifier yxa49nzn 3225d14a-3888-4ec1-8284-b588f0d20230 -- POST / 200 193.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,188 mnist_classifier_MNISTClassifier yxa49nzn 3ea1c243-3ce5-4662-850c-c6fafb0f8a47 -- POST / 200 193.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,190 mnist_classifier_MNISTClassifier yxa49nzn fd3a34eb-f31a-4a95-8a01-00356a6a7445 -- POST / 200 195.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,190 mnist_classifier_MNISTClassifier yxa49nzn 1b7febd6-e6f6-49d9-a8c1-c63996bdd5c7 -- POST / 200 195.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,191 mnist_classifier_MNISTClassifier yxa49nzn e0e93913-aa36-4bfd-902d-a97ed67d7731 -- POST / 200 195.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,196 mnist_classifier_MNISTClassifier yxa49nzn ff764a20-043d-4476-93db-631c9730be40 -- POST / 200 200.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,196 mnist_classifier_MNISTClassifier yxa49nzn a3a5e321-4b48-4c1c-a8e6-e9deb0d1d045 -- POST / 200 200.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,196 mnist_classifier_MNISTClassifier yxa49nzn e9415494-8296-4a48-9250-fa32208c328c -- POST / 200 200.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,197 mnist_classifier_MNISTClassifier yxa49nzn d3126698-feec-4fd8-b263-98fc898441a0 -- POST / 200 200.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,197 mnist_classifier_MNISTClassifier yxa49nzn d7e7591d-050e-4618-8983-ad39540ee34f -- POST / 200 201.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,198 mnist_classifier_MNISTClassifier yxa49nzn d5e4b078-fee8-4101-b37c-d5eae7482d57 -- POST / 200 201.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,198 mnist_classifier_MNISTClassifier yxa49nzn 597819c4-8563-47dd-8c0c-f0d07975ac0a -- POST / 200 201.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,198 mnist_classifier_MNISTClassifier yxa49nzn 6dcc071a-d035-4e23-aee7-39eb23a784e0 -- POST / 200 201.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,200 mnist_classifier_MNISTClassifier yxa49nzn 25c80017-d60a-4e91-8f88-abdcf08da896 -- POST / 200 203.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,201 mnist_classifier_MNISTClassifier yxa49nzn a88f834c-ac6b-4d33-ad3c-f7ed6387443f -- POST / 200 204.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,201 mnist_classifier_MNISTClassifier yxa49nzn f8723243-92b5-48ef-bdd8-0fc7f6ac84ea -- POST / 200 203.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,202 mnist_classifier_MNISTClassifier yxa49nzn 239b17ce-239b-4c52-9598-3807cadb84df -- POST / 200 204.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,202 mnist_classifier_MNISTClassifier yxa49nzn 8dae5577-5e4a-4106-b27f-2e2b11b3dd19 -- POST / 200 203.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,203 mnist_classifier_MNISTClassifier yxa49nzn 3bb2a0f6-7476-4e86-a3b6-87d80be66891 -- POST / 200 205.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,203 mnist_classifier_MNISTClassifier yxa49nzn 92bbedbe-b884-4bfb-bf80-2919a4f8eeff -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,205 mnist_classifier_MNISTClassifier yxa49nzn e2545dfa-7c9f-4e20-9fe9-08bafdb04acd -- POST / 200 206.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,205 mnist_classifier_MNISTClassifier yxa49nzn d2c80b8a-1db8-41a0-8097-68dd1a4924c6 -- POST / 200 207.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,205 mnist_classifier_MNISTClassifier yxa49nzn 79bea36d-a03d-4989-be52-5502e900b150 -- POST / 200 206.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,205 mnist_classifier_MNISTClassifier yxa49nzn 7b55c3d5-c457-4158-a9f8-309a072077cc -- POST / 200 206.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,206 mnist_classifier_MNISTClassifier yxa49nzn 5a56e363-8a43-4a65-b1a2-5da2b49bdc89 -- POST / 200 206.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,206 mnist_classifier_MNISTClassifier yxa49nzn 886ccd2b-4d68-4105-9f44-647ddf27ad9e -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,206 mnist_classifier_MNISTClassifier yxa49nzn 130497b1-620d-4dc3-b838-ee42716a7acf -- POST / 200 205.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,206 mnist_classifier_MNISTClassifier yxa49nzn 4fbc05cd-60bb-45b7-ae9e-220720e01ffc -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,206 mnist_classifier_MNISTClassifier yxa49nzn 596a0480-e423-46a2-800a-815a28307804 -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,206 mnist_classifier_MNISTClassifier yxa49nzn 80922baa-7e8c-453d-8825-f3828a81209c -- POST / 200 206.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,206 mnist_classifier_MNISTClassifier yxa49nzn 5aa3a291-7338-4e6a-ab69-03c8625f0162 -- POST / 200 205.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,207 mnist_classifier_MNISTClassifier yxa49nzn 5c489d84-d440-44e1-8acc-ae34b8c684d4 -- POST / 200 202.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,208 mnist_classifier_MNISTClassifier yxa49nzn 4c0f974b-8bd9-4a30-bb44-2367bd084fc0 -- POST / 200 203.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,210 mnist_classifier_MNISTClassifier yxa49nzn b0165a96-4709-45f6-ae51-57ea3b91156a -- POST / 200 186.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,210 mnist_classifier_MNISTClassifier yxa49nzn 079b85b2-453b-478e-9bc1-3387b1e3d994 -- POST / 200 185.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,210 mnist_classifier_MNISTClassifier yxa49nzn 4afce0e7-7eae-4975-bdd7-be8438d1a9a5 -- POST / 200 181.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,210 mnist_classifier_MNISTClassifier yxa49nzn ff29a112-ddc2-462a-b25b-9c51d8a6199d -- POST / 200 181.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,210 mnist_classifier_MNISTClassifier yxa49nzn dc5a9ecf-e5d2-4b52-8a76-26a9352cae8b -- POST / 200 180.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,211 mnist_classifier_MNISTClassifier yxa49nzn f927dd6e-ef64-4403-8df5-0bb1dc48d3c9 -- POST / 200 177.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,211 mnist_classifier_MNISTClassifier yxa49nzn 46313963-d2ff-47db-99d7-763db2ce9e86 -- POST / 200 177.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,211 mnist_classifier_MNISTClassifier yxa49nzn 8ecdf9b1-342a-4eb9-bb6b-d1838654a49b -- POST / 200 176.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,212 mnist_classifier_MNISTClassifier yxa49nzn 954e8883-95b6-49f4-8b08-523ffa05fdf0 -- POST / 200 175.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,212 mnist_classifier_MNISTClassifier yxa49nzn 1ae7ee69-87b6-4906-8f65-16e778732d1d -- POST / 200 175.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,213 mnist_classifier_MNISTClassifier yxa49nzn 17a4bb71-eb1f-4760-a711-b09a1f06e241 -- POST / 200 175.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,275 mnist_classifier_MNISTClassifier yxa49nzn 2bd5a03c-14ab-4284-809b-7fd585f1dd4c -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,302 mnist_classifier_MNISTClassifier yxa49nzn accfbc57-b71d-4060-bc27-86dcfb330676 -- POST / 200 263.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,304 mnist_classifier_MNISTClassifier yxa49nzn db7fb597-9b67-46db-84f6-3d763d977388 -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,304 mnist_classifier_MNISTClassifier yxa49nzn 3562fc85-d7ee-4ff2-bd9c-e25840434977 -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,304 mnist_classifier_MNISTClassifier yxa49nzn d03cd13d-183a-4281-b637-6ce1eab59831 -- POST / 200 263.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,304 mnist_classifier_MNISTClassifier yxa49nzn c673e92a-62d2-486d-8c67-cf7c26a805c5 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,306 mnist_classifier_MNISTClassifier yxa49nzn 4bdcc9f2-558f-4205-8c85-598d222513bf -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,306 mnist_classifier_MNISTClassifier yxa49nzn 2ea9809e-7f38-455a-9db9-068c0e9274be -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,306 mnist_classifier_MNISTClassifier yxa49nzn c408466f-80d7-4f91-8df8-8332df4bccfc -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,306 mnist_classifier_MNISTClassifier yxa49nzn 714ec622-b3bf-4405-92ac-ad8839d15fa5 -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,306 mnist_classifier_MNISTClassifier yxa49nzn cc96e079-0027-4b5d-ae44-3de676cedea2 -- POST / 200 261.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,306 mnist_classifier_MNISTClassifier yxa49nzn 406d5bad-18e7-4088-bf08-db00d0effb9d -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,307 mnist_classifier_MNISTClassifier yxa49nzn 0dc46548-2e89-44fa-9b57-18e515d9d2b5 -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,307 mnist_classifier_MNISTClassifier yxa49nzn 3e881efa-4a28-42a2-9aba-555ed59b84ad -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,307 mnist_classifier_MNISTClassifier yxa49nzn f25e30bf-ddf9-4b8c-9fa1-e81b34073827 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,307 mnist_classifier_MNISTClassifier yxa49nzn facf2ab2-0371-4535-bfe0-80ddfb536af3 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,307 mnist_classifier_MNISTClassifier yxa49nzn b7021de4-588c-42a4-bf52-11932de041dd -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,308 mnist_classifier_MNISTClassifier yxa49nzn 6e495b40-6b1d-4c02-94ca-77759754746e -- POST / 200 258.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,308 mnist_classifier_MNISTClassifier yxa49nzn a0c246a8-4793-4cf5-ae1d-ff2d173a410e -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,308 mnist_classifier_MNISTClassifier yxa49nzn 619894b0-6f01-4db5-a788-d1bae48260a2 -- POST / 200 259.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,308 mnist_classifier_MNISTClassifier yxa49nzn 5947137a-ed14-4e8e-95e4-2d79bf5f0636 -- POST / 200 258.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,308 mnist_classifier_MNISTClassifier yxa49nzn c3f008a3-f32b-4211-988b-bc131bf1a486 -- POST / 200 257.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,309 mnist_classifier_MNISTClassifier yxa49nzn 15486134-200a-4164-9535-0e0d20a851c3 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,309 mnist_classifier_MNISTClassifier yxa49nzn 831d8792-af85-4420-9082-ed8de6b90105 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,394 mnist_classifier_MNISTClassifier yxa49nzn 31cf349c-028a-4d18-8c84-d94dbca6b27c -- POST / 200 212.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,397 mnist_classifier_MNISTClassifier yxa49nzn 48b37bce-faca-4b63-8011-0f5650c41729 -- POST / 200 196.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,398 mnist_classifier_MNISTClassifier yxa49nzn 0b2f8ce7-3f1e-44c8-b2a1-683d8937140c -- POST / 200 181.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,399 mnist_classifier_MNISTClassifier yxa49nzn 99e533b0-4c31-403c-b341-2c64ba377248 -- POST / 200 181.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,399 mnist_classifier_MNISTClassifier yxa49nzn e92cb45a-0e1a-4816-b7d3-c5a3045a66fa -- POST / 200 166.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,400 mnist_classifier_MNISTClassifier yxa49nzn 2b3e4217-3596-4fb2-9e93-8327ec572c44 -- POST / 200 178.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,400 mnist_classifier_MNISTClassifier yxa49nzn 58195baf-2ab4-4973-bf45-3e856bbd6087 -- POST / 200 178.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,400 mnist_classifier_MNISTClassifier yxa49nzn 2597f8e7-540d-49ba-91cc-7372b89c7877 -- POST / 200 178.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,401 mnist_classifier_MNISTClassifier yxa49nzn 2ceafc8d-612b-4ed9-b245-1501e9ded8c3 -- POST / 200 177.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,407 mnist_classifier_MNISTClassifier yxa49nzn 374cfc40-0d4f-4283-8d04-94536b30cbc1 -- POST / 200 182.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,411 mnist_classifier_MNISTClassifier yxa49nzn f69f26e9-5c67-4d43-9b24-198c2c287032 -- POST / 200 185.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,412 mnist_classifier_MNISTClassifier yxa49nzn 0ce70ced-dec1-4dfc-b7c8-ea7d5bc460c8 -- POST / 200 184.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,412 mnist_classifier_MNISTClassifier yxa49nzn 4e0aba5f-b8ac-47bc-8dfe-bebf4ed9014a -- POST / 200 184.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,414 mnist_classifier_MNISTClassifier yxa49nzn 5f1013a9-0b15-4b64-a5b2-c675738252e9 -- POST / 200 183.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,415 mnist_classifier_MNISTClassifier yxa49nzn c29151fe-90e6-45a7-b400-0bb3831997a7 -- POST / 200 183.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,416 mnist_classifier_MNISTClassifier yxa49nzn 072982fa-61da-4375-b9da-d898b687ebfe -- POST / 200 183.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,420 mnist_classifier_MNISTClassifier yxa49nzn 8a2bd847-154a-4f9c-987d-e06498b30ef1 -- POST / 200 184.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,421 mnist_classifier_MNISTClassifier yxa49nzn f2811d2c-922f-4f04-9a57-564f3c83818a -- POST / 200 183.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,423 mnist_classifier_MNISTClassifier yxa49nzn 55123deb-c184-4ee1-b9b1-88b9b6809b66 -- POST / 200 180.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,425 mnist_classifier_MNISTClassifier yxa49nzn d03e4a13-da11-4278-a112-5c00b3c5903a -- POST / 200 187.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,427 mnist_classifier_MNISTClassifier yxa49nzn 013444b3-e4d2-4912-87c7-7eddaa7ff371 -- POST / 200 179.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,427 mnist_classifier_MNISTClassifier yxa49nzn 2b599322-cfa9-4a21-a42f-525d857d7e08 -- POST / 200 187.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,427 mnist_classifier_MNISTClassifier yxa49nzn b0c58b92-2ee2-49d2-9fcd-f580f79366ed -- POST / 200 186.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,428 mnist_classifier_MNISTClassifier yxa49nzn 576e718b-f4ac-420c-975c-ec84e5d23ac8 -- POST / 200 179.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,429 mnist_classifier_MNISTClassifier yxa49nzn f6f08993-6a98-4a39-bf37-872773a2499f -- POST / 200 175.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,429 mnist_classifier_MNISTClassifier yxa49nzn 2019abd3-75b9-4dc0-b407-5aaceae217d7 -- POST / 200 179.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,431 mnist_classifier_MNISTClassifier yxa49nzn 82253e68-ef47-43b5-b002-040478639890 -- POST / 200 179.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,431 mnist_classifier_MNISTClassifier yxa49nzn 7c5161aa-178d-429f-a1c8-0087754c9491 -- POST / 200 179.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,431 mnist_classifier_MNISTClassifier yxa49nzn 3a2b56b1-9cee-4e18-8a08-1aac9520ee3a -- POST / 200 175.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,431 mnist_classifier_MNISTClassifier yxa49nzn 3a8b4162-b536-4591-8c4c-a2c8497546d1 -- POST / 200 176.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,522 mnist_classifier_MNISTClassifier yxa49nzn d94ad23f-7998-4383-a0f8-46481309c5a7 -- POST / 200 211.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,526 mnist_classifier_MNISTClassifier yxa49nzn 24abcd39-cc51-4b97-a7a3-50d5b3a356b0 -- POST / 200 269.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,529 mnist_classifier_MNISTClassifier yxa49nzn 10e5faed-3c77-4645-8c5a-0611e5711520 -- POST / 200 271.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,529 mnist_classifier_MNISTClassifier yxa49nzn d76881fa-2094-4fb4-8075-15ecba776afe -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,530 mnist_classifier_MNISTClassifier yxa49nzn 40126cbc-42b6-4903-8445-191afa994a9e -- POST / 200 220.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,531 mnist_classifier_MNISTClassifier yxa49nzn bc2b6279-f3be-408d-9281-eeefda18ad30 -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,531 mnist_classifier_MNISTClassifier yxa49nzn 380f36c1-f473-42fd-ae70-1266aa0598ed -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,532 mnist_classifier_MNISTClassifier yxa49nzn 7a07b718-9abc-4eb7-98b5-f4a8e316e3fb -- POST / 200 221.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,532 mnist_classifier_MNISTClassifier yxa49nzn 1960de7a-1b24-4631-8250-ebbc547747a1 -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,533 mnist_classifier_MNISTClassifier yxa49nzn ba2e3df0-f5de-4e35-bcc6-5521192783cf -- POST / 200 221.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,533 mnist_classifier_MNISTClassifier yxa49nzn 93736f57-ea76-4e70-bfcc-083e0f4703a9 -- POST / 200 221.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,536 mnist_classifier_MNISTClassifier yxa49nzn e3093d46-051e-41a7-8c75-80ca87229ec2 -- POST / 200 224.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,537 mnist_classifier_MNISTClassifier yxa49nzn 163ae4e7-33de-4e50-9f35-47209b3f07e0 -- POST / 200 225.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,537 mnist_classifier_MNISTClassifier yxa49nzn 1af2b9aa-94fc-4e9c-a28d-7244810c208d -- POST / 200 225.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,538 mnist_classifier_MNISTClassifier yxa49nzn 8c319d63-fb62-45cf-b653-46a47b979d86 -- POST / 200 225.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,539 mnist_classifier_MNISTClassifier yxa49nzn 6bccad9c-7815-4b2f-aeee-2a988385e423 -- POST / 200 225.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,540 mnist_classifier_MNISTClassifier yxa49nzn 50af4e00-99a6-400f-9fdd-bc2a7e3584f9 -- POST / 200 226.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,540 mnist_classifier_MNISTClassifier yxa49nzn eb7f208f-c21b-4ebc-b8b8-ceba7153624e -- POST / 200 227.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,542 mnist_classifier_MNISTClassifier yxa49nzn 3ed517d0-a593-4496-8aae-c8fb3648d1e1 -- POST / 200 228.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,543 mnist_classifier_MNISTClassifier yxa49nzn fd1720ac-2690-43e1-a91e-ae8b81a22c88 -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,544 mnist_classifier_MNISTClassifier yxa49nzn 7b8faf08-04c5-4fa6-9b80-fa010ff1fc7f -- POST / 200 208.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,545 mnist_classifier_MNISTClassifier yxa49nzn 129e9ac1-7ad0-40f2-90ab-968c5f5352e9 -- POST / 200 208.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,545 mnist_classifier_MNISTClassifier yxa49nzn ddbaa460-8d79-4744-b385-8dc01ec67e12 -- POST / 200 207.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,545 mnist_classifier_MNISTClassifier yxa49nzn c4f83292-b0df-4887-8ca1-b8b0095f55c2 -- POST / 200 204.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,549 mnist_classifier_MNISTClassifier yxa49nzn 1e45233e-9a2f-4b09-bbc6-1744d7cce598 -- POST / 200 207.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,551 mnist_classifier_MNISTClassifier yxa49nzn 57a59b85-8eb6-4fd1-8669-e76331f257e3 -- POST / 200 209.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,551 mnist_classifier_MNISTClassifier yxa49nzn e053b773-8085-43de-9cd6-72079ab0aeaf -- POST / 200 206.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,551 mnist_classifier_MNISTClassifier yxa49nzn 35fde041-b3a0-4307-a6f4-08dbe4cbec92 -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,775 mnist_classifier_MNISTClassifier yxa49nzn 61558364-a4d2-41b2-897c-8e7815d62312 -- POST / 200 428.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,778 mnist_classifier_MNISTClassifier yxa49nzn 1193ae16-06f0-4b7b-b928-66e09f785d57 -- POST / 200 431.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,778 mnist_classifier_MNISTClassifier yxa49nzn 81d81270-79d3-43d1-9ed2-e1434a7e9eda -- POST / 200 430.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,778 mnist_classifier_MNISTClassifier yxa49nzn 4baa9710-83ad-4c1e-b7cc-88b9b53bf6ef -- POST / 200 429.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,780 mnist_classifier_MNISTClassifier yxa49nzn f4a6fae7-fdba-411d-b849-aa059d28269a -- POST / 200 430.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,780 mnist_classifier_MNISTClassifier yxa49nzn fe5cb5d4-5dfd-4556-a1ad-479e7a4d5942 -- POST / 200 430.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,783 mnist_classifier_MNISTClassifier yxa49nzn e7fee3e3-a9bc-45e3-a3ac-e9e4b77b1b7a -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,786 mnist_classifier_MNISTClassifier yxa49nzn e6ea2e28-b0df-46de-a4f0-97ba342d862d -- POST / 200 436.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,815 mnist_classifier_MNISTClassifier yxa49nzn cbbe8d4a-cf05-49de-bb5c-47dec4656084 -- POST / 200 462.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,817 mnist_classifier_MNISTClassifier yxa49nzn c1258a04-7da0-4499-9491-5c8dbbcb05ac -- POST / 200 464.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,817 mnist_classifier_MNISTClassifier yxa49nzn 165593e3-f460-4fd2-883f-d9a25960eaef -- POST / 200 462.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,818 mnist_classifier_MNISTClassifier yxa49nzn bb3a3f94-9304-481f-b255-841f9ec760ae -- POST / 200 462.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,818 mnist_classifier_MNISTClassifier yxa49nzn 9a3bb7a2-79ef-439b-aa07-9ae243720e4d -- POST / 200 461.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,819 mnist_classifier_MNISTClassifier yxa49nzn 2b5a9fec-612a-4860-b074-b7a176925166 -- POST / 200 462.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,820 mnist_classifier_MNISTClassifier yxa49nzn a68fcd77-2983-45e4-a0ca-b4be5253d80d -- POST / 200 462.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,820 mnist_classifier_MNISTClassifier yxa49nzn f1b5981d-9757-4d00-a7ab-f3255ff18e0f -- POST / 200 460.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,953 mnist_classifier_MNISTClassifier yxa49nzn 2793c5d3-4e0d-48f1-800f-33f360747daf -- POST / 200 593.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,954 mnist_classifier_MNISTClassifier yxa49nzn 95972318-a825-4410-8210-e9dcb3b6fbce -- POST / 200 593.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,954 mnist_classifier_MNISTClassifier yxa49nzn 3303ed6d-7e16-4dc5-b2ab-4a65780030ea -- POST / 200 534.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,955 mnist_classifier_MNISTClassifier yxa49nzn 37df88f8-7dda-47a1-98da-c7ef49dbab34 -- POST / 200 534.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,955 mnist_classifier_MNISTClassifier yxa49nzn 753ee931-3956-43e5-93d8-29990441f197 -- POST / 200 533.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,956 mnist_classifier_MNISTClassifier yxa49nzn 6a6eb201-688f-4446-84c9-ad592239009e -- POST / 200 534.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,956 mnist_classifier_MNISTClassifier yxa49nzn b7f5238a-4f71-4f0d-9a1b-b9eff8f74b44 -- POST / 200 534.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,957 mnist_classifier_MNISTClassifier yxa49nzn 1a141b16-d507-46f7-9074-cc6d3f796388 -- POST / 200 534.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,958 mnist_classifier_MNISTClassifier yxa49nzn 69a3961e-8e3c-4a8e-b305-d5a846ce43dd -- POST / 200 535.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,958 mnist_classifier_MNISTClassifier yxa49nzn 1d937630-4e3f-40a6-8e93-3a0924779e46 -- POST / 200 533.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,960 mnist_classifier_MNISTClassifier yxa49nzn 9c091e88-f87e-4568-aa0f-347ec9a5fa55 -- POST / 200 535.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,961 mnist_classifier_MNISTClassifier yxa49nzn 11bfd8ae-034a-45da-a75a-4edbc987b0af -- POST / 200 534.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,962 mnist_classifier_MNISTClassifier yxa49nzn 4e79aa0a-950f-42b2-bafe-03788d60dff9 -- POST / 200 533.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,962 mnist_classifier_MNISTClassifier yxa49nzn 44868c70-1ab7-4ea3-a773-8d24f48bd85d -- POST / 200 534.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,962 mnist_classifier_MNISTClassifier yxa49nzn df7b0947-fe13-46cc-bed2-bddde546c5bd -- POST / 200 534.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,963 mnist_classifier_MNISTClassifier yxa49nzn b6dc772b-f8b7-4ec7-8194-63100ebd6e40 -- POST / 200 534.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,963 mnist_classifier_MNISTClassifier yxa49nzn 584bdbd1-7c14-44f3-963b-c1e13c740433 -- POST / 200 535.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,963 mnist_classifier_MNISTClassifier yxa49nzn dbd4fdfe-6f3e-45fa-bc7a-b4134f3e7443 -- POST / 200 533.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,963 mnist_classifier_MNISTClassifier yxa49nzn 5f573725-70c1-4910-80b7-28bcb4f5803d -- POST / 200 533.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,964 mnist_classifier_MNISTClassifier yxa49nzn eb0a6039-c175-4b7d-b3e1-c563a34f8c2f -- POST / 200 533.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,964 mnist_classifier_MNISTClassifier yxa49nzn 616f3c77-fe85-497f-b2da-708af14e5f36 -- POST / 200 531.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,965 mnist_classifier_MNISTClassifier yxa49nzn 3c969ee0-3bdf-47a7-b4fb-f3c8651e627b -- POST / 200 530.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,965 mnist_classifier_MNISTClassifier yxa49nzn e2d4c702-4392-4dde-babf-53179beed0b9 -- POST / 200 530.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,967 mnist_classifier_MNISTClassifier yxa49nzn bb4b048d-a192-4f8b-bf53-15ae79ba5797 -- POST / 200 523.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,970 mnist_classifier_MNISTClassifier yxa49nzn 3005fcd3-7978-45c9-8a46-f7f2e3e13905 -- POST / 200 513.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,970 mnist_classifier_MNISTClassifier yxa49nzn f5074a7c-379b-4c30-9349-382bbefbfdbb -- POST / 200 512.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,970 mnist_classifier_MNISTClassifier yxa49nzn c7a37cf8-b079-4b26-82a7-a7ef99581fbf -- POST / 200 512.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,971 mnist_classifier_MNISTClassifier yxa49nzn 7cc777d7-cddf-43c8-8a2c-8c48caaad59d -- POST / 200 512.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,971 mnist_classifier_MNISTClassifier yxa49nzn 3b44dbbd-33a9-425f-afcb-42dee0deabba -- POST / 200 510.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,971 mnist_classifier_MNISTClassifier yxa49nzn 6c63ae8a-5d0d-42e7-8989-6ab9ba7778db -- POST / 200 509.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,973 mnist_classifier_MNISTClassifier yxa49nzn 529d851b-0d1c-4318-a455-05e17b1967b3 -- POST / 200 412.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,989 mnist_classifier_MNISTClassifier yxa49nzn 4356be14-7532-464c-9bfa-b75d8a193d76 -- POST / 200 427.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,990 mnist_classifier_MNISTClassifier yxa49nzn 63360225-37e0-49aa-adc7-7247db8cbc88 -- POST / 200 525.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,991 mnist_classifier_MNISTClassifier yxa49nzn f90fa338-0283-419d-b881-2c0dfaa1a53b -- POST / 200 523.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,991 mnist_classifier_MNISTClassifier yxa49nzn 130fc22c-9f06-42d4-b7d7-485b4e7d763c -- POST / 200 523.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,992 mnist_classifier_MNISTClassifier yxa49nzn dbdc37ea-35ad-4a21-a4ea-c08a6bb27eb1 -- POST / 200 519.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,992 mnist_classifier_MNISTClassifier yxa49nzn 279b5b54-ea3e-4f2c-942c-287ce1f23945 -- POST / 200 517.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,992 mnist_classifier_MNISTClassifier yxa49nzn cf17e84f-e864-4de2-a505-f3d72084aff9 -- POST / 200 515.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,992 mnist_classifier_MNISTClassifier yxa49nzn a3ee7960-2ede-4058-a9e5-74277c1b93ed -- POST / 200 515.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,993 mnist_classifier_MNISTClassifier yxa49nzn 14274392-1301-4aaa-ae58-483c11bb576f -- POST / 200 514.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,993 mnist_classifier_MNISTClassifier yxa49nzn 74e66570-5093-42cf-9ccc-4d9adea20695 -- POST / 200 513.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,993 mnist_classifier_MNISTClassifier yxa49nzn 8a489cff-99bf-49e9-aace-a2eeb6b7837a -- POST / 200 510.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,994 mnist_classifier_MNISTClassifier yxa49nzn c0e66fcd-25fb-4b50-b342-ce96c05d0523 -- POST / 200 508.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,994 mnist_classifier_MNISTClassifier yxa49nzn 967d9ff5-64b5-4ede-9c5b-f25d483b0197 -- POST / 200 508.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,994 mnist_classifier_MNISTClassifier yxa49nzn f9aa82d3-c1e2-4607-ae9b-d0a2bb8fa72e -- POST / 200 508.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,994 mnist_classifier_MNISTClassifier yxa49nzn 1e474b1c-108e-4bd8-87b2-7d72d73d761b -- POST / 200 506.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,994 mnist_classifier_MNISTClassifier yxa49nzn 98615483-0f89-4b81-9354-e3c9e877c72b -- POST / 200 504.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,994 mnist_classifier_MNISTClassifier yxa49nzn 9af9540b-1c50-4c5e-afcd-6d1130bc63b4 -- POST / 200 503.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,995 mnist_classifier_MNISTClassifier yxa49nzn eea28559-1567-4fcc-ab20-72c25748140d -- POST / 200 502.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,995 mnist_classifier_MNISTClassifier yxa49nzn 3b045539-50c4-40d7-9f6e-c6c27d72ba28 -- POST / 200 501.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,995 mnist_classifier_MNISTClassifier yxa49nzn beec6a08-b1fa-4d43-a6a4-ad7ea8489cd8 -- POST / 200 500.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,995 mnist_classifier_MNISTClassifier yxa49nzn f826ba7d-c8c0-4309-8cef-c040087bb8a4 -- POST / 200 500.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,995 mnist_classifier_MNISTClassifier yxa49nzn ec8da4d5-1594-43fb-9cf9-f86ebed00747 -- POST / 200 500.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,995 mnist_classifier_MNISTClassifier yxa49nzn d36907aa-3de8-46c6-968d-a9640e7d873e -- POST / 200 497.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,995 mnist_classifier_MNISTClassifier yxa49nzn bdd92741-c8bd-4a53-ba4c-cfbc9a8119f5 -- POST / 200 496.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,996 mnist_classifier_MNISTClassifier yxa49nzn f3846ca1-803f-49d5-9b26-e449f28c22b4 -- POST / 200 494.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,996 mnist_classifier_MNISTClassifier yxa49nzn 52adb232-5bff-4214-afef-6a2e8324d890 -- POST / 200 495.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,996 mnist_classifier_MNISTClassifier yxa49nzn fb8a81ad-c865-4580-a72d-6c55577f3bb3 -- POST / 200 494.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,996 mnist_classifier_MNISTClassifier yxa49nzn b5bb6948-b276-41c4-b58e-4429432e7f7b -- POST / 200 432.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,996 mnist_classifier_MNISTClassifier yxa49nzn 50398158-58ac-4e9e-a283-439274cf635c -- POST / 200 432.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,996 mnist_classifier_MNISTClassifier yxa49nzn 8126895e-623c-4c3c-899f-d85bb2f5761f -- POST / 200 444.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,996 mnist_classifier_MNISTClassifier yxa49nzn e267798e-c9e1-42e7-b2b3-1fea28661eb0 -- POST / 200 442.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,997 mnist_classifier_MNISTClassifier yxa49nzn 0306bb2d-15e1-4479-a832-fc789e72d23d -- POST / 200 441.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,997 mnist_classifier_MNISTClassifier yxa49nzn 793bf55d-faba-4cf0-88d3-4c875437df94 -- POST / 200 440.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,997 mnist_classifier_MNISTClassifier yxa49nzn 81086d65-e003-4e2f-98ca-7cf322648aa5 -- POST / 200 438.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,997 mnist_classifier_MNISTClassifier yxa49nzn cf9aee63-a9bf-4cd1-85f5-5302afb973e6 -- POST / 200 437.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,997 mnist_classifier_MNISTClassifier yxa49nzn 34fbab48-989e-460d-a6e2-f410ab6a408f -- POST / 200 435.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,997 mnist_classifier_MNISTClassifier yxa49nzn 76d17856-8c78-4d5c-99f5-6ed84445837b -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,997 mnist_classifier_MNISTClassifier yxa49nzn c1b18135-9001-4563-9ce5-9b09af6700b2 -- POST / 200 432.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,998 mnist_classifier_MNISTClassifier yxa49nzn e3d3b046-f577-459c-8dd5-3981910fc9ea -- POST / 200 432.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,998 mnist_classifier_MNISTClassifier yxa49nzn 04988fd8-6388-4665-9820-3d7c987123dd -- POST / 200 431.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,998 mnist_classifier_MNISTClassifier yxa49nzn 13b713ad-7dec-44df-8cfb-3bc961f1d8a2 -- POST / 200 431.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,998 mnist_classifier_MNISTClassifier yxa49nzn ada03f22-b818-49bf-b702-109db362694e -- POST / 200 425.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,998 mnist_classifier_MNISTClassifier yxa49nzn 7885d547-4268-4cce-aa22-fc1f08bbaa49 -- POST / 200 421.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,998 mnist_classifier_MNISTClassifier yxa49nzn 3b14701a-d790-41ca-a18d-53abd8e1b9ee -- POST / 200 421.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,999 mnist_classifier_MNISTClassifier yxa49nzn cb3ee947-aa02-4972-8e10-f88471ed2d7a -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,999 mnist_classifier_MNISTClassifier yxa49nzn 206d925d-4878-4deb-aa1c-ec43b4705c0c -- POST / 200 278.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,999 mnist_classifier_MNISTClassifier yxa49nzn f2de6a14-4c6d-48ca-a965-e1c9ff49697a -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,999 mnist_classifier_MNISTClassifier yxa49nzn 75a378ac-8a5d-4656-b4a6-60a1ef30427e -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,999 mnist_classifier_MNISTClassifier yxa49nzn 4ccdf11e-63c1-49ff-90c1-235ca5c330b8 -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,999 mnist_classifier_MNISTClassifier yxa49nzn 1ddcae89-39d8-422f-bfde-8664c414f097 -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:52,999 mnist_classifier_MNISTClassifier yxa49nzn b7ba665a-242a-4cf4-8078-e493c51b7ca8 -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,000 mnist_classifier_MNISTClassifier yxa49nzn 869c76c1-a3b3-401d-88ac-2f75b9c1ad14 -- POST / 200 277.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,000 mnist_classifier_MNISTClassifier yxa49nzn d42e3d33-3816-46b2-916b-dd74cd4fca21 -- POST / 200 275.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,000 mnist_classifier_MNISTClassifier yxa49nzn e6d0332e-2110-49a2-9e6f-a32f8818ccf1 -- POST / 200 246.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,000 mnist_classifier_MNISTClassifier yxa49nzn f08cd9aa-aca5-4f10-b04f-66fba0de1ef4 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,001 mnist_classifier_MNISTClassifier yxa49nzn c9ce2d7f-0126-4d8f-b44c-74471b283e3b -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,001 mnist_classifier_MNISTClassifier yxa49nzn ac8c39de-4003-466c-aed1-376077deb3f7 -- POST / 200 241.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,002 mnist_classifier_MNISTClassifier yxa49nzn 69318245-efad-47f5-8675-c5ab03d8b3bf -- POST / 200 240.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,002 mnist_classifier_MNISTClassifier yxa49nzn b8f8272b-3c95-4544-8743-814ed341a18d -- POST / 200 239.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,002 mnist_classifier_MNISTClassifier yxa49nzn faadb4e4-f68c-4560-b085-d7f48971375f -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,002 mnist_classifier_MNISTClassifier yxa49nzn 4461436c-9c7d-451e-8299-f0827c0b3862 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,002 mnist_classifier_MNISTClassifier yxa49nzn 92aa614d-2708-47d7-a5be-acda4bd7cf54 -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,003 mnist_classifier_MNISTClassifier yxa49nzn 177226e8-12b9-44a3-bf22-7e60e54c6612 -- POST / 200 232.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,003 mnist_classifier_MNISTClassifier yxa49nzn f957fda2-8fe1-4331-805b-e132541f5ab3 -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,004 mnist_classifier_MNISTClassifier yxa49nzn ebfa1884-eb70-42de-90eb-4b9076c598ee -- POST / 200 179.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,005 mnist_classifier_MNISTClassifier yxa49nzn e99713f9-9e7d-4308-ae07-82657628ebf3 -- POST / 200 171.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,007 mnist_classifier_MNISTClassifier yxa49nzn 967a04d6-5285-40fd-bbc5-bff42594d7c5 -- POST / 200 172.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,009 mnist_classifier_MNISTClassifier yxa49nzn 78e1f509-07c7-4a5a-bd0e-f5931dd30166 -- POST / 200 174.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,012 mnist_classifier_MNISTClassifier yxa49nzn 15cc7e3b-01f9-4a67-bab2-f0d07e9be265 -- POST / 200 177.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,248 mnist_classifier_MNISTClassifier yxa49nzn 8c80aff0-b30b-4254-b022-22177b7c2af4 -- POST / 200 283.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,261 mnist_classifier_MNISTClassifier yxa49nzn b9813b8e-59d5-48d7-90f0-465e5b8f1a9b -- POST / 200 246.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,261 mnist_classifier_MNISTClassifier yxa49nzn ec57fa82-dca0-4d13-a060-a2c39bc71949 -- POST / 200 247.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,262 mnist_classifier_MNISTClassifier yxa49nzn a34089a6-cf36-41d5-b3f6-2828d9f019da -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,262 mnist_classifier_MNISTClassifier yxa49nzn 78ed2881-bf08-4432-9010-7b3133aff0e4 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,263 mnist_classifier_MNISTClassifier yxa49nzn 20e2079e-434b-4fb3-ad93-7e4adb5822cb -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,264 mnist_classifier_MNISTClassifier yxa49nzn 5e3b3829-9354-40e2-a4a1-35ab1fa4c0d6 -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,264 mnist_classifier_MNISTClassifier yxa49nzn e9da71e9-f1b2-40f6-b682-4109c5bd37bd -- POST / 200 235.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,265 mnist_classifier_MNISTClassifier yxa49nzn 375466fa-cd8a-4291-8e63-384fe3387027 -- POST / 200 234.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,266 mnist_classifier_MNISTClassifier yxa49nzn 3ece2550-68a0-4040-b0a6-7e0141ce3877 -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,266 mnist_classifier_MNISTClassifier yxa49nzn 2f4955f5-c12c-4feb-8709-fd9097f92c4d -- POST / 200 232.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,267 mnist_classifier_MNISTClassifier yxa49nzn 271d779c-c9ee-44b2-9f3a-e943319ec585 -- POST / 200 232.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,267 mnist_classifier_MNISTClassifier yxa49nzn c1b4158f-4eb5-4d14-8444-4912d82983e5 -- POST / 200 233.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,268 mnist_classifier_MNISTClassifier yxa49nzn 070eb98a-6955-4f9b-a8b6-91a9b80dcfac -- POST / 200 232.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,269 mnist_classifier_MNISTClassifier yxa49nzn e769b9c4-9e02-4eb2-a054-972713e4386c -- POST / 200 231.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,269 mnist_classifier_MNISTClassifier yxa49nzn 76097a16-9618-4c53-81f9-a89a6ac1fafa -- POST / 200 229.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,270 mnist_classifier_MNISTClassifier yxa49nzn 0ee65233-b8b4-40a3-a10d-840bbbf0b373 -- POST / 200 229.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,270 mnist_classifier_MNISTClassifier yxa49nzn 2dea29bc-7ce1-4ec9-bb67-3d9f68ffc27e -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,270 mnist_classifier_MNISTClassifier yxa49nzn 6d274f81-f9f1-4507-9dd9-4826c8d2fec4 -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,270 mnist_classifier_MNISTClassifier yxa49nzn cf7c5c07-245e-4865-8c2f-bf283a60dede -- POST / 200 226.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,271 mnist_classifier_MNISTClassifier yxa49nzn 8e0f4fef-60e7-4b1f-84b6-e7182dc14fa4 -- POST / 200 226.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,271 mnist_classifier_MNISTClassifier yxa49nzn ece0a02a-86ae-4d51-bfaa-96ca39aa3689 -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,271 mnist_classifier_MNISTClassifier yxa49nzn fc798bcf-0f7b-45a3-aaa0-b48f9fe7b669 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,273 mnist_classifier_MNISTClassifier yxa49nzn dd7e5d69-20fe-447a-bb00-86faab98e820 -- POST / 200 226.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,274 mnist_classifier_MNISTClassifier yxa49nzn e602e08f-3433-4f61-bf83-ae0ce41bf782 -- POST / 200 221.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,275 mnist_classifier_MNISTClassifier yxa49nzn ef861872-ae5c-4c1f-b21f-3a5dc4e32c93 -- POST / 200 228.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,280 mnist_classifier_MNISTClassifier yxa49nzn 04d7e483-5cf9-4858-93fb-12e26f6575fc -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,284 mnist_classifier_MNISTClassifier yxa49nzn 4790bc20-252b-49a3-a96a-a9e475b884f9 -- POST / 200 236.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,285 mnist_classifier_MNISTClassifier yxa49nzn f1593531-6895-4990-9270-0c6a76917382 -- POST / 200 236.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,285 mnist_classifier_MNISTClassifier yxa49nzn 1ca75493-957c-47ba-83a9-775a094e2871 -- POST / 200 236.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,286 mnist_classifier_MNISTClassifier yxa49nzn 03565cdc-2339-4ef2-8092-b1ae1ad66e8b -- POST / 200 236.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,288 mnist_classifier_MNISTClassifier yxa49nzn 13e3b924-0c41-4a80-85aa-70d71540fbd1 -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,373 mnist_classifier_MNISTClassifier yxa49nzn 52c58be2-79ea-4a64-bad9-beef41444f96 -- POST / 200 317.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,376 mnist_classifier_MNISTClassifier yxa49nzn 79b0094a-bf7c-4f4c-ba02-017863040d0a -- POST / 200 319.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,376 mnist_classifier_MNISTClassifier yxa49nzn 4fb26282-7440-4e4d-87a8-e822c5a611dc -- POST / 200 319.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,377 mnist_classifier_MNISTClassifier yxa49nzn 12b29efc-4503-4d79-bb47-90b306ea658c -- POST / 200 319.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,377 mnist_classifier_MNISTClassifier yxa49nzn cb9f6bbd-15aa-4a86-b1c3-5e8bfcf5e8d8 -- POST / 200 307.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,378 mnist_classifier_MNISTClassifier yxa49nzn 4e131f7f-3980-4d70-906e-d9f46353576a -- POST / 200 310.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,378 mnist_classifier_MNISTClassifier yxa49nzn 9d41f0a3-4469-442a-af0c-f5b8b7d14a11 -- POST / 200 299.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,378 mnist_classifier_MNISTClassifier yxa49nzn 4d4d48b1-c859-4056-987c-7945f1a0cb82 -- POST / 200 309.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,379 mnist_classifier_MNISTClassifier yxa49nzn 1d580f4e-f2b0-43d6-aa6b-6205599b99d8 -- POST / 200 300.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,379 mnist_classifier_MNISTClassifier yxa49nzn 720beb68-054c-42de-ae5a-30f26a385520 -- POST / 200 288.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,380 mnist_classifier_MNISTClassifier yxa49nzn 914b4067-34a2-49c1-acb9-39013c62e31e -- POST / 200 301.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,381 mnist_classifier_MNISTClassifier yxa49nzn 023394d2-7903-46c9-91f7-2cd2e2fb4094 -- POST / 200 288.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,381 mnist_classifier_MNISTClassifier yxa49nzn c9f7a195-4951-48b1-9cd5-47e2e910ab43 -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,382 mnist_classifier_MNISTClassifier yxa49nzn 9229d378-0e33-479b-81e1-049ec3cc0ed0 -- POST / 200 287.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,383 mnist_classifier_MNISTClassifier yxa49nzn 9441fe56-0ab8-42bb-96f2-7b64aa7b56b3 -- POST / 200 286.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,383 mnist_classifier_MNISTClassifier yxa49nzn 0b7d2a97-b518-49ba-8140-bd3edbd973c9 -- POST / 200 286.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,389 mnist_classifier_MNISTClassifier yxa49nzn 17de54d1-f5c3-411d-9ca4-5160c6ac1db5 -- POST / 200 288.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,392 mnist_classifier_MNISTClassifier yxa49nzn 011aa4b4-9a53-4159-828a-9d006c58c8d4 -- POST / 200 295.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,393 mnist_classifier_MNISTClassifier yxa49nzn 14e4aaab-fb1f-4866-ab5a-2ef04563c3e1 -- POST / 200 289.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,393 mnist_classifier_MNISTClassifier yxa49nzn f23fb072-08a4-4760-83a3-542b5c200156 -- POST / 200 295.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,394 mnist_classifier_MNISTClassifier yxa49nzn b5e07245-3516-4cb4-911e-012829f443ae -- POST / 200 290.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,395 mnist_classifier_MNISTClassifier yxa49nzn ae1fdf2b-8dc1-416b-abb7-954c16cb034d -- POST / 200 287.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,395 mnist_classifier_MNISTClassifier yxa49nzn 60a9b9b0-ff1b-4ebc-8d61-ad1d07c254c9 -- POST / 200 291.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,395 mnist_classifier_MNISTClassifier yxa49nzn 89786d6a-d1c8-463e-aba2-aaa25d0c93c2 -- POST / 200 287.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,397 mnist_classifier_MNISTClassifier yxa49nzn 476fca2d-66e6-4110-bb7d-2874ba58d30e -- POST / 200 287.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,398 mnist_classifier_MNISTClassifier yxa49nzn 26c7f3c4-379a-4b7a-be20-26174041af21 -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,398 mnist_classifier_MNISTClassifier yxa49nzn 7d962727-52bb-481f-b10c-fb0ee0148b88 -- POST / 200 286.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,402 mnist_classifier_MNISTClassifier yxa49nzn 236f98a2-7c8d-4ca3-8fa0-d4445825dbbf -- POST / 200 293.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,406 mnist_classifier_MNISTClassifier yxa49nzn 83920cae-c983-41fe-a130-4967d8aa9633 -- POST / 200 293.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,406 mnist_classifier_MNISTClassifier yxa49nzn 71482b8e-1218-4f90-a8fd-ed11e70d4fa5 -- POST / 200 293.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,407 mnist_classifier_MNISTClassifier yxa49nzn deb338be-c5c5-4ee2-b99d-189bb534f64f -- POST / 200 287.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,409 mnist_classifier_MNISTClassifier yxa49nzn fd8b5ae3-160d-42ce-8865-825a6cee73a3 -- POST / 200 295.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,410 mnist_classifier_MNISTClassifier yxa49nzn 5a0448b4-1cea-47ab-a737-0747383eea42 -- POST / 200 289.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,410 mnist_classifier_MNISTClassifier yxa49nzn 0e95bd98-46fb-4e0d-b7d3-eb10e666a279 -- POST / 200 294.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,411 mnist_classifier_MNISTClassifier yxa49nzn d6e9c936-1c7b-400f-b88b-51ac9993ce24 -- POST / 200 290.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,412 mnist_classifier_MNISTClassifier yxa49nzn d191ba30-3d36-4224-926f-d9486e442593 -- POST / 200 288.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,412 mnist_classifier_MNISTClassifier yxa49nzn a39b31bf-12b6-4a61-a9f3-794d4715c88b -- POST / 200 290.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,413 mnist_classifier_MNISTClassifier yxa49nzn 4a1ef68c-837f-42d7-89ce-fb016eb6c4e7 -- POST / 200 288.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,415 mnist_classifier_MNISTClassifier yxa49nzn 80ee050c-e848-49ef-87e5-9c96341273c6 -- POST / 200 292.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,416 mnist_classifier_MNISTClassifier yxa49nzn 174eccee-81b5-44c9-9727-b203d2cc2ac8 -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,417 mnist_classifier_MNISTClassifier yxa49nzn 85e2dc05-2734-4828-9e7a-5e93b64b4aae -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,417 mnist_classifier_MNISTClassifier yxa49nzn 573d728e-bb25-4727-ba43-1e4c5aff6113 -- POST / 200 291.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,417 mnist_classifier_MNISTClassifier yxa49nzn 46d26890-595b-4578-9179-2f2542b6d2e0 -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,418 mnist_classifier_MNISTClassifier yxa49nzn f6d6fe30-cf0d-429a-abff-9ff4d77f1429 -- POST / 200 291.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,418 mnist_classifier_MNISTClassifier yxa49nzn bf97043c-fe90-43ea-9345-410dd44ee3ec -- POST / 200 282.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,419 mnist_classifier_MNISTClassifier yxa49nzn 90018e24-df17-436a-9f8b-db6e64bb4894 -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,419 mnist_classifier_MNISTClassifier yxa49nzn 9f5d759b-9950-4174-b83d-38a79f4fa164 -- POST / 200 281.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,420 mnist_classifier_MNISTClassifier yxa49nzn 44cfacbb-767d-40ef-a840-856f7a220f02 -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,422 mnist_classifier_MNISTClassifier yxa49nzn 366a0ed8-528c-418c-80e6-da7409e69c97 -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,423 mnist_classifier_MNISTClassifier yxa49nzn 4940adcf-5af5-4b80-be8f-dc1a29c87557 -- POST / 200 278.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,423 mnist_classifier_MNISTClassifier yxa49nzn c189a718-ca33-49f5-bb0c-419e26d4ddb4 -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,423 mnist_classifier_MNISTClassifier yxa49nzn b6ab63a8-7910-4728-b8ee-1c19f27cc556 -- POST / 200 274.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,424 mnist_classifier_MNISTClassifier yxa49nzn 99bca444-339b-43af-9ff3-e7fa6d8b82d7 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,426 mnist_classifier_MNISTClassifier yxa49nzn 0fc80310-3417-4390-b9a9-5e6953093af5 -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,426 mnist_classifier_MNISTClassifier yxa49nzn f8982326-1dc3-4fc4-946b-ad27c565bad3 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,433 mnist_classifier_MNISTClassifier yxa49nzn 7c96e70d-1fe2-4d19-b825-eff4aa1d439f -- POST / 200 279.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,437 mnist_classifier_MNISTClassifier yxa49nzn 5d32f0a2-5b70-4097-af79-ac4413733ff0 -- POST / 200 283.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,438 mnist_classifier_MNISTClassifier yxa49nzn f996c8bd-425a-4fa1-a1b2-dc3326abc0a0 -- POST / 200 284.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,438 mnist_classifier_MNISTClassifier yxa49nzn 817f79d3-20e1-4416-a68a-e59414c0336b -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,439 mnist_classifier_MNISTClassifier yxa49nzn 59fb83ab-365e-4dac-907e-a3cff07a3e75 -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,442 mnist_classifier_MNISTClassifier yxa49nzn 6ff747a9-6b52-421e-ab0f-baf752569767 -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,442 mnist_classifier_MNISTClassifier yxa49nzn faab455e-552b-45b4-b1a6-90dee3ff3b36 -- POST / 200 285.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,443 mnist_classifier_MNISTClassifier yxa49nzn b45e3085-74ba-4a3b-9366-6624b68a4662 -- POST / 200 285.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,443 mnist_classifier_MNISTClassifier yxa49nzn 45609ee9-3fbb-4019-81a3-baafcf056f47 -- POST / 200 276.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,443 mnist_classifier_MNISTClassifier yxa49nzn cdf8c451-5c02-4051-9c42-7d2a81424ed5 -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,443 mnist_classifier_MNISTClassifier yxa49nzn 30be1dc6-bd05-417a-9de6-f78656390cea -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,443 mnist_classifier_MNISTClassifier yxa49nzn 93943a0b-42fc-49ca-8a1a-131c904df4b5 -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,444 mnist_classifier_MNISTClassifier yxa49nzn 99bf1e6f-5480-45af-9d42-eb3b7b53ac54 -- POST / 200 273.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,519 mnist_classifier_MNISTClassifier yxa49nzn d8609391-7a5e-48a4-a7e5-ae07e0167120 -- POST / 200 218.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,532 mnist_classifier_MNISTClassifier yxa49nzn 7df32948-1cec-4ae0-a149-5454fa6e80f6 -- POST / 200 231.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,536 mnist_classifier_MNISTClassifier yxa49nzn 9a4bd213-3193-4f2c-aa49-e5d5a62c0838 -- POST / 200 235.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,537 mnist_classifier_MNISTClassifier yxa49nzn 037eea06-0e2a-40c3-adfd-bef6156760c1 -- POST / 200 235.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,537 mnist_classifier_MNISTClassifier yxa49nzn eadf471a-76e9-41b3-9f73-91433ad3d275 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,537 mnist_classifier_MNISTClassifier yxa49nzn 6f9b12ac-529a-45e6-a0db-ca6aafde95f5 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,537 mnist_classifier_MNISTClassifier yxa49nzn d07f7b89-29d8-4a5b-b9d0-28c7c9afd636 -- POST / 200 235.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,537 mnist_classifier_MNISTClassifier yxa49nzn aafd5393-a646-4278-9ac0-7b008e6958c0 -- POST / 200 223.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,538 mnist_classifier_MNISTClassifier yxa49nzn 256a2478-72a0-4c4e-9281-879c219e03f1 -- POST / 200 222.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,538 mnist_classifier_MNISTClassifier yxa49nzn 22a113c1-2d61-4ee4-b106-e3dad3375356 -- POST / 200 222.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,538 mnist_classifier_MNISTClassifier yxa49nzn 2abb94db-cfc2-4d8e-8309-ded1ce21cc69 -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,538 mnist_classifier_MNISTClassifier yxa49nzn 823bedec-9b4c-4815-a7f2-2d16b0e7f652 -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,538 mnist_classifier_MNISTClassifier yxa49nzn cf6a52a0-b6e4-4a3f-b505-5708c0c1874a -- POST / 200 221.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,538 mnist_classifier_MNISTClassifier yxa49nzn a09f27a6-262f-4805-b524-10e0f7c1b8a3 -- POST / 200 219.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,538 mnist_classifier_MNISTClassifier yxa49nzn ba4b6b0e-d19b-4b06-973c-d35d9c3ca51b -- POST / 200 219.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,539 mnist_classifier_MNISTClassifier yxa49nzn 52000575-ad6d-4c30-822a-9162944ff5bc -- POST / 200 215.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,539 mnist_classifier_MNISTClassifier yxa49nzn d427e482-8705-46f4-bdfc-76460e08cede -- POST / 200 217.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,539 mnist_classifier_MNISTClassifier yxa49nzn 31b0e3ef-3fee-4982-97d0-8f2d5e6cc2ec -- POST / 200 218.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,540 mnist_classifier_MNISTClassifier yxa49nzn efb07d38-af7d-4c12-8b04-9013d34be019 -- POST / 200 216.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,541 mnist_classifier_MNISTClassifier yxa49nzn 608f0442-66b2-43f6-bede-a679d32b6f64 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,541 mnist_classifier_MNISTClassifier yxa49nzn 26a12c9e-8eff-406f-a624-5066e2fb56f6 -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,541 mnist_classifier_MNISTClassifier yxa49nzn 004e509e-ed0d-465e-afa1-5d399b13178d -- POST / 200 209.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,541 mnist_classifier_MNISTClassifier yxa49nzn 67067efd-b79d-4b2c-96d0-c0b95084a75f -- POST / 200 217.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,542 mnist_classifier_MNISTClassifier yxa49nzn f59d68e2-55e1-4336-b16e-c909c421d2ad -- POST / 200 215.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,542 mnist_classifier_MNISTClassifier yxa49nzn 7957f544-9b3b-45c3-9c3b-a00ba450fe6a -- POST / 200 214.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,542 mnist_classifier_MNISTClassifier yxa49nzn 44ae2954-607c-4c0d-92e3-5dac8b52a90d -- POST / 200 210.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,542 mnist_classifier_MNISTClassifier yxa49nzn ba47115f-98bb-41f4-a366-15911c90df34 -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,542 mnist_classifier_MNISTClassifier yxa49nzn 1ad3f960-c2fe-435b-933f-2e956270b90b -- POST / 200 208.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,542 mnist_classifier_MNISTClassifier yxa49nzn 2279dfe9-f87a-4951-91fb-be2685e3a4e8 -- POST / 200 208.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,542 mnist_classifier_MNISTClassifier yxa49nzn 25dfef5b-daa1-4481-802b-eb3e91dd42e4 -- POST / 200 208.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,543 mnist_classifier_MNISTClassifier yxa49nzn ab6516c2-3fcc-4a73-8d70-7293f458e566 -- POST / 200 208.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,543 mnist_classifier_MNISTClassifier yxa49nzn b21aa5b3-84ef-4765-9f91-ba9866a083ae -- POST / 200 208.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,783 mnist_classifier_MNISTClassifier yxa49nzn 30eee670-782e-4895-9020-cc390286a7f7 -- POST / 200 368.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,784 mnist_classifier_MNISTClassifier yxa49nzn 64581151-ffa8-435e-8ab4-c951c1e002b4 -- POST / 200 350.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,785 mnist_classifier_MNISTClassifier yxa49nzn 46777f0c-5565-471f-bd99-67e8507c1f98 -- POST / 200 350.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,785 mnist_classifier_MNISTClassifier yxa49nzn 4857fa52-683d-4a2e-b507-532f6543518c -- POST / 200 341.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,786 mnist_classifier_MNISTClassifier yxa49nzn 369c67d3-a6a0-41f5-834c-7aa00c9f73d9 -- POST / 200 338.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,786 mnist_classifier_MNISTClassifier yxa49nzn d0150a0c-4ee7-4713-84b3-ca13f2426cb6 -- POST / 200 336.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,791 mnist_classifier_MNISTClassifier yxa49nzn b1add2ec-7eb3-44b8-8ca0-edb19f4b73ad -- POST / 200 329.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,792 mnist_classifier_MNISTClassifier yxa49nzn edf3f80e-83b0-4e57-8d83-44eeeb279d20 -- POST / 200 340.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,794 mnist_classifier_MNISTClassifier yxa49nzn 24ac8802-f2d4-4f2b-8910-fede441e30d0 -- POST / 200 342.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,796 mnist_classifier_MNISTClassifier yxa49nzn 32b0bec4-5996-4e23-a9ce-b5b820134972 -- POST / 200 342.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,796 mnist_classifier_MNISTClassifier yxa49nzn 39f555f2-e8fb-4ee6-91ba-3f1009615ab4 -- POST / 200 342.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,797 mnist_classifier_MNISTClassifier yxa49nzn 0acc769b-3369-4b9b-929c-5b50ce03e5d9 -- POST / 200 342.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,797 mnist_classifier_MNISTClassifier yxa49nzn 2d59229d-46ac-4aea-b765-dac11fcdeaae -- POST / 200 341.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,797 mnist_classifier_MNISTClassifier yxa49nzn 0ec86963-9725-49e7-a86a-7e7e0820e6e1 -- POST / 200 340.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,798 mnist_classifier_MNISTClassifier yxa49nzn 4b5954e9-ef58-473c-a801-5dbff739220a -- POST / 200 340.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,798 mnist_classifier_MNISTClassifier yxa49nzn 17c0e27d-abb3-499c-9042-5f0d74c8ea09 -- POST / 200 340.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,799 mnist_classifier_MNISTClassifier yxa49nzn 0d2a0b0d-f655-48f1-81dd-b1f34423d024 -- POST / 200 338.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,800 mnist_classifier_MNISTClassifier yxa49nzn bde32115-cb1c-45e6-b9c7-9ae0e20b1f69 -- POST / 200 339.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,959 mnist_classifier_MNISTClassifier yxa49nzn da1486ed-0a57-4be1-8f9c-ab6dc78ba683 -- POST / 200 484.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,959 mnist_classifier_MNISTClassifier yxa49nzn a3e2516a-db54-4323-9757-39cc5628b4c5 -- POST / 200 497.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,960 mnist_classifier_MNISTClassifier yxa49nzn 897f326e-08ab-42ef-9a70-daf6ec904430 -- POST / 200 495.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,960 mnist_classifier_MNISTClassifier yxa49nzn bc06789f-1f57-4c48-902a-87362c69d978 -- POST / 200 495.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,961 mnist_classifier_MNISTClassifier yxa49nzn 74470288-89b0-4eb7-b298-822da27bb939 -- POST / 200 494.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,961 mnist_classifier_MNISTClassifier yxa49nzn e483f400-aeb9-47c1-b824-01abac190282 -- POST / 200 494.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,962 mnist_classifier_MNISTClassifier yxa49nzn 5c69c4de-88c8-4da7-b13f-7aa42df7a98e -- POST / 200 495.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,963 mnist_classifier_MNISTClassifier yxa49nzn 4874fef7-8013-4559-bac7-3320c4b40621 -- POST / 200 496.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,964 mnist_classifier_MNISTClassifier yxa49nzn 060406c7-f520-4259-9bf0-2d60452a9d4d -- POST / 200 493.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,964 mnist_classifier_MNISTClassifier yxa49nzn 565f0cd8-0405-4bd8-8708-18a1b070f46e -- POST / 200 493.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,964 mnist_classifier_MNISTClassifier yxa49nzn 27f4c7b8-b55a-404e-8096-9849838e6936 -- POST / 200 493.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,965 mnist_classifier_MNISTClassifier yxa49nzn 54386705-8f75-4d86-89b5-89cb6c3e158b -- POST / 200 491.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,966 mnist_classifier_MNISTClassifier yxa49nzn c3d11fdb-a4b1-4bfe-9926-065f2e6d8cdc -- POST / 200 492.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,966 mnist_classifier_MNISTClassifier yxa49nzn 0897d816-a3b4-4504-980f-8e005b21cd61 -- POST / 200 493.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,967 mnist_classifier_MNISTClassifier yxa49nzn da53c6c3-0a8d-45ea-9d9e-af0502064a50 -- POST / 200 505.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,968 mnist_classifier_MNISTClassifier yxa49nzn 51c3594b-1e7b-448f-9d8e-1648f3a96aad -- POST / 200 505.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,970 mnist_classifier_MNISTClassifier yxa49nzn 580ad909-f2f7-4a88-b707-383620da81b9 -- POST / 200 494.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,970 mnist_classifier_MNISTClassifier yxa49nzn 29eb51ac-0c57-48d7-a5ff-64f0023ea580 -- POST / 200 495.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,971 mnist_classifier_MNISTClassifier yxa49nzn eeb6756a-f0b8-4ea9-b0ed-d1d46f9ed02e -- POST / 200 496.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,972 mnist_classifier_MNISTClassifier yxa49nzn cff6fcdc-7756-4cbd-9aee-2bdf8f932a99 -- POST / 200 496.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,973 mnist_classifier_MNISTClassifier yxa49nzn 142cdb4d-3b83-4bdb-855b-fb22d61105a9 -- POST / 200 495.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,973 mnist_classifier_MNISTClassifier yxa49nzn 16801a3b-1ae5-49d4-857c-f1cdc7cb249c -- POST / 200 496.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,974 mnist_classifier_MNISTClassifier yxa49nzn 7ee45655-cbea-443c-a7de-45a0802fac62 -- POST / 200 496.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,974 mnist_classifier_MNISTClassifier yxa49nzn 5aed9f12-b559-42c5-bc06-da65bebca42e -- POST / 200 493.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,974 mnist_classifier_MNISTClassifier yxa49nzn 1ccf8e9e-8158-4433-84e8-605fd3d5d884 -- POST / 200 492.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,975 mnist_classifier_MNISTClassifier yxa49nzn e2be25df-c024-4bac-8599-6283062c1bfe -- POST / 200 483.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,975 mnist_classifier_MNISTClassifier yxa49nzn 148703e2-2a98-4e8c-a46a-5453a0c4c18c -- POST / 200 480.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,975 mnist_classifier_MNISTClassifier yxa49nzn 300df9e9-5938-424e-9121-5c73d3de4e02 -- POST / 200 478.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,975 mnist_classifier_MNISTClassifier yxa49nzn 43b9ad09-c9a6-4fd0-9d6e-336c046e409a -- POST / 200 478.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,976 mnist_classifier_MNISTClassifier yxa49nzn 5eeb950f-a9c4-4b64-a8ff-0641d2a11099 -- POST / 200 477.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,976 mnist_classifier_MNISTClassifier yxa49nzn b8990ba3-0984-4f37-a7d2-85d6cd14ecd5 -- POST / 200 476.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,976 mnist_classifier_MNISTClassifier yxa49nzn e3325a8b-7f32-46af-8909-c5381a3d349c -- POST / 200 474.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,977 mnist_classifier_MNISTClassifier yxa49nzn 9fc21051-aeac-4d79-b140-7469bba69881 -- POST / 200 474.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,977 mnist_classifier_MNISTClassifier yxa49nzn cc83c94d-0b65-40f7-a0b2-8601fd658f91 -- POST / 200 472.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,977 mnist_classifier_MNISTClassifier yxa49nzn a3ee7573-644e-4a45-b9ba-8817b2d743d9 -- POST / 200 472.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,977 mnist_classifier_MNISTClassifier yxa49nzn 97d80487-2aed-42d2-a013-52361999dea2 -- POST / 200 472.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,979 mnist_classifier_MNISTClassifier yxa49nzn 20732bad-3100-4b73-bdaf-d18af8e18902 -- POST / 200 433.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,979 mnist_classifier_MNISTClassifier yxa49nzn ed513ce1-d2a4-4131-a042-49e3dc75a085 -- POST / 200 433.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,980 mnist_classifier_MNISTClassifier yxa49nzn 5f86f05b-28ee-4a5e-8eed-08066858af2d -- POST / 200 434.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,981 mnist_classifier_MNISTClassifier yxa49nzn 8735e3d0-2841-48f7-b535-b6c2eab27659 -- POST / 200 434.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,981 mnist_classifier_MNISTClassifier yxa49nzn fcdf8254-f7eb-4ebd-8664-6a3f3ff22100 -- POST / 200 435.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,983 mnist_classifier_MNISTClassifier yxa49nzn a217fc01-f21d-48f6-8ec5-6938a3102e5e -- POST / 200 430.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,983 mnist_classifier_MNISTClassifier yxa49nzn 0f5a8a1b-e254-44f8-9e05-611a3ee87d6a -- POST / 200 430.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,984 mnist_classifier_MNISTClassifier yxa49nzn 6694dbec-66b2-45e6-b506-7c00f70f1ff5 -- POST / 200 430.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,984 mnist_classifier_MNISTClassifier yxa49nzn 2af0edf2-d77d-4143-b289-cc8229cde2de -- POST / 200 430.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,984 mnist_classifier_MNISTClassifier yxa49nzn 7baa9aff-16a1-43b5-ac62-ff467f283ac3 -- POST / 200 428.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,984 mnist_classifier_MNISTClassifier yxa49nzn aa1ed541-c715-4713-961b-8e957831d947 -- POST / 200 426.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,985 mnist_classifier_MNISTClassifier yxa49nzn 33832431-d044-46d0-9db5-e21e77472636 -- POST / 200 426.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,986 mnist_classifier_MNISTClassifier yxa49nzn 1a9a3a80-2322-425c-83d9-99c54be3891c -- POST / 200 426.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,986 mnist_classifier_MNISTClassifier yxa49nzn fb4be076-3166-4555-b2d9-5a976f3679f2 -- POST / 200 427.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,986 mnist_classifier_MNISTClassifier yxa49nzn b5eae798-0ef6-4c11-bce3-98f61fbb416c -- POST / 200 403.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,986 mnist_classifier_MNISTClassifier yxa49nzn 2d534565-5a0b-41ef-81b2-c5396e10f2ac -- POST / 200 401.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,987 mnist_classifier_MNISTClassifier yxa49nzn 4f7c897c-04a2-4adb-b619-b1f62da715d4 -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,988 mnist_classifier_MNISTClassifier yxa49nzn 658bb7c8-2e16-4258-989f-0e0d11c72aeb -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,990 mnist_classifier_MNISTClassifier yxa49nzn d0b4fe7b-c93f-4fc2-ab74-d87a02789a79 -- POST / 200 258.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,991 mnist_classifier_MNISTClassifier yxa49nzn d729aab2-86fb-49f1-ba9e-93e2deeb51fd -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,991 mnist_classifier_MNISTClassifier yxa49nzn e028ed7c-a045-4224-b897-cd6fc9936819 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,991 mnist_classifier_MNISTClassifier yxa49nzn d581758d-feba-432f-bf38-94d17f1beed8 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,992 mnist_classifier_MNISTClassifier yxa49nzn 88d0465a-a2fa-46a7-8475-0df92bfdec3b -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,992 mnist_classifier_MNISTClassifier yxa49nzn 825db257-9f8a-492d-82c1-a2ace7afaef2 -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,992 mnist_classifier_MNISTClassifier yxa49nzn 47e57829-3a03-493c-ad73-1c9b715004f9 -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,995 mnist_classifier_MNISTClassifier yxa49nzn 5c3ce388-a167-412f-94f6-c29d7e63b868 -- POST / 200 260.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,996 mnist_classifier_MNISTClassifier yxa49nzn f8028bee-6d72-43e9-970d-aed9a3c8c5d7 -- POST / 200 410.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,996 mnist_classifier_MNISTClassifier yxa49nzn df8bd74e-d913-40f3-9667-3856b042a928 -- POST / 200 274.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,997 mnist_classifier_MNISTClassifier yxa49nzn 9a4fb3d9-11a1-44fa-ba33-c60398256854 -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,997 mnist_classifier_MNISTClassifier yxa49nzn b17f79eb-007c-4d4f-9733-a35bbf0997b3 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,997 mnist_classifier_MNISTClassifier yxa49nzn e35e18c5-c1a9-4fe2-9ff3-2c0bb026134c -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,998 mnist_classifier_MNISTClassifier yxa49nzn cdeabdea-003b-4c74-83fb-812260d753ff -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,998 mnist_classifier_MNISTClassifier yxa49nzn 753ce5a3-45af-47d2-a9c6-744f39fa3be3 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,999 mnist_classifier_MNISTClassifier yxa49nzn a2984c62-f96a-4ba7-be92-3946c2a775a9 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,999 mnist_classifier_MNISTClassifier yxa49nzn 93742fb7-672e-4ccb-9a61-63291aa5d127 -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:53,999 mnist_classifier_MNISTClassifier yxa49nzn afae2ae0-167e-4f25-9a5e-0a53a172f1c9 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,000 mnist_classifier_MNISTClassifier yxa49nzn 3e7a941f-b972-4e8a-aef2-bc7f53d8057b -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,000 mnist_classifier_MNISTClassifier yxa49nzn 1155ef30-840f-4e05-906c-a27cdb23a04f -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,001 mnist_classifier_MNISTClassifier yxa49nzn eeb5e2f5-a36c-4864-a6ba-c46529e2f98b -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,001 mnist_classifier_MNISTClassifier yxa49nzn fce73b07-5c28-4f63-b71d-ab0416ca50a0 -- POST / 200 263.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,001 mnist_classifier_MNISTClassifier yxa49nzn ee79c47c-9a9b-4e84-80f1-761e3d4ec036 -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,002 mnist_classifier_MNISTClassifier yxa49nzn 2644a9d7-3597-4d6a-b08c-33b3922fab08 -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,002 mnist_classifier_MNISTClassifier yxa49nzn 5cb74112-f612-4f75-8c3c-18dd352a06a0 -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,002 mnist_classifier_MNISTClassifier yxa49nzn d766a6df-0cbf-4e89-b897-c9eeba5493f6 -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,002 mnist_classifier_MNISTClassifier yxa49nzn 5050ab6e-2297-43e8-95a3-7944a5eedce8 -- POST / 200 261.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,002 mnist_classifier_MNISTClassifier yxa49nzn 5ef6c366-9841-4b23-8bd1-63ab90765259 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,002 mnist_classifier_MNISTClassifier yxa49nzn 18801c57-7319-4de6-81fb-02436c3a79ec -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,003 mnist_classifier_MNISTClassifier yxa49nzn 32a285d4-ed70-4be0-a361-6f667d819ed0 -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,003 mnist_classifier_MNISTClassifier yxa49nzn ab6e69c8-8d94-473e-b702-91df70649fff -- POST / 200 226.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,003 mnist_classifier_MNISTClassifier yxa49nzn 9987b3b2-f73e-4395-8169-e291e3e2cc36 -- POST / 200 223.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,003 mnist_classifier_MNISTClassifier yxa49nzn 834abf21-20b7-462c-8f01-fd295a6b3aea -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,003 mnist_classifier_MNISTClassifier yxa49nzn daebc5a6-1b9d-4ff6-a886-4ad4b9771a35 -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,003 mnist_classifier_MNISTClassifier yxa49nzn 5f3d8c82-fd30-43ea-bf49-a9c5b9faff6e -- POST / 200 221.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,004 mnist_classifier_MNISTClassifier yxa49nzn 2a2a91d5-f2f7-41e6-a244-fca2edc49e96 -- POST / 200 176.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,004 mnist_classifier_MNISTClassifier yxa49nzn 0b02d3eb-64c4-412c-8e65-5b225f17bc0b -- POST / 200 175.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,004 mnist_classifier_MNISTClassifier yxa49nzn f556041c-5c93-4ecd-8e08-c9d06ed6f0ac -- POST / 200 174.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,004 mnist_classifier_MNISTClassifier yxa49nzn 40c37c10-4531-4a99-b521-e132b48ab8a6 -- POST / 200 174.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,005 mnist_classifier_MNISTClassifier yxa49nzn 90b39f4d-0e43-4dbf-b20e-1eb8d64c94e9 -- POST / 200 174.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,005 mnist_classifier_MNISTClassifier yxa49nzn ff741764-463c-4610-b63a-97e28a0bee87 -- POST / 200 174.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,005 mnist_classifier_MNISTClassifier yxa49nzn 43f2ad80-845c-46b9-9db3-d122c0da9c83 -- POST / 200 172.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,006 mnist_classifier_MNISTClassifier yxa49nzn b90c2c8e-f562-4d81-8afc-d406018df053 -- POST / 200 172.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,006 mnist_classifier_MNISTClassifier yxa49nzn ddb66231-219c-497e-b4cf-75dc1950c331 -- POST / 200 169.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,006 mnist_classifier_MNISTClassifier yxa49nzn c4247373-1621-44d9-9399-6959c148d390 -- POST / 200 171.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,006 mnist_classifier_MNISTClassifier yxa49nzn 7a3c7b40-5491-4421-b64d-8332d5c4785c -- POST / 200 170.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,316 mnist_classifier_MNISTClassifier yxa49nzn 6470e370-9659-43ac-9add-c53331305423 -- POST / 200 337.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,317 mnist_classifier_MNISTClassifier yxa49nzn 65c49c0b-d1c9-4adf-a527-5092c8c1472a -- POST / 200 329.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,317 mnist_classifier_MNISTClassifier yxa49nzn 8f4879f3-8dba-4215-98f7-9ea6bdf65678 -- POST / 200 309.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,318 mnist_classifier_MNISTClassifier yxa49nzn a2240bd9-91e0-4540-abb3-98593f554aa2 -- POST / 200 300.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,319 mnist_classifier_MNISTClassifier yxa49nzn c5981e85-9db1-419a-adad-d0d6a488ebba -- POST / 200 305.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,319 mnist_classifier_MNISTClassifier yxa49nzn fbf8c8ff-3dd7-42dc-b5a8-0bc95d1ed7ee -- POST / 200 309.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,320 mnist_classifier_MNISTClassifier yxa49nzn 711fbeae-a559-4d6c-8e29-c5c8a3ace48a -- POST / 200 302.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,320 mnist_classifier_MNISTClassifier yxa49nzn bdbbcb9b-781c-44b3-aab9-184e28e508f1 -- POST / 200 301.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,324 mnist_classifier_MNISTClassifier yxa49nzn 822422f1-85d0-4fa0-ab5b-e496519009aa -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,325 mnist_classifier_MNISTClassifier yxa49nzn 0404ee16-ede9-4f6a-a5b1-108b93af740e -- POST / 200 297.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,325 mnist_classifier_MNISTClassifier yxa49nzn 639e2f1b-7e3a-494f-ab88-5f288cefd6f7 -- POST / 200 305.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,325 mnist_classifier_MNISTClassifier yxa49nzn 4cce081d-f7a0-4385-b79b-472ba88eca5e -- POST / 200 304.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,326 mnist_classifier_MNISTClassifier yxa49nzn 56d64d4c-47ed-4b84-8008-520c7fd8add0 -- POST / 200 304.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,326 mnist_classifier_MNISTClassifier yxa49nzn 81f1a323-5b45-4931-9a57-3e69a7eed37a -- POST / 200 304.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,326 mnist_classifier_MNISTClassifier yxa49nzn c53b7334-b694-48bc-956f-6d3a180bcf3b -- POST / 200 303.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,327 mnist_classifier_MNISTClassifier yxa49nzn 044eeb0a-c445-422f-88a4-b6cadb6bfb73 -- POST / 200 302.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,327 mnist_classifier_MNISTClassifier yxa49nzn 2181c212-d99c-4e14-b5f6-9909b5da9401 -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,327 mnist_classifier_MNISTClassifier yxa49nzn 9d634f6b-866d-462f-b1f4-3bbbd751f4e8 -- POST / 200 300.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,327 mnist_classifier_MNISTClassifier yxa49nzn ccea7ba1-7bf0-4475-91c9-bcdd2e965dc5 -- POST / 200 300.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,328 mnist_classifier_MNISTClassifier yxa49nzn 767b20f4-4317-41ad-8938-1c5223252a91 -- POST / 200 297.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,328 mnist_classifier_MNISTClassifier yxa49nzn 3f839852-cb91-497d-8969-92b38747aef4 -- POST / 200 296.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,328 mnist_classifier_MNISTClassifier yxa49nzn 3a21fd57-e393-4192-a763-74bdbd871109 -- POST / 200 297.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,329 mnist_classifier_MNISTClassifier yxa49nzn d48db2f4-42d5-4936-9fea-d0bb4c96ecc1 -- POST / 200 296.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,329 mnist_classifier_MNISTClassifier yxa49nzn d3e41074-5c35-48ac-bcc8-87753e2393d5 -- POST / 200 296.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,329 mnist_classifier_MNISTClassifier yxa49nzn 6730b297-8ffa-4bcd-92a6-a0cfba756f35 -- POST / 200 296.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,330 mnist_classifier_MNISTClassifier yxa49nzn 414ff3d0-eb77-4b2e-9bf5-c6791d19f839 -- POST / 200 288.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,330 mnist_classifier_MNISTClassifier yxa49nzn d57c972b-367e-4369-9af5-8690aa007234 -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,330 mnist_classifier_MNISTClassifier yxa49nzn dcfc31dd-d172-4861-ad87-f3165e941fe2 -- POST / 200 274.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,330 mnist_classifier_MNISTClassifier yxa49nzn ff3a7568-2dc1-4440-8f06-7df12415b421 -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,331 mnist_classifier_MNISTClassifier yxa49nzn bef9b4c1-2333-4ec5-b978-316fbcd4c2d2 -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,331 mnist_classifier_MNISTClassifier yxa49nzn 9d6bba30-2326-4043-a267-a6af10d1b932 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,331 mnist_classifier_MNISTClassifier yxa49nzn 169e0e7b-aa2b-4a1f-82ba-2ca070c6504d -- POST / 200 262.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,332 mnist_classifier_MNISTClassifier yxa49nzn 21b2d789-5f75-469a-9654-846adbba14d0 -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,334 mnist_classifier_MNISTClassifier yxa49nzn a240cf48-497e-43a2-99bc-62410409788e -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,335 mnist_classifier_MNISTClassifier yxa49nzn 55ad7fff-65b7-45b4-b8d8-150cdb847aef -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,335 mnist_classifier_MNISTClassifier yxa49nzn bc02d539-77ac-4394-b493-c6759b821ce2 -- POST / 200 247.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,335 mnist_classifier_MNISTClassifier yxa49nzn a02cf2bc-7938-4868-a395-09e340d860c4 -- POST / 200 245.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,335 mnist_classifier_MNISTClassifier yxa49nzn 8b9dfcaa-f02a-4392-bbf1-16fef1d532c4 -- POST / 200 245.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,336 mnist_classifier_MNISTClassifier yxa49nzn d3159411-2172-4eca-b887-24355c30135c -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,336 mnist_classifier_MNISTClassifier yxa49nzn 69aca5e4-8713-4e28-aa7d-1e1f7ad1bb0d -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,336 mnist_classifier_MNISTClassifier yxa49nzn 6a80fc32-591c-4fa8-95e6-b5b964e766e9 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,337 mnist_classifier_MNISTClassifier yxa49nzn 54709974-fac9-4e3b-9f7e-dd0d22283fb6 -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,337 mnist_classifier_MNISTClassifier yxa49nzn 4132d7c4-db7a-4f50-85e4-4baab3262541 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,338 mnist_classifier_MNISTClassifier yxa49nzn e5566b89-c585-4ee1-9f41-123381be301f -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,338 mnist_classifier_MNISTClassifier yxa49nzn 78ecaae3-ca4c-4362-bbce-60f58b58dcde -- POST / 200 243.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,338 mnist_classifier_MNISTClassifier yxa49nzn 851520ae-0e4c-4bdb-b57d-a4cd436e5214 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,339 mnist_classifier_MNISTClassifier yxa49nzn aca5bcce-e9af-42aa-8f64-b7870e50ee02 -- POST / 200 243.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,339 mnist_classifier_MNISTClassifier yxa49nzn 3a0a2815-fa6c-4f39-b52b-197398f75dc4 -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,339 mnist_classifier_MNISTClassifier yxa49nzn b7b234aa-ed66-435e-ac53-d1747f2b5d6d -- POST / 200 234.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,340 mnist_classifier_MNISTClassifier yxa49nzn f9330780-fffa-4998-82fe-0a0b50c1acef -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,340 mnist_classifier_MNISTClassifier yxa49nzn 6feac2b4-aec0-43d8-8df1-b0b881875db2 -- POST / 200 233.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,340 mnist_classifier_MNISTClassifier yxa49nzn 24fe5b0f-3aae-41d4-b207-5ac4abb036cf -- POST / 200 231.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,341 mnist_classifier_MNISTClassifier yxa49nzn 2827feeb-ca3c-488c-b4d5-dc2750f27881 -- POST / 200 230.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,341 mnist_classifier_MNISTClassifier yxa49nzn 4be3d1da-e0ec-47d3-9bec-3b6638937174 -- POST / 200 229.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,342 mnist_classifier_MNISTClassifier yxa49nzn f6955df1-c0ef-4ed7-9fc0-753604cf9d98 -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,342 mnist_classifier_MNISTClassifier yxa49nzn 9fa5f772-abd4-4ddc-b8fa-1cbd41a0f637 -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,342 mnist_classifier_MNISTClassifier yxa49nzn 687e0658-8cb1-4dd5-8383-b4346013f4f4 -- POST / 200 228.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,343 mnist_classifier_MNISTClassifier yxa49nzn 9a00adb2-3a93-489e-bde5-388aae7d1d40 -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,343 mnist_classifier_MNISTClassifier yxa49nzn 8dc7d2fd-e8ab-4de6-9948-70906e2d1e3f -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,344 mnist_classifier_MNISTClassifier yxa49nzn 4accb14c-d728-4ae8-b95b-ea808e61b052 -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,344 mnist_classifier_MNISTClassifier yxa49nzn 6ec0271d-8b3d-44ab-9feb-ca23d8b7e4ae -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,345 mnist_classifier_MNISTClassifier yxa49nzn af7bb678-6220-4a70-8a6a-d4c7ddc23e2d -- POST / 200 199.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,345 mnist_classifier_MNISTClassifier yxa49nzn 02415106-8d8a-4453-a095-0982744d11b4 -- POST / 200 209.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,348 mnist_classifier_MNISTClassifier yxa49nzn 7869b834-e710-4816-bea3-aa4fe99b5bba -- POST / 200 202.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,348 mnist_classifier_MNISTClassifier yxa49nzn e368353f-2971-4b82-a2be-d19bcae443fc -- POST / 200 205.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,349 mnist_classifier_MNISTClassifier yxa49nzn 7c2c826e-14df-4103-8f62-db330581ff29 -- POST / 200 205.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,349 mnist_classifier_MNISTClassifier yxa49nzn b08fda98-3ae9-46ab-af73-4a487f2b3075 -- POST / 200 202.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,358 mnist_classifier_MNISTClassifier yxa49nzn 6e21ea8b-e29f-447d-86f3-438c2347b630 -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,359 mnist_classifier_MNISTClassifier yxa49nzn 36a13c57-4fb0-4aad-8628-b2e80059ef35 -- POST / 200 209.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,359 mnist_classifier_MNISTClassifier yxa49nzn d4342402-cbd7-49f8-ad39-6008bd7fc545 -- POST / 200 209.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,360 mnist_classifier_MNISTClassifier yxa49nzn 4e1d7710-84d5-4cda-a664-eaa2e6fe286a -- POST / 200 209.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,361 mnist_classifier_MNISTClassifier yxa49nzn f7cf1775-34cb-49bc-8a8b-0dec521d037d -- POST / 200 214.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,361 mnist_classifier_MNISTClassifier yxa49nzn a4a1597d-c1bd-42f8-b134-462571955204 -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,418 mnist_classifier_MNISTClassifier yxa49nzn 7a37cdd1-18b3-4833-8a27-498450a268d6 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,441 mnist_classifier_MNISTClassifier yxa49nzn 2789a1fa-9101-47d3-8735-b8a174fa40b9 -- POST / 200 287.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,442 mnist_classifier_MNISTClassifier yxa49nzn bbdea702-7868-4544-9d81-a3cd5ad2980d -- POST / 200 290.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,445 mnist_classifier_MNISTClassifier yxa49nzn 809c938e-17d7-4f88-83a3-01b2441b7ac7 -- POST / 200 290.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,446 mnist_classifier_MNISTClassifier yxa49nzn 579e00ac-c240-46e0-a37b-32ab6fb720b2 -- POST / 200 293.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,446 mnist_classifier_MNISTClassifier yxa49nzn e7549ffa-0441-497c-b3f0-1fa6c7bf31a5 -- POST / 200 287.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,446 mnist_classifier_MNISTClassifier yxa49nzn 47993546-4a86-452b-85ef-d6990a47027c -- POST / 200 286.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,447 mnist_classifier_MNISTClassifier yxa49nzn 0f4993d4-acec-4a23-b09c-58f4c6a3ca8a -- POST / 200 283.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,447 mnist_classifier_MNISTClassifier yxa49nzn a1551f22-c4d3-42cb-8727-cd022d3ac3d9 -- POST / 200 279.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,447 mnist_classifier_MNISTClassifier yxa49nzn bdf63444-7ab7-4988-934a-1aac6f7da2e4 -- POST / 200 278.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,447 mnist_classifier_MNISTClassifier yxa49nzn 2c54155d-7fbc-4a3a-a1eb-d8cbc55b44c7 -- POST / 200 278.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,447 mnist_classifier_MNISTClassifier yxa49nzn 5ad35fdd-640e-480a-b53c-852714d3eeb4 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,448 mnist_classifier_MNISTClassifier yxa49nzn 93eee275-2c62-43c5-ae7a-4043e1c9f567 -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,448 mnist_classifier_MNISTClassifier yxa49nzn 1e511d78-44f7-45ec-9c6a-0953dc708c2f -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,448 mnist_classifier_MNISTClassifier yxa49nzn 042cdad4-2336-428c-a0d5-a5ceb937cf4b -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,448 mnist_classifier_MNISTClassifier yxa49nzn 417178f5-669c-4ca5-985b-1dbc2552a4a7 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,450 mnist_classifier_MNISTClassifier yxa49nzn 38c406ac-9ece-4f8a-9fc7-b295bfddcbb3 -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,450 mnist_classifier_MNISTClassifier yxa49nzn 24f3b268-b02f-4a11-9c13-f936b8a0692f -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,450 mnist_classifier_MNISTClassifier yxa49nzn 64886d8d-43e7-48f0-b57d-08e7c4a5cf2d -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,451 mnist_classifier_MNISTClassifier yxa49nzn 797d293c-e3c8-41b7-9eea-036bfb66e351 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,451 mnist_classifier_MNISTClassifier yxa49nzn 7965da86-6a57-4513-b734-8845daa9e7e6 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,451 mnist_classifier_MNISTClassifier yxa49nzn 9b59058c-d91f-4dc7-95e0-022cc9d4efef -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,451 mnist_classifier_MNISTClassifier yxa49nzn 5324338a-855f-4c0f-ba2a-11cad6eabb70 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,451 mnist_classifier_MNISTClassifier yxa49nzn 7f955f55-f2c7-4060-a36b-7056e91db982 -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,452 mnist_classifier_MNISTClassifier yxa49nzn 2211f03a-ace0-46f8-a784-f72a2b4d7219 -- POST / 200 245.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,453 mnist_classifier_MNISTClassifier yxa49nzn 3726e08e-1274-4874-9892-2a73bc1629ba -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,454 mnist_classifier_MNISTClassifier yxa49nzn 903cd280-e853-4410-8d74-7fd06015f9bd -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,723 mnist_classifier_MNISTClassifier yxa49nzn 085d0c3d-fdf9-49b8-884d-84e5aa91dce1 -- POST / 200 362.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,738 mnist_classifier_MNISTClassifier yxa49nzn 5268a48f-df19-4b40-963e-10bf1931821c -- POST / 200 377.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,742 mnist_classifier_MNISTClassifier yxa49nzn d91f5e71-8f1d-4bd4-9e62-46a497316ba6 -- POST / 200 379.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,744 mnist_classifier_MNISTClassifier yxa49nzn 9011a58b-7b18-41f4-a6df-bc447110e4e9 -- POST / 200 380.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,745 mnist_classifier_MNISTClassifier yxa49nzn 58c70e62-a47d-4fe7-9986-069b450286c3 -- POST / 200 378.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,745 mnist_classifier_MNISTClassifier yxa49nzn 3180328c-7978-4152-bb81-9ef79c6823fa -- POST / 200 378.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,746 mnist_classifier_MNISTClassifier yxa49nzn 1267c13b-4fc3-4a9f-ab26-de9ccb5c8e8a -- POST / 200 377.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,747 mnist_classifier_MNISTClassifier yxa49nzn 868b5dad-f53d-493b-8b10-98847fa3853d -- POST / 200 378.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,748 mnist_classifier_MNISTClassifier yxa49nzn 23e32960-53c8-49d8-9e1e-f0aec5449e17 -- POST / 200 377.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,748 mnist_classifier_MNISTClassifier yxa49nzn 155a62dd-2355-493a-b141-489303e75dff -- POST / 200 376.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,748 mnist_classifier_MNISTClassifier yxa49nzn a95d4240-6d86-48dd-a0b9-3fab03aebb9b -- POST / 200 376.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,749 mnist_classifier_MNISTClassifier yxa49nzn e1d032a0-45b7-4f9a-bccd-91de76edf914 -- POST / 200 352.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,749 mnist_classifier_MNISTClassifier yxa49nzn 0545cf4a-12e3-4d52-9551-3f9f2ef97a1c -- POST / 200 369.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,750 mnist_classifier_MNISTClassifier yxa49nzn 87778511-a86f-4a4e-91d0-031ee7418c3c -- POST / 200 369.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,750 mnist_classifier_MNISTClassifier yxa49nzn dd0685aa-f78a-4853-bb9a-827c8477dbed -- POST / 200 368.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,751 mnist_classifier_MNISTClassifier yxa49nzn 5aa49dc1-0ed0-4e4f-aa29-74ca4840938f -- POST / 200 367.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,752 mnist_classifier_MNISTClassifier yxa49nzn d912f348-ebb1-4819-a399-996083edc87f -- POST / 200 363.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,752 mnist_classifier_MNISTClassifier yxa49nzn dc9d939c-c019-417b-8326-149e5e1f0fbf -- POST / 200 358.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,753 mnist_classifier_MNISTClassifier yxa49nzn d0a7e2df-a25f-4018-9e57-34ba577b6327 -- POST / 200 357.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,754 mnist_classifier_MNISTClassifier yxa49nzn 9b7ed4e6-9e32-4efc-baf1-f4bde95ab5ae -- POST / 200 354.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,842 mnist_classifier_MNISTClassifier yxa49nzn d9bb6ea7-eb86-4876-a82b-a952d1608dec -- POST / 200 401.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,846 mnist_classifier_MNISTClassifier yxa49nzn 7e1a5165-23d9-48f7-8928-79e5b9d97f1d -- POST / 200 431.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,847 mnist_classifier_MNISTClassifier yxa49nzn bdedf1aa-2184-46eb-8963-de1d3f77a395 -- POST / 200 429.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,849 mnist_classifier_MNISTClassifier yxa49nzn 2dbd7970-a4bf-4802-9cc9-094e5b74cccf -- POST / 200 408.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,851 mnist_classifier_MNISTClassifier yxa49nzn cb2cd429-69fd-477c-8b87-c50c49c06c92 -- POST / 200 410.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,851 mnist_classifier_MNISTClassifier yxa49nzn a83d7c73-7e81-4d84-931e-a38e1b15b159 -- POST / 200 410.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,857 mnist_classifier_MNISTClassifier yxa49nzn febaacd1-c9c7-491b-8680-a4eaa5b56116 -- POST / 200 399.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,859 mnist_classifier_MNISTClassifier yxa49nzn b78f5d3c-f2e8-4ba5-9123-92b10486aeb5 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,859 mnist_classifier_MNISTClassifier yxa49nzn 7107ed2a-41eb-453d-84a8-957ca9159af1 -- POST / 200 398.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,860 mnist_classifier_MNISTClassifier yxa49nzn eb1451b1-2e6b-428e-b1a2-6560545a160d -- POST / 200 398.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,860 mnist_classifier_MNISTClassifier yxa49nzn 41dd1182-e560-46ff-bb3e-de91bddc4db5 -- POST / 200 399.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,861 mnist_classifier_MNISTClassifier yxa49nzn 884a8fef-1a64-41e2-8ca4-16e36f26ee09 -- POST / 200 399.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,862 mnist_classifier_MNISTClassifier yxa49nzn a0f660ee-93cf-4489-aaca-66f326df0c71 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,863 mnist_classifier_MNISTClassifier yxa49nzn d5cce3bb-6f90-4c00-bcba-ee372bd1c1c7 -- POST / 200 399.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,864 mnist_classifier_MNISTClassifier yxa49nzn 91282496-4038-4787-ac00-f2494b543d10 -- POST / 200 399.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,865 mnist_classifier_MNISTClassifier yxa49nzn 5f6df5e6-b3f6-4b5f-9a15-7abbf9136ead -- POST / 200 400.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,866 mnist_classifier_MNISTClassifier yxa49nzn 45df4093-fee5-4cce-96aa-be299b4fb4b9 -- POST / 200 398.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,867 mnist_classifier_MNISTClassifier yxa49nzn 3eb15208-b3d9-4b75-9974-dd5e3162d835 -- POST / 200 390.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,871 mnist_classifier_MNISTClassifier yxa49nzn 7a7f1800-065b-4779-ad91-da2c0d7c6537 -- POST / 200 393.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,871 mnist_classifier_MNISTClassifier yxa49nzn 3750a831-a125-471e-8640-ee7a946d8b74 -- POST / 200 394.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,872 mnist_classifier_MNISTClassifier yxa49nzn 27f2bb26-0546-4381-befd-e7d625b49618 -- POST / 200 394.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,872 mnist_classifier_MNISTClassifier yxa49nzn f0c49c22-d2a1-4742-bf61-4ef9678f2b62 -- POST / 200 394.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,872 mnist_classifier_MNISTClassifier yxa49nzn ad56c102-1d20-4cc0-baa0-1ed58e7b74ab -- POST / 200 394.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,873 mnist_classifier_MNISTClassifier yxa49nzn c4239276-f3ca-4014-8114-76c9e6d44d53 -- POST / 200 394.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,873 mnist_classifier_MNISTClassifier yxa49nzn 0094648f-0250-4e82-b4bd-fc50fd955ad8 -- POST / 200 395.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,874 mnist_classifier_MNISTClassifier yxa49nzn 46066081-1575-415e-a3bc-c0619fc5aa1b -- POST / 200 395.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,874 mnist_classifier_MNISTClassifier yxa49nzn c43cf00c-e0b9-4976-bd4e-15b6aebb9454 -- POST / 200 395.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,875 mnist_classifier_MNISTClassifier yxa49nzn 1514d370-c58b-460f-ae0d-5bd1f2d53ed8 -- POST / 200 396.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,875 mnist_classifier_MNISTClassifier yxa49nzn 2643f989-9f91-4c17-9154-128aba9445b0 -- POST / 200 396.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,876 mnist_classifier_MNISTClassifier yxa49nzn caf6d4f0-9649-498e-9ac5-796b743a9914 -- POST / 200 395.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,876 mnist_classifier_MNISTClassifier yxa49nzn 94fc7f1a-6f00-4a04-87b4-d28b0eb04d66 -- POST / 200 393.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,877 mnist_classifier_MNISTClassifier yxa49nzn 4e04aedf-7633-404f-9fe3-6a71d26cf115 -- POST / 200 392.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,878 mnist_classifier_MNISTClassifier yxa49nzn 625845d8-56f8-4eee-a014-abe33e6c918f -- POST / 200 391.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,878 mnist_classifier_MNISTClassifier yxa49nzn 2eb3f3dd-44ef-49ca-a1f1-7fed77bd5d37 -- POST / 200 392.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,879 mnist_classifier_MNISTClassifier yxa49nzn bcb86bc6-6c98-44fc-b81a-eb15e1583c97 -- POST / 200 393.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,880 mnist_classifier_MNISTClassifier yxa49nzn 51a766ad-5aae-4857-a71d-6170656ee1be -- POST / 200 391.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,880 mnist_classifier_MNISTClassifier yxa49nzn 4e98450c-7c7c-4202-aac5-cf5b28c86232 -- POST / 200 391.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,881 mnist_classifier_MNISTClassifier yxa49nzn 2b9e4ebd-7fa0-4cd2-8ca7-cda29b87d6b6 -- POST / 200 391.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,882 mnist_classifier_MNISTClassifier yxa49nzn 5b7da478-4fbd-44b2-aa5b-5d7f677acbd8 -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,882 mnist_classifier_MNISTClassifier yxa49nzn a2d7d45a-d3d1-469d-a2cd-74e5ce6adb1c -- POST / 200 388.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,883 mnist_classifier_MNISTClassifier yxa49nzn 7d084145-3087-44a9-bc94-f07b04daa721 -- POST / 200 389.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,884 mnist_classifier_MNISTClassifier yxa49nzn 513f9508-9bf0-4fe6-a84e-a51c76385653 -- POST / 200 387.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,885 mnist_classifier_MNISTClassifier yxa49nzn 7ea3c86c-ade3-48b8-806c-535452647dc1 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,885 mnist_classifier_MNISTClassifier yxa49nzn 6b50ba69-a11a-4301-bbd9-fb548b01cba0 -- POST / 200 387.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,887 mnist_classifier_MNISTClassifier yxa49nzn 900a7b66-9c78-428d-ac04-3620b456aa66 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,888 mnist_classifier_MNISTClassifier yxa49nzn 37e4362a-3b4c-4827-a846-e25c775cb92e -- POST / 200 387.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,888 mnist_classifier_MNISTClassifier yxa49nzn 0c7f95a0-1fe0-48e3-b3c9-bc6abaf9086e -- POST / 200 385.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,889 mnist_classifier_MNISTClassifier yxa49nzn f60eb7e1-114b-4cb9-8777-f2698f7030c5 -- POST / 200 385.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,889 mnist_classifier_MNISTClassifier yxa49nzn 8393e015-5d9f-47be-b10e-3dec9ba84fb7 -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,889 mnist_classifier_MNISTClassifier yxa49nzn 3cf8291c-6697-47da-b404-dd9eb2d25001 -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,890 mnist_classifier_MNISTClassifier yxa49nzn ff2411fa-6fec-41db-b45d-87d52852ddd9 -- POST / 200 384.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,893 mnist_classifier_MNISTClassifier yxa49nzn da32118b-0920-427a-8da0-4c21aa66e958 -- POST / 200 387.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,894 mnist_classifier_MNISTClassifier yxa49nzn 3371d156-7fae-4ac1-884d-00b8f9e4fff4 -- POST / 200 387.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,894 mnist_classifier_MNISTClassifier yxa49nzn eb4e2410-53a3-4643-a611-8881e2eca6ab -- POST / 200 380.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,895 mnist_classifier_MNISTClassifier yxa49nzn 472bb05a-c5ab-4929-8ee4-e007bf9f8f60 -- POST / 200 377.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,896 mnist_classifier_MNISTClassifier yxa49nzn b7cafd12-8af1-40aa-8da9-655f3e91c269 -- POST / 200 377.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,897 mnist_classifier_MNISTClassifier yxa49nzn 5104a0df-f97c-482f-9316-ba8380128c0a -- POST / 200 376.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,898 mnist_classifier_MNISTClassifier yxa49nzn 298e42fe-928e-4a54-a0e5-436c79efd7cf -- POST / 200 377.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,898 mnist_classifier_MNISTClassifier yxa49nzn f91b70b3-f6e9-4608-9ed2-f2a36cb2eda0 -- POST / 200 235.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,899 mnist_classifier_MNISTClassifier yxa49nzn 9ca6d308-5f30-4380-b046-115fbcd9577a -- POST / 200 235.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,899 mnist_classifier_MNISTClassifier yxa49nzn 7678703f-2418-4384-bf12-a3cbc0bba877 -- POST / 200 233.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,899 mnist_classifier_MNISTClassifier yxa49nzn e3adb243-649e-4445-89c1-b79e01a05c64 -- POST / 200 232.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,900 mnist_classifier_MNISTClassifier yxa49nzn e38f68ec-ddbc-479a-b9e2-435af46ccfd0 -- POST / 200 232.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,900 mnist_classifier_MNISTClassifier yxa49nzn 5bbe3c61-d215-4fba-b265-903bd01fb8e1 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,901 mnist_classifier_MNISTClassifier yxa49nzn 8381b0f0-846f-41ff-8a7b-887673f510ca -- POST / 200 232.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,901 mnist_classifier_MNISTClassifier yxa49nzn 8797e0a0-f24c-4203-9391-d79df0c4cc38 -- POST / 200 232.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,901 mnist_classifier_MNISTClassifier yxa49nzn 80d9cdd1-bbdd-487b-8811-d5da29083e79 -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,902 mnist_classifier_MNISTClassifier yxa49nzn 456f261c-997b-4621-90f0-74df15fa7d1b -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,902 mnist_classifier_MNISTClassifier yxa49nzn 4b563b96-1500-4c43-acad-79055cad5e8c -- POST / 200 233.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,903 mnist_classifier_MNISTClassifier yxa49nzn ec4ae11e-6a3b-4bac-9ef3-b61055a65bed -- POST / 200 233.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,904 mnist_classifier_MNISTClassifier yxa49nzn eb8b970b-c0d4-4615-b48f-ec0a43275b14 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,904 mnist_classifier_MNISTClassifier yxa49nzn 6fd80dc1-870f-4a9d-a495-4585e3680391 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,905 mnist_classifier_MNISTClassifier yxa49nzn aa7d5349-efef-48b9-9c90-68337b219554 -- POST / 200 232.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,905 mnist_classifier_MNISTClassifier yxa49nzn 517c8268-a44a-4904-b4ce-21d2ee546bbd -- POST / 200 231.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,905 mnist_classifier_MNISTClassifier yxa49nzn cb4e414e-9d90-482b-80c4-ce7f7c9e7bab -- POST / 200 230.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,906 mnist_classifier_MNISTClassifier yxa49nzn ad2a30f3-7328-403a-bf1f-48a3377feb4a -- POST / 200 234.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,920 mnist_classifier_MNISTClassifier yxa49nzn a9a0b350-cd1b-4701-88b9-00ff8ef55109 -- POST / 200 243.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,923 mnist_classifier_MNISTClassifier yxa49nzn 933aa8c9-582b-4bc6-a291-60fe9a1c3259 -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,923 mnist_classifier_MNISTClassifier yxa49nzn 39572122-8ae4-4945-af3a-af4707a0775c -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,924 mnist_classifier_MNISTClassifier yxa49nzn fbd9d112-9604-410a-90f1-8900b8d2a067 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,924 mnist_classifier_MNISTClassifier yxa49nzn b66303a2-e145-4830-9467-f4aa4dafc938 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,924 mnist_classifier_MNISTClassifier yxa49nzn e674a0c2-1797-408e-ace9-f1c155d8323a -- POST / 200 212.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,925 mnist_classifier_MNISTClassifier yxa49nzn c79de2ba-902b-416d-83a2-67d7bf7b5daa -- POST / 200 211.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,925 mnist_classifier_MNISTClassifier yxa49nzn fd49738d-8bd7-4c71-b477-f192fcbeef76 -- POST / 200 208.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,925 mnist_classifier_MNISTClassifier yxa49nzn 521fe69b-f55e-4b75-931c-6cb9dc703c2b -- POST / 200 208.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,925 mnist_classifier_MNISTClassifier yxa49nzn 433cbddb-a57c-4502-b0be-28f28a73d343 -- POST / 200 167.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,925 mnist_classifier_MNISTClassifier yxa49nzn b821b727-9390-4a68-abb5-37a3d1b3447b -- POST / 200 151.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,925 mnist_classifier_MNISTClassifier yxa49nzn 04218ff3-5096-4b42-aa7b-cfcac37be2ab -- POST / 200 149.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,926 mnist_classifier_MNISTClassifier yxa49nzn cee3b879-cd2e-4472-9191-6a2774edafc4 -- POST / 200 150.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,926 mnist_classifier_MNISTClassifier yxa49nzn 56889f3a-9516-4e3d-9628-f8b16f734b3f -- POST / 200 142.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,926 mnist_classifier_MNISTClassifier yxa49nzn 307223f9-c4e9-49ed-86f1-aed4040d9163 -- POST / 200 141.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,926 mnist_classifier_MNISTClassifier yxa49nzn 347e0a0a-52be-4abe-9d6d-e7d09e016a54 -- POST / 200 141.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,927 mnist_classifier_MNISTClassifier yxa49nzn 1304c866-5b02-4b1e-bd56-892d858f7bc3 -- POST / 200 141.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,927 mnist_classifier_MNISTClassifier yxa49nzn 40d8b54d-af09-4a6d-b51e-37a5cd3ccc7b -- POST / 200 140.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,927 mnist_classifier_MNISTClassifier yxa49nzn c4648baa-3b0e-4e0a-bae5-053f0c38421b -- POST / 200 135.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,927 mnist_classifier_MNISTClassifier yxa49nzn 6196363b-70dc-49dc-bdc8-ea1e0aaa9eef -- POST / 200 133.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,928 mnist_classifier_MNISTClassifier yxa49nzn fba91d39-b434-471b-9235-b3f03b570724 -- POST / 200 134.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,928 mnist_classifier_MNISTClassifier yxa49nzn 2b885aed-15ad-497e-8430-386c66705b91 -- POST / 200 134.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,929 mnist_classifier_MNISTClassifier yxa49nzn cf1e9a5a-f6d0-41ab-9ef3-907722e1d354 -- POST / 200 134.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4643) INFO 2026-04-23 17:55:54,929 mnist_classifier_MNISTClassifier yxa49nzn 4805b261-a266-4f84-89f9-d77b12b9bf8f -- POST / 200 134.1ms
Processed 1000 requests in 5.11 seconds
Throughput: 195.73 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.