Source: model_server/utils/prediction_utils.py#L0

create_predict_request

create_predict_request(input_tensorproto_dict, name=None, version=None)

Creates a PredictRequest proto

Arguments:

  • input_tensorproto_dict (dict): A dictionary with key (typically input tensor name string) and value as TensorProto.
  • name (str): Optional model name. Default None
  • version (str): Optional model version. Default None

Returns:

PredictRequest proto

create_predict_response

create_predict_response(output_tensorproto_dict, name=None, version=None)

Creates a PredictResponse proto

Arguments:

  • input_tensorproto_dict (dict): A dictionary with key (typically output tensor name string) and value as TensorProto.
  • name (str): Optional model name. Default None
  • version (str): Optional model version. Default None

Returns:

PredictResponse proto