Class: Google::Cloud::Dialogflow::V2::ConversationModelEvaluation

Inherits:
Object
  • Object
show all
Extended by:
Protobuf::MessageExts::ClassMethods
Includes:
Protobuf::MessageExts
Defined in:
proto_docs/google/cloud/dialogflow/v2/conversation_model.rb

Overview

Represents evaluation result of a conversation model.

Instance Attribute Summary collapse

Instance Attribute Details

#create_time ⇒ ::Google::Protobuf::Timestamp (readonly)

Returns Output only. Creation time of this model.

Returns:



147
148
149
150
 
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 147

class ConversationModelEvaluation
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#display_name ⇒ ::String

Returns Optional. The display name of the model evaluation. At most 64 bytes long.

Returns:

  • (::String) —

    Optional. The display name of the model evaluation. At most 64 bytes long.



147
148
149
150
 
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 147

class ConversationModelEvaluation
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#evaluation_config ⇒ ::Google::Cloud::Dialogflow::V2::EvaluationConfig

Returns Optional. The configuration of the evaluation task.

Returns:



147
148
149
150
 
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 147

class ConversationModelEvaluation
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#name ⇒ ::String

Returns The resource name of the evaluation. Format: projects/<Project ID>/conversationModels/<Conversation Model ID>/evaluations/<Evaluation ID>.

Returns:

  • (::String) —

    The resource name of the evaluation. Format: projects/<Project ID>/conversationModels/<Conversation Model ID>/evaluations/<Evaluation ID>



147
148
149
150
 
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 147

class ConversationModelEvaluation
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#raw_human_eval_template_csv ⇒ ::String (readonly)

Returns Output only. Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.

Returns:

  • (::String) —

    Output only. Human eval template in csv format. It tooks real-world conversations provided through input dataset, generates example suggestions for customer to verify quality of the model. For Smart Reply, the generated csv file contains columns of Context, (Suggestions,Q1,Q2)*3, Actual reply. Context contains at most 10 latest messages in the conversation prior to the current suggestion. Q1: "Would you send it as the next message of agent?" Evaluated based on whether the suggest is appropriate to be sent by agent in current context. Q2: "Does the suggestion move the conversation closer to resolution?" Evaluated based on whether the suggestion provide solutions, or answers customer's question or collect information from customer to resolve the customer's issue. Actual reply column contains the actual agent reply sent in the context.



147
148
149
150
 
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 147

class ConversationModelEvaluation
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end

#smart_reply_metrics ⇒ ::Google::Cloud::Dialogflow::V2::SmartReplyMetrics (readonly)

Returns Output only. Only available when model is for smart reply.

Returns:



147
148
149
150
 
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 147

class ConversationModelEvaluation
  include ::Google::Protobuf::MessageExts
  extend ::Google::Protobuf::MessageExts::ClassMethods
end