Class: Google::Cloud::Dialogflow::V2::SmartReplyMetrics
- Inherits:
-
Object
- Object
- Google::Cloud::Dialogflow::V2::SmartReplyMetrics
- Extended by:
- Protobuf::MessageExts::ClassMethods
- Includes:
- Protobuf::MessageExts
- Defined in:
- proto_docs/google/cloud/dialogflow/v2/conversation_model.rb
Overview
The evaluation metrics for smart reply model.
Defined Under Namespace
Classes: TopNMetrics
Instance Attribute Summary collapse
-
#allowlist_coverage ⇒ ::Float
Percentage of target participant messages in the evaluation dataset for which similar messages have appeared at least once in the allowlist.
-
#conversation_count ⇒ ::Integer
Total number of conversations used to generate this metric.
-
#top_n_metrics ⇒ ::Array<::Google::Cloud::Dialogflow::V2::SmartReplyMetrics::TopNMetrics>
Metrics of top n smart replies, sorted by [TopNMetric.n][].
Instance Attribute Details
#allowlist_coverage ⇒ ::Float
Returns Percentage of target participant messages in the evaluation dataset for which similar messages have appeared at least once in the allowlist. Should be [0, 1].
253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 |
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 253 class SmartReplyMetrics include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Evaluation metrics when retrieving `n` smart replies with the model. # @!attribute [rw] n # @return [::Integer] # Number of retrieved smart replies. For example, when `n` is 3, this # evaluation contains metrics for when Dialogflow retrieves 3 smart replies # with the model. # @!attribute [rw] recall # @return [::Float] # Defined as `number of queries whose top n smart replies have at least one # similar (token match similarity above the defined threshold) reply as the # real reply` divided by `number of queries with at least one smart reply`. # Value ranges from 0.0 to 1.0 inclusive. class TopNMetrics include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |
#conversation_count ⇒ ::Integer
Returns Total number of conversations used to generate this metric.
253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 |
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 253 class SmartReplyMetrics include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Evaluation metrics when retrieving `n` smart replies with the model. # @!attribute [rw] n # @return [::Integer] # Number of retrieved smart replies. For example, when `n` is 3, this # evaluation contains metrics for when Dialogflow retrieves 3 smart replies # with the model. # @!attribute [rw] recall # @return [::Float] # Defined as `number of queries whose top n smart replies have at least one # similar (token match similarity above the defined threshold) reply as the # real reply` divided by `number of queries with at least one smart reply`. # Value ranges from 0.0 to 1.0 inclusive. class TopNMetrics include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |
#top_n_metrics ⇒ ::Array<::Google::Cloud::Dialogflow::V2::SmartReplyMetrics::TopNMetrics>
Returns Metrics of top n smart replies, sorted by [TopNMetric.n][].
253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 |
# File 'proto_docs/google/cloud/dialogflow/v2/conversation_model.rb', line 253 class SmartReplyMetrics include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods # Evaluation metrics when retrieving `n` smart replies with the model. # @!attribute [rw] n # @return [::Integer] # Number of retrieved smart replies. For example, when `n` is 3, this # evaluation contains metrics for when Dialogflow retrieves 3 smart replies # with the model. # @!attribute [rw] recall # @return [::Float] # Defined as `number of queries whose top n smart replies have at least one # similar (token match similarity above the defined threshold) reply as the # real reply` divided by `number of queries with at least one smart reply`. # Value ranges from 0.0 to 1.0 inclusive. class TopNMetrics include ::Google::Protobuf::MessageExts extend ::Google::Protobuf::MessageExts::ClassMethods end end |