Skip to content

Evaluation Parameters

Required Evaluation Parameters

Name Type Description
leftKeys list[str] List of column names for the left features, typically text fields.
leftWeights list[str] List of weights for the left features.
rightKeys list[str] List of column names for the right features. The first field should be an image, and the others should be text fields.
rightWeights list[float] List of weights for the right features.

Optional Evaluation Parameters

Name Type Default value Description
batchSize int 64 Batch size.
contextLength int 77 Maximum number of tokens in the input text to train with.
numWorkers int 4 Number of data loader workers.
topQ int 1000 The number of queries to sample from the input set.

Example

evaluate_task_params = {
    "leftKeys": ["query"],
    "rightKeys": ["my_image", "my_text"],
    "leftWeights": [1],
    "rightWeights": [0.9, 0.1],
    "batchSize": 32,
    "numWorkers": 4,
    "contextLength": 77,
    "topQ": 2000,
}