Evaluation Parameters

Required Evaluation Parameters

Name	Type	Description
leftKeys	list[str]	List of column names for the left features, typically text fields.
leftWeights	list[str]	List of weights for the left features.
rightKeys	list[str]	List of column names for the right features. The first field should be an image, and the others should be text fields.
rightWeights	list[float]	List of weights for the right features.

Optional Evaluation Parameters

Name	Type	Default value	Description
batchSize	int	64	Batch size.
contextLength	int	77	Maximum number of tokens in the input text to train with.
numWorkers	int	4	Number of data loader workers.
runQueriesCpu	bool	True	Run queries in CPU (faster and less prone to GPU memory overflows).
topQ	int	-1	The number of queries to sample from the input set, -1 defaults to the full dataset.

Example

evaluate_task_params = {
    "leftKeys": ["query"],
    "rightKeys": ["my_image", "my_text"],
    "leftWeights": [1],
    "rightWeights": [0.9, 0.1],
    "batchSize": 32,
    "numWorkers": 4,
    "contextLength": 77,
    "topQ": 2000,
}