Get CUDA Information

This gives information about your cuda usage.

---

GET /device/cuda

Example

CUDA

Marqo Open SourceMarqo Cloud

cURLPython

curl -XGET http://localhost:8882/device/cuda

results = mq.index("my-index").get_cuda_info()

For Marqo Cloud, you will need to access the endpoint of your index and replace your_endpoint with this. To do this, visit Find Your Endpoint. You will also need your API Key. To obtain this key visit Find Your API Key.

cURLPython

curl -XGET your_endpoint/device/cuda \
-H 'x-api-key: XXXXXXXXXXXXXXX'

results = mq.index("my-index").get_cuda_info()

Response: 200 OK

{
   "cuda_devices": [
     {
       "device_id": 0,
       "device_name": "Tesla T4",
       "memory_used": "1.7 GiB",
       "total_memory": "14.6 GiB",
       "utilization": "11.0 %",
       "memory_used_percent": "25.0 %"
     }
   ]
}