Cloudflare Docs
Constellation
Visit Constellation on GitHub
Set theme to dark (⇧+D)

Constellation runtimes

With innovation to AI, various machine learning (ML) and AI tools and frameworks are emerging and being improved over time. Constellation was designed to support multiple ML runtimes at its core.

Our vision is to support multiple runtimes. Currently, we only support the ONNX Runtime, and are exploring and researching others. XGBoost is in the final stages of testing.

Key
NameDescription
ONNXONNX RuntimeCross-platform machine-learning model accelerator. ONNX Runtime can be used with converted models from PyTorch, Tensorflow/Keras, TFLite, scikit-learn, and other frameworks.

Use Wrangler to list the models Cloudflare supports:

$ npx wrangler constellation runtime list
┌──────┐
│ name │
├──────┤
│ ONNX │
└──────┘

​​ Supported runtimes

​​ ONNX

Constellation supports the ONNX Runtime. The Open Neural Network Exchange (ONNX) is an ecosystem supported by multiple technology companies and research organizations, defines open standards for machine learning, and makes open-source software for AI.

The Open Neural Network Exchange (ONNX) is an ecosystem supported by multiple technology companies and research organizations. ONNX defines open standards for machine learning, and makes open-source software for AI.

The two essential parts of ONNX are the open file format), made with interoperability and easy conversion from other formats in mind, and the ONNX Runtime, which we are running in Constellation.