Glossary

Inference

The moment a trained model is used to answer. Every reply a chatbot gives you is an inference and has a computing cost.

Related terms

• Training
• Local model

← Back to the full glossary