AI service architecture — Python, FastAPI, and the request that takes five seconds¶
An AI endpoint and a CRUD endpoint speak the same protocol — HTTP in, JSON out — and nothing else about them is alike. A CRUD request touches a database for a few milliseconds and returns; an AI request holds a socket open for seconds while a model generates tokens it cannot predict the length of, and every one of those seconds costs money whether or not the client is still listening. …
🔒 La suite est en accès freemium — lecture complète 100 % gratuite
Tu lis ici l'aperçu libre. Le reste du chapitre (code, schémas, maths, exercices) fait partie du livre complet : crée un compte gratuit (30 secondes, aucun paiement) pour tout lire.