NewClassic
Back to Framework

AI Platform

Technical infrastructure for AI solution delivery including model management, data layer, AI gateway, orchestration, and AI operations

The pointBuild the platform one funded use case at a time.
At a glanceThe platform stack, end to end

PLATFORM MATURITY LADDER

P0 → P3 — each tier is built only when the previous one demonstrably runs out of road.

START SIMPLE
Value, Maturity & Complexity Increase →
SCALE UP
P0Direct API
One vendor API + secrets vault + spend alertWhen: Demos, pilots, single teamNo gateway, no platform team — do not build ahead of demand
More than 2 teams calling models? Shadow AI appearing?
P1Gateway
+ Central model gateway: authN/Z, rate limits, PII redaction, logging, cost visibility, model routingWhen: Multiple teams, first production workloadsNo vector infra, no eval platform yet — gateway before services
Teams rebuilding RAG, evals, prompts from scratch?
P2Shared Services
+ Data products + vector/retrieval infra, Evaluation Services (golden sets, runners, judges), prompt/pattern library, observability, registriesWhen: Reuse matters, 5+ use casesNo agent runtime yet — shared services before autonomy
Long-running agents taking actions in production?
P3Agent-Ready
+ Orchestration runtime, agent identity & auth, HITL workflows, MCP/A2A protocols, agent registry & lifecycle, FinOps chargeback, autonomy controlsWhen: Agentic workloads at scaleOnly with funded agentic use cases — the heaviest tier
Platform ahead of demand is failure mode #3 — platform behind demand is shadow AI
Architecture
Data Sources
Use Cases

Model Assessment & Selection

from P0
FOUNDATION
OpenAI
Anthropic
Google
Others
OR
OPEN SOURCE
Llama/Meta
Mistral
DeepSeek
Others
Vendors illustrative, as of 2026
DEPLOYMENT (for Open Source)
CloudAWS/Azure/GCP
On-PremiseOwn infrastructure
MODEL CAPABILITIES
Agent-OptimizedModels for agentic use
Reasoning ModelsComplex planning
Model RoutingIntelligent selection
Context StrategyLong context mgmt
Model RegistryVersion catalog
Model ModalityText, image, audio
Assemble vs AdoptSuite vs best-of-breed

Data Layer

from P2
AI DATA COMPONENTS
Vector DBEmbeddings storage
Graph DBRelationship data
Knowledge BaseAgent knowledge
Real-time FeedsStreaming data
DATA INTEROPERABILITY
Data PrepValidation & quality
IntegrationCross-system
ETL/ELTData pipelines
DATA FABRIC
Unified Access
Virtualization
Metadata Mgmt
Governance
Data Products
ENTERPRISE DATA SOURCES
Data LakeRaw/unstructured
Data WarehouseStructured analytics
LakehouseHybrid approach
Other SourcesAPIs, DBs, files

Enterprise AI Gateway

from P1
INPUT (Prompt)
Rate LimitingAPI usage controls
SSO/RBACIdentity & access mgmt
PII RedactionData protection
Prompt GuardInjection protection
Agent Identity & AuthAgent authentication
Action AuthorizationPermission controls
GuardrailsContent safety (input)
OUTPUT (Response)
Groundedness ChecksJudge-model grounding scores
Output MonitoringSampled fairness & drift audits
GuardrailsContent safety (output)
SHARED
Monitoring
Logging
Caching
Session Mgmt
Agent Protocols

Orchestration

from P3
RUNTIME EXECUTION
Workflow EngineMulti-agent execution
HITL WorkflowsHuman approval
Edge OrchestrationEdge AI coordination
Dynamic ProvisioningOn-demand scaling
AGENT MANAGEMENT
Agent RegistryCatalog & discovery
Lifecycle MgmtDeploy, update, retire
FRAMEWORKS
Orchestratione.g. LangChain, LlamaIndex
Agentice.g. CrewAI, AutoGen
Prompt LibraryTemplate mgmt
Illustrative, as of 2026
INTEGRATIONS & PROTOCOLS
Partner HubThird-party integrations
MCP ProtocolModel Context Protocol
A2A ProtocolAgent-to-Agent comms

AI Ops

from P2
GOVERNANCE & COMPLIANCE
Security & ComplianceSecurity ops
SLAs & MetricsPerformance targets
Audit TrailCompliance logs
OBSERVABILITY
PerformanceSystem tracking
Agent ObservabilityDecision tracing
Anomaly DetectionUnusual behavior
ANALYSIS & INSIGHTS
Debugging & ReplayBehavior analysis
LLM as JudgeRuntime AI evaluation
Cost AttributionPer-agent costs
Evaluation ServicesGolden sets, runners, judges
OPERATIONS
ML & LLM OpsModel operations
Feedback LoopContinuous learning
Platform
Services
Cloud-Native
Secure
Scalable
Observable
Agent-Ready
Enterprise AI Platform - AI Transformation Framework