Nomad Media AI Concepts and Usage
How Nomad Media uses AI to enrich asset metadata while keeping all data within the customer's AWS account.
AI Metadata Overview
The Nomad Media platform uses a secure approach to AI. All metadata generated by AI models is stored exclusively within the customer's AWS account:
- Media storage — All media resides in the customer's S3 bucket. When a media file needs to be analyzed, a read-only, time-limited link (typically less than 24 hours) is provided to the AI model.
- AI-generated metadata — All AI-generated metadata is stored in the customer's S3 account as supporting JSON files accompanying each media asset. Files are associated to the asset through an Asset Registry in the customer's DynamoDB tables.
- Face recognition — If face recognition is enabled, any customer-supplied naming information (the mapping of AI-generated face IDs to names, known as a "person") is stored only in the customer's DynamoDB tables. This data is never shared outside the customer's AWS account.
- No AI training on customer data — Nomad Media does not use any customer data for AI training purposes. If a customer wishes to train their own custom models, the resulting models and data remain the exclusive property of the customer.
All AI models and analysis are optional. Each model can be individually enabled or disabled.
AI Model Overview
| Model | Notes |
|---|---|
| Amazon AI Services (Rekognition, Transcribe, Textract) | Runs within the Nomad Media AWS account. Inference results are returned directly to the customer and not retained by Nomad Media. |
| Amazon Bedrock | Used to run third-party models inside the Nomad Media AWS account. |
| Twelve Labs | Generates deep visual and audio search embeddings for video. Twelve Labs does not store the original video, but does store embeddings in their vector database for search purposes. |
| Mobius Labs | Used for concept detection, celebrity detection, and other AI analysis. Runs within the Nomad Media AWS account. Inference results are returned directly to the customer and not retained by Nomad Media. |
| Hugging Face | Custom AI models retrieved from Hugging Face and run inside the Nomad Media AWS account via AWS SageMaker. Inference results are returned directly to the customer and not retained by Nomad Media. |
| Microsoft Cognitive Services | AI API calls are processed inside the Azure cloud. Inference results are returned directly to the customer and not retained in the Azure cloud. |
| Other Third Parties | Any third-party AI provider used by Nomad Media is contractually restricted to using customer media only for the purpose of generating AI metadata. Resulting media and metadata are not retained by the third party. |