MMM Models Table (BETA)

mmm_models_table

The MMM Models table stores Marketing Mix Modeling model runs, including configuration and train/test accuracy. One row per model run. A configuration can have multiple retrained runs over time.

📋

Table Guide

What You Can Answer With This Table

  • Which model run is current for a configuration? — use settings_id, window_end_date
  • How accurate was a model run on held-out data? — use test_smape, test_wmape, test_r_squared
  • Which KPI, efficiency ratio, and granularity define the run? — use kpi, efficiency_ratio_type, time_unit

Before You Query

  • This table is not time-series, so no date filter is needed.

Key Relationships

TableJoin KeyUse This Join To
MMM Predictionsmodel_idCompare a model run's predicted vs actual KPI over time
MMM Attributionsmodel_idBreak a model run's KPI into per-group contributions
MMM Marginal Liftsmodel_idGet each modeled group's marginal return for a model run
MMM Campaign Groupsmodel_idSee which campaigns were grouped into each modeled group for a model run
MMM Reallocation Settingsmodel_idGet the budget optimization and simulation scenarios run on a model

When to Use a Different Table

  • Use MMM Reallocations when you need scenario budget moves per modeled group. MMM Models stores model configuration and aggregate run accuracy.
  • Use MMM Predictions when you need predicted vs actual KPI values over time. MMM Models stores run-level accuracy metrics.

View the full Triple Whale Data Ontology →


Dimensions

Dimensions are immutable properties that can be used for grouping data.

TitleIDTypeDescription
Model Run Created Datecreated_attimestamp

The time at which the model run was written to the database. Formatted according to the ISO 8601 international standard.

Example value: 2024-01-22 06:15:00

Exclude Amazonexclude_amazonboolean

True if Amazon data was excluded from the model's training.

Possible values: true, false

Exclude Black Fridayexclude_black_fridayboolean

True if the Black Friday / Cyber Monday period was excluded from the model's training.

Possible values: true, false

Is Deletedis_deletedboolean

True if the model has been deleted. Deleted models are retained (soft delete) rather than removed.

Possible values: true, false

Is Experimentalis_expboolean

True if the model run is experimental rather than a standard production run.

Possible values: true, false

KPIkpistring

The business outcome the model is trained to explain and predict, including the customer population (total or new customer).

Possible values: NC Revenue, Revenue, NC Profit, Profit, NC Orders, Orders, NC Subscriptions, Subscriptions

Efficiency Ratio Typeefficiency_ratio_typestring

The name of the marketing efficiency ratio paired with the model's KPI, used to express return on ad spend. This is a label such as ROAS, not a numeric value, and is derived from kpi.

Possible values: ROAS, NC ROAS, POAS, NC POAS, CAC, NC CAC, SCAC, NC SCAC

Model IDmodel_idstring

The unique identifier of the model run. Each scheduled retrain produces a new model_id.

Example value: 9f2c1a7e-3b44-4c9a-8e21-7d5f0b2a1c33

Settings IDsettings_idstring

The unique identifier of the model configuration. All runs of the same model share one settings_id; this is the key that ties a model's runs together across the MMM tables.

Example value: 3a7b2c9d-1e44-4f8a-9c12-6b0d8e2f4a51

Settings Namesettings_namestring

The human-readable name of the model configuration.

Example value: revenue_weekly_a3b2

Training Start Datestart_training_datestring

The first date of historical data used to train the model.

Example value: 2023-01-01

Time Unittime_unitstring

The granularity at which the model is trained and reports results.

Possible values: daily, weekly, monthly

Use Clicksuse_clicksboolean

True if ad clicks were included as a signal in the model.

Possible values: true, false

Use Discountuse_discountboolean

True if discount activity was included as a signal in the model.

Possible values: true, false

Use Email/SMSuse_email_smsboolean

True if email and SMS activity was included as a signal in the model.

Possible values: true, false

Use Impressionsuse_impressionsboolean

True if ad impressions were included as a signal in the model.

Possible values: true, false

Window End Datewindow_end_datestring

The end date of the model run's evaluation window. The most recent model run for a configuration has the latest window_end_date.

Example value: 2024-01-22

Window Start Datewindow_start_datestring

The start date of the model run's evaluation window.

Example value: 2024-01-15

Measures

Measures are numeric fields that can be aggregated and/or combined to calculate new metrics.

TitleIDTypeDescription
Test CRPStest_crpsnumericContinuous Ranked Probability Score on the held-out test period, evaluating the full predicted distribution against actuals. Lower is better.
Test CRPS Percentagetest_crps_percentagenumericTest-period CRPS expressed as a percentage of the actual KPI. Lower is better.
Test MAPEtest_mapenumericMean Absolute Percentage Error on the held-out test period. Lower is better.
Test Mean Errortest_mean_errornumericAverage signed error between predicted and actual KPI on the test period, indicating directional bias.
Test Pearson Correlationtest_pearsonnumericPearson correlation between predicted and actual KPI on the test period. Closer to 1 is better.
Test R-Squaredtest_r_squarednumericR-squared (coefficient of determination) on the test period. Closer to 1 means more variance explained.
Test RMSEtest_rmsenumericRoot Mean Squared Error on the test period, in KPI units. Lower is better.
Test SMAPEtest_smapenumericSymmetric Mean Absolute Percentage Error on the test period. Lower is better.
Test SMAPE CI Lowertest_smape_ci_lowernumericLower bound of the confidence interval for the test-period SMAPE.
Test SMAPE CI Uppertest_smape_ci_uppernumericUpper bound of the confidence interval for the test-period SMAPE.
Test WMAPEtest_wmapenumericWeighted Mean Absolute Percentage Error on the test period. Lower is better.
Train CRPStrain_crpsnumericContinuous Ranked Probability Score on the training (in-sample) data. Lower is better.
Train CRPS Percentagetrain_crps_percentagenumericTraining-data CRPS expressed as a percentage of the actual KPI. Lower is better.
Train MAPEtrain_mapenumericMean Absolute Percentage Error on the training (in-sample) data. Lower is better.
Train Mean Errortrain_mean_errornumericAverage signed error between predicted and actual KPI on the training data, indicating directional bias.
Train Pearson Correlationtrain_pearsonnumericPearson correlation between predicted and actual KPI on the training data. Closer to 1 is better.
Train R-Squaredtrain_r_squarednumericR-squared (coefficient of determination) on the training data. Closer to 1 means more variance explained.
Train RMSEtrain_rmsenumericRoot Mean Squared Error on the training data, in KPI units. Lower is better.
Train SMAPEtrain_smapenumericSymmetric Mean Absolute Percentage Error on the training data. Lower is better.
Train SMAPE CI Lowertrain_smape_ci_lowernumericLower bound of the confidence interval for the training-data SMAPE.
Train SMAPE CI Uppertrain_smape_ci_uppernumericUpper bound of the confidence interval for the training-data SMAPE.
Train WMAPEtrain_wmapenumericWeighted Mean Absolute Percentage Error on the training data. Lower is better.