[Ready For Review][AQUA][Multi-Model] Enhance AQUA CLI to Accept Fine-Tuned Weights Under Base Model in Multi-Model Deployment

[mrDzurb]

Description

Currently, the CLI and UI handler for multi-model deployment accept a flat list of models, where model_id can refer to either a base model or a fine-tuned weight. Under the hood, the handler detects fine-tuned models and transforms the input into a nested structure grouping fine-tuned weights under their respective base models. This logic should be improved by explicitly allowing users to provide a base model and its associated fine-tuned weights directly in the input structure. This enhancement simplifies user intent, reduces ambiguity, and enables direct validation of base-to-weight relationships.

Current CLI command

ads aqua deployment create \
  --container_image_uri "dsmc://odsc-vllm-serving:0.8.5.post1.6" \
  --models '[
    {
      "model_id": "ocid1.log.oc1.iad.<ocid>",
      "gpu_count": 1,
      "model_name": "meta-llama/Meta-Llama-3.1-8B",
      "model_task": "text_generation",
    },
    {
      "model_task": "text_generation",
      "model_id": "ocid1.log.oc1.iad.<ocid>",
      "gpu_count": 1
    }
  ]' \
  --instance_shape "VM.GPU.A10.2" \
  --display_name "modelDeployment_multimodel"

New CLI command

ads aqua deployment create \
  --container_image_uri "dsmc://odsc-vllm-serving:0.8.5.post1.6" \
  --models '[
    {
      "model_id": "ocid1.log.oc1.iad.<ocid>",
      "gpu_count": 1,
      "model_name": "meta-llama/Meta-Llama-3.1-8B",
      "model_task": "text_generation",
      "fine_tune_weights": [
        {
          "model_id": "ocid1.datasciencemodel.oc1.iad.<>",
          "model_name": "meta-llama/Meta-Llama-3.1-8B-FT1"
        },
        {
          "model_id": "ocid1.datasciencemodel.oc1.iad.<>",
          "model_name": "meta-llama/Meta-Llama-3.1-8B-FT2"
        }
      ]
    },
    {
      "model_task": "text_generation",
      "model_id": "ocid1.log.oc1.iad.<ocid>",
      "gpu_count": 1
    }
  ]' \
  --instance_shape "VM.GPU.A10.2" \
  --display_name "modelDeployment_multimodel"

[github-actions]

📌 Cov diff with main:

📌 Overall coverage:

[github-actions]

📌 Cov diff with main:

📌 Overall coverage:

[elizjo]

Check if self.model_id exists before inserting/ creating set?

[elizjo]

are we allowing users to name their own FT modules?

[VipulMascarenhas]

changes lgtm 👍

[elizjo]

LGTM

[github-actions]

📌 Cov diff with main:

📌 Overall coverage:

[github-actions]

📌 Cov diff with main:

📌 Overall coverage:

[github-actions]

📌 Cov diff with main:

📌 Overall coverage: