About resize requests in a MIG (original) (raw)

This document gives an overview of resize requests in a managed instance group (MIG). To learn more about other ways to add virtual machine (VM) instances to a MIG, seeAdd instances to a MIG.

Use MIG resize requests for the following benefits:

• Create VMs in the MIG all at once. When resources are available, the MIG creates VMs all at once. This approach helps you avoid charges for partial capacity until all resources become available.
• Obtain high-demand resources. You can use MIG resize requests with the flex-start or reservation-bound provisioning models. These provisioning models give you the following benefits:
  • You have higher chances of obtaining high-demand resources like GPUs.
  • Based on the machine type that your requested VMs use, you get a discount up to 53% for memory, vCPUs, and any attached GPUs.

Use cases

You can use resize requests in a MIG for the following:

• Create Flex-start VMs. You can request to createFlex-start VMs for obtaining resources as soon as they are available. These VMs are suitable for workloads that need to run for up to seven days, but can start at any time. When you use resize requests to create Flex-start VMs, the following occurs:
  • The MIG schedules Flex-start VM creation as soon as resources are available.
  • After the MIG creates the requested Flex-start VMs, the VMs run until one of the following occurs:
    * Compute Engine deletes the Flex-start VMs at the end of their run duration.
    * You delete the Flex-start VMs.
• Create VMs by consuming a reservation. You can request to createVMs that use the reservation-bound provisioning modelto consume a reservation. When you use resize requests to consume a reservation, the following occurs:
  • The MIG creates VMs at or after the reservation start time.
  • After the MIG creates the requested VMs, the VMs run until one of the following occurs:
    * Compute Engine deletes the reservation at its end time.
    * You stop or delete the VMs.

How resize requests work

The following sections explain how MIG resize requests work.

On creation

To create a MIG resize request, specify the following properties:

• To define the number of VMs to create, use one of the following properties:
  • resizeBy: the number of VMs to create. The MIG automatically generates VM names.
  • instanceNames: a list of VM names. The MIG creates one VM for each name that you specify. This property is inPreview. Use it if your workload requires specific VM names.
• requestedRunDuration: how long the VMs must run for. The run duration must be between 10 minutes and seven days. This property is optional. If you use MIG resize requests to create VMs as soon as resources are available, then this property overrides the run duration that is specified in the MIG's instance template.

After creation

After you create a MIG resize request, the request goes through different states. The following diagram shows these states:

The states shown in the preceding diagram are as follows:

• CREATING: Compute Engine received the resize request, the MIG's target size increases by the number of VMs that are specified in the request, and the MIG creates managed instances that are in a CREATINGstate. These managed instances represent the VMs that the MIG creates when the resize request succeeds.
• ACCEPTED: Compute Engine created and accepted the request. Based on your use case for MIG resize requests, Compute Engine does one of the following:
  • Create Flex-start VMs. On a best-effort basis, theDynamic Workload Schedulerschedules Flex-start VM creation based on availability and the run duration that is specified in the request. If you lackstandard or preemptible allocation quota, or if resources are temporarily unavailable, then the Dynamic Workload Scheduler maintains the request until you have sufficient quota and resources become available.
  • Create VMs by consuming a reservation. If the auto-created reservation that you're targeting for consumption has reached its start time, then the request transitions to SUCCEEDED. Otherwise, the request persists until the reservation reaches its start time.
• SUCCEEDED: the MIG created the requested number of VMs all at once. The VMs are allocated as close to each other as possible, based on availability. Based on your use case for MIG resize requests, the following occurs:
  • When the MIG creates Flex-start VMs, the VMs run until the MIG deletes them at the end of their run duration, or until you delete the VMs. You can't recreate, stop, or suspend the VMs.
  • When the MIG creates VMs by consuming an auto-created reservation, the VMs run until the reservation period ends, or until you stop, suspend, or delete the VMs.
• FAILED: the resize request failed due to a technical error. As a result, Compute Engine decreases the target size of the MIG by the number of requested VMs.
• CANCELLED: a usercanceled the resize request. When you cancel a resize request, Compute Engine stops the MIG from creating the requested resources. After you cancel a resize request, Compute Engine decreases the MIG's target size by the number of requested VMs and deletes the request after 14 days. Optionally, you candelete the resize requestbefore Compute Engine deletes it.

If you delete a MIG that contains resize requests, then this deletion also removes any resize requests and VMs in the MIG. However, if you delete a MIG when the MIG creates VMs to fulfill a resize request, Compute Engine waits until the MIG has finished creating the requested number of VMs and the state of the resize request transitions to SUCCEEDED before deleting the MIG.

Quota

Based on your use case for MIG resize requests, you need quota as follows:

• Create Flex-start VMs. Quota requirements vary based on the machine type that your requested number of Flex-start VMs use. If you lack quota for your requested resources, then a resize request remains pending until you have sufficient quota. For more information about quotas that apply to Compute Engine resources, seeAllocation quotas.
• Create VMs by consuming a reservation. You don't need quota in this use case. This requirement is because you use thereservation-bound provisioning modelto consume an auto-created reservation for a future reservation in calendar mode.

Pricing

You don't incur charges when you create, cancel, or delete resize requests in a MIG. Instead, based on your use case for MIG resize requests, you incur charges as follows:

• If you use MIG resize Flex-start VMs, then you incur charges as follows:
  • Charges begin when the MIG creates the Flex-start VMs. Google Cloud charges you for the Flex-start VMs based onDynamic Workload Scheduler pricing.
  • Charges end when the MIG deletes the Flex-start VMs at the end of their run duration, or when you delete the Flex-start VMs.
• If you use MIG resize requests to create VMs by consuming a reservation, then you incur charges as follows:
  • When the MIG creates the VMs, you don't incur charges again for the consumed reservation resources. You only incur charges for resources that the VMs use and that aren't part of the reservation, such as disks or IP addresses.
  • Charges end at the reservation end time. At this time, Compute Engine deletes the reservation and any VMs that consume it. For more information, see thebilling for reservations.

Limitations

The following sections explain the limitations for MIG resize requests.

Limitations for resize requests

MIG resize requests have the following limitations:

• You can use MIG resize requests to obtain different machine types depending on the provisioning model that you use:
  • Flex-start: you can obtain any GPU machine type (except A4X Max and A4X), and H4D machine types. Use this model to create Flex-start VMs as soon as resources are available.
  • Reservation-bound: you can only obtain A4X Max, A4X, A4, A3 Ultra, or H4D machine types. Use this model to create VMs by consuming a reservation.
• You can only cancel resize requests that are in the ACCEPTED state.
• You can only delete a resize request after it succeeds (SUCCEEDED), fails (FAILED), or is canceled (CANCELLED).

Limitations for the instance template

For the MIG's instance template, the following limitations apply:

• You must specify to stop VMs duringhost maintenance events.
• You can't specifyplacement policies.
• Based on your use case for MIG resize requests, you must specify the following configurations when you create the instance template:
  • To create Flex-start VMs, you must specify the following:
    * To delete VMs at the end of their run duration by using themaxRunDuration and instanceTerminationAction fields.
    * Toprevent reservations consumption.
    * To use theflex-start provisioning model.
  • To create VMs by consuming an auto-created reservation for a future reservation in calendar mode, you must specify the following:
    * To delete VMs at the end of the reservation period by using theinstanceTerminationAction field.
    * Totarget the reservation for consumption.
    * To use thereservation-bound provisioning model.

Limitations for the MIG

For the MIG, the following limitations apply:

• In a regional MIG, you can only use theANY_SINGLE_ZONE target distribution shape.
• You mustturn off repairsin the MIG.
• You mustdelete the autoscaling configuration.
• You can't apply VM configuration updates to the VMs created through resize requests. To prevent automatic updates,set the MIG's update type to opportunistic.
• You can't apply theall-instances configuration to VMs created through resize requests.
• You can't defineper-instance configurationsin VMs created through resize requests.
• You can only set thestandby pool modeof the MIG to manual (default).
• If a MIG contains accepted resize requests, then you can't do the following:
  • You can't add a second instance template to initiate acanary update in the MIG.
  • You can't change thetarget size of the MIG.
• You can't delete or abandon the managed instances in a CREATING status that the MIG creates for a resize request. To delete those managed instances, you mustcancel the resize request.
• If you use MIG resize requests to create Flex-start VMs, then you can'tstop orrecreate VMs.

What's next

• Learn how tocreate resize requests in a MIG.
• Learn how toview, cancel, or delete resize requests in a MIG.