Armory Docs – Spinnaker Plugins

Plugins: Install the AWS Event Cache Plugin in Armory Continuous Deployment

Mon, 01 Jan 0001 00:00:00 +0000

Installation overview

Enabling the AWS Event Cache plugin consists of the following steps:

Configure the plugin
Install the plugin
Create an AWS SNS topic and subscription

Before you begin

You have read the AWS Event Cache overview.
You are running Armory Continuous Deployment.
You manage your instance using the Armory Operator and the spinnaker-kustomize-patches repo.

Compatibility

Armory CD Version	Spinnaker Version	AWS Event Cache Plugin Version
2.31.x	1.31.x	0.2.1
2.30.x	1.29.x, 1.30.x	0.2.1
2.28.x	1.28.x	0.2.1

Configure the plugin

Create an aws-event-cache-plugin.yml file with the following contents:

apiVersion: spinnaker.armory.io/v1alpha2
kind: SpinnakerService
metadata:
 name: spinnaker
spec:
 spinnakerConfig:
 profiles:
 spinnaker:
 spinnaker:
 extensibility:
 repositories:
 awscatsOnEvent:
 version: <version>
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 clouddriver: &clouddriver-cats
 spinnaker:
 extensibility:
 plugins:
 Armory.AWSCATsOnEvent:
 enabled: true
 clouddriver-ro:
 *clouddriver-cats
 clouddriver-rw:
 *clouddriver-cats
 clouddriver-caching:
 *clouddriver-cats
 gate:
 spinnaker:
 extensibility:
 plugins:
 Armory.AWSCATsOnEvent:
 enabled: true

Replace <version> with the plugin version compatible with your Armory CD version.

Save the file to your spinnaker-kustomize-patches/plugins directory.

Install the plugin

Add the plugin patch to your Kustomize recipe’s patchesStrategicMerge section. For example:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18


apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

namespace: spinnaker

components:
 - core/base
 - core/persistence/in-cluster
 - targets/kubernetes/default

patchesStrategicMerge:
 - core/patches/oss-version.yml
 - plugins/aws-event-cache-plugin.yml

patches:
 - target:
 kind: SpinnakerService
 path: utilities/switch-to-oss.yml

Apply the updates to your Kustomization recipe.

kubectl apply -k <kustomization-directory-path>

After plugin installation finishes, you need to create an AWS Simple Notification Service Standard topic for your Spinnaker or Armory CD instance. See the AWS SNS Creating an Amazon SNS topic for instructions.

In the Details section:

Type: Select Standard
Name: Create a meaningful name, such as AWS Event Cache Plugin

In the Access policy section:

Select Advanced and add the following policy:

 {
 "Version": "2008-10-17",
 "Statement": [
 {
 "Sid": "AWSConfigSNSPolicy",
 "Effect": "Allow",
 "Principal": {
 "Service": "config.amazonaws.com"
 },
 "Action": "sns:Publish",
 "Resource": "arn:aws:sns:us-west-2:568975057762:config-topic-568975057762"
 }
 ]
 }

Your Spinnaker or Armory CD instance needs to subscribe to the topic you created. See Subscribing to an Amazon SNS topic for how to create your subscription. You need your Gate endpoint when you create the subscription.

Protocol: Select either HTTP or HTTPS depending on your Gate endpoint.
Endpoint: This is your Gate endpoint.

After you create your subscription, you should see it in your AWS SNS Subscriptions list. The status should be Confirmed. If you don’t see the Confirmed after 1 or 2 minutes, ensure your Spinnaker or Armory CD service is running. Verify your Gate endpoint and make sure the plugin installation succeeded.

Plugins: Install the GitHub Integration Plugin in Armory Continuous Deployment

Mon, 01 Jan 0001 00:00:00 +0000

Installation overview

Enabling the GitHub Integration plugin consists of the following steps:

Meet the prerequisites
Create and install a GitHub App
Configure the plugin
Install the plugin

Before you begin

You have read the GitHub Integration Plugin overview.
You are familiar with GitHub Apps.

You are running Armory Continuous Deployment.
You manage your instance using the Armory Operator and the spinnaker-kustomize-patches repo.

Compatibility

Armory CD Version	Spinnaker Version	GitHub Integration Plugin Version
2.30.x	1.30.x	0.1.2

Create and install a GitHub App

You need to create and install a GitHub App that interacts with the GitHub Integration plugin.

Create a GitHub App. Follow the instructions in GitHub’s Registering a GitHub App guide.
- Provide values for GitHub App name. Homepage URL, and Repository permissions. You do not need to fill out the Identifying and authorizing users, Post installation, or Webhook sections.
- Your GitHub App should have the following Repository permissions:
  - Actions: Read and write
  - Contents: Read and write
  - Deployments: Read and write
  - Environments: Read and write
  - Metadata: Read-only
- You do need to generate a private key (Private keys section).
- Be sure to note the GitHub App’s App ID and Private key. You need these to configure the GitHub Integration plugin.
Install the GitHub App you created either in a specific repo or organization-wide. Follow the instructions in GitHub’s Installing your own GitHub App guide.

Configure the plugin

Create a github-integration-plugin.yml file with the following contents:

apiVersion: spinnaker.armory.io/v1alpha2
kind: SpinnakerService
metadata:
 name: spinnaker
spec:
 spinnakerConfig:
 profiles:
 spinnaker:
 github:
 plugin:
 accounts: []
 spinnaker:
 extensibility:
 repositories:
 repository:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 deck:
 settings-local.js:
 gate:
 spinnaker:
 extensibility:
 plugins:
 Armory.GitHubIntegration:
 enabled: true
 version: <version>
 deck-proxy:
 enabled: true
 plugins:
 Armory.GitHubIntegration:
 enabled: true
 version: <version>
 orca:
 spinnaker:
 extensibility:
 plugins:
 Armory.GitHubIntegration:
 enabled: true
 version: <version>
 igor:
 spinnaker:
 extensibility:
 plugins:
 Armory.GitHubIntegration:
 enabled: true
 version: <version>
 echo:
 spinnaker:
 extensibility:
 plugins:
 Armory.GitHubIntegration:
 enabled: true
 version: <version>

deck.settings-local.js: Copy the contents of your existing setting-local.js to this section. Add githubWorkflow to the triggerTypes array to enable the GitHub Workflow trigger option. Add githubEvent to the triggerTypes array to enable the GitHub event trigger option for GitHub Deployment events.

For example:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37


spec:
 spinnakerConfig:
 profiles:
 spinnaker:
 github:
 plugin:
 accounts: []
 spinnaker:
 extensibility:
 repositories:
 repository:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 deck:
 settings-local.js: |
 window.spinnakerSettings = {
 ... (content omitted for brevity)
 triggerTypes: [
 'artifactory',
 'concourse',
 'cron',
 'docker',
 'git',
 'githubWorkflow',
 'githubEvent',
 'helm',
 'jenkins',
 'nexus',
 'pipeline',
 'plugin',
 'pubsub',
 'travis',
 'webhook',
 'wercker',
 ]
 ... (content omitted for brevity)
 }

version: Replace <version> with the plugin version compatible with your Spinnaker version.
accounts: Configure the GitHub location(s) where you installed the GitHub App you created. The configuration differs depending on whether you installed the GitHub App organization-wide or with access to individual repositories.

- name: <name>
 organization: <github-organization>
 repository: <github-repository>
 defaultBranch: <default-github-branch>
 githubAppId: <github-app-id>
 githubAppPrivateKey: <github-app-private-key>
 permissions: []

All fields are required.

name: Unique name; this name appears in the GitHub Integration stages’ GitHub Account select list.
organization: GitHub organization that you installed the GitHub App in
repository: The GitHub repository to access
defaultBranch: Default repository branch; for example, main or master
githubAppId: The GitHub App’s App ID
githubAppPrivateKey: The GitHub App’s private key; this field supports encrypted field references; see Work with Secrets in Spinnaker for details.

- name: <name>
 organization: <github-organization>
 orgWideInstallation: true
 includePublicRepositories: false
 defaultBranch: <default-github-branch>
 githubAppId: <github-app-id>
 githubAppPrivateKey: <github-app-private-key>
 permissions: []

All fields are required.

name: Unique name; this name appears in the GitHub Integration stages’ GitHub Account select list.
organization: GitHub organization that you installed the GitHub App in
orgWideInstallation: true
includePublicRepositories: true/false (Optional) Defaults to false. Flag to limit the Spinnaker triggers to only PRIVATE/INTERNAL repositories that the Github App installation has access to.
defaultBranch: Default repository branch; for example, main or master
githubAppId: The GitHub App’s App ID
githubAppPrivateKey: The GitHub App’s private key; this field supports encrypted field references; see Work with Secrets in Spinnaker for details.

Conflict with Armory CDSH v2.30.x

Known issue: The GitHub Integration plugin conflicts with the Armory.Header plugin version included in Armory CD v2.30.x. You must install version 0.2.0 of the Armory.Header plugin.

Show me how

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22


profiles:
 gate:
 spinnaker:
 extensibility:
 repositories:
 pluginRepository:
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 plugins:
 Armory.GitHubIntegration:
 enabled: true
 version: <version>
 Armory.ArmoryHeader:
 enabled: true
 version: 0.2.0
 deck-proxy:
 enabled: true
 plugins:
 Armory.GitHubIntegration:
 enabled: true
 version: <version>
 Armory.ArmoryHeader:
 enabled: true

Accounts config example

In this example, you have company-public and company-private GitHub organizations, so you created two GitHub Apps, one for each org.

You installed the GitHub App for the company-private org with access to all repos in the org.
You installed the GitHub App for the company-public org with access to two specific repos in the org.

Your accounts config looks like this:

github:
 plugin:
 accounts:
 - name: FirstAppRepo
 organization: company-public
 repository: first-app-repo
 defaultBranch: master
 githubAppId: 9753
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-9753-privatekey
 permissions: []
 - name: SecondAppRepo
 organization: company-public
 repository: second-app-repo
 defaultBranch: main
 githubAppId: 9753
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-9753-privatekey
 permissions: []
 - name: CompanyPrivateOrgAllRepos
 organization: company-private
 orgWideInstallation: true
 includePublicRepositories: false
 defaultBranch: main
 githubAppId: 1357
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-1357-privatekey
 permissions: []

Install the plugin

Add the plugin patch to your Kustomize recipe’s patchesStrategicMerge section. For example:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18


apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

namespace: spinnaker

components:
 - core/base
 - core/persistence/in-cluster
 - targets/kubernetes/default

patchesStrategicMerge:
 - core/patches/oss-version.yml
 - plugins/patch-github-integration-plugin.yml

patches:
 - target:
 kind: SpinnakerService
 path: utilities/switch-to-oss.yml

Apply the updates to your Kustomization recipe.

kubectl apply -k <kustomization-directory-path>

What’s next

Learn how to use the GitHub Integration plugin.

Plugins: Enable Pipelines-as-Code in Armory Continuous Deployment

Mon, 01 Jan 0001 00:00:00 +0000

Before you begin

You are running Armory Continuous Deployment.
You manage your instance using the Armory Operator.

Pipelines-as-Code is a built-in feature of Armory CD. You only need to configure your repo, enable the Dinghy service, and apply your changes to use Pipelines-as-Code.

If you are running open source Spinnaker, see the Pipelines-as-Code landing page for installation paths based on whether you are using Halyard or the Spinnaker Operator.

Where to configure the service

If you are using the spinnaker-kustomize-patches repo, put your config in the armory/features/pipelines-as-code/features.yml file.

If you are using a single spinnakerservice.yml manifest, put your config in the spec.spinnakerConfig.config.armory.dinghy section.

apiVersion: spinnaker.armory.io/v1alpha2
kind: SpinnakerService
metadata:
 name: spinnaker
spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:

Enable Pipelines-as-Code

The Dinghy service is already enabled in the armory/features/pipelines-as-code/features.yml file, so you only need to modify your Kustomization recipe. Add an entry for Pipelines-as-Code in the components section of your kustomization.yml file:

components:
 - core/base
 - core/persistence/in-cluster
 - targets/kubernetes/default
 - armory/features/pipelines-as-code/

Add enabled: true to your dinghy section.

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 enabled: true

Configure your repo

Before configuring your repos, ensure you have the following:

A personal access token that has read access to the repo where you store your dinghyfile and the repo where you store module files. You should create a Kubernetes Secret for your personal access token so you don’t store the token in plain text in your config file.
The organization where the app repos and templates reside; for example, if your repo is armory-io/dinghy-templates, your template-org is armory-io.
The name of the repo containing your modules; for example, if your repo is armory-io/dinghy-templates, your template-repo is dinghy-templates.

Add the following to your config file:

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 enabled: true
 templateOrg: <repo-org>
 templateRepo: <dinghy-templates-repo>
 githubToken: <abc>
 githubEndpoint: <https://api.github.com>

All fields are required.

templateOrg: VCS organization or namespace where application and template repositories are located
templateRepo: VCS repository where module templates are located
githubToken: GitHub token; This field supports “encrypted” field references; see Secrets for details.
githubEndpoint: (Default: https://api.github.com) GitHub API endpoint. Useful if you’re using GitHub Enterprise.

GitHub webhooks

Set up webhooks at the organization level for push events. You can do this by going to https://github.com/organizations/<your_org_here>/settings/hooks.

Set content-type to application/json.
Set the Payload URL to your Gate URL. Depending on whether you configured Gate to use its own DNS name or a path on the same DNS name as Deck, the URL follows one of the following formats:
- https://<your-gate-url>/webhooks/git/github if you have a separate DNS name or port for Gate
- https://<your-spinnaker-url>/api/v1/webhooks/git/github if you’re using a different path for Gate

If your Gate endpoint is protected by a firewall, you need to configure your firewall to allow inbound webhooks from GitHub’s IP addresses. You can find the IPs in this API response. Read more about GitHub’s IP addresses.

You can configure webhooks on multiple GitHub organizations or repositories to send events to Dinghy. Only a single repository from one organization can be the shared template repository in Dinghy. However, Dinghy can process pipelines from multiple GitHub organizations. You want to ensure the GitHub token configured for Dinghy has permission for all the organizations involved.

Pull request validations

When you make a GitHub pull request (PR) and there is a change in a dinghyfile, Pipelines-as-Code automatically performs a validation for that dinghyfile. It also updates the GitHub status accordingly. If the validation fails, you see an unsuccessful dinghy check.

Make PR validations mandatory to ensure users only merge working dinghyfiles.

Perform the following steps to configure mandatory PR validation:

Go to your GitHub repository.
Click on Settings > Branches.
In Branch protection rules, select Add rule.
Add master in Branch name pattern so that the rule gets enforced on the master branch. Note that if this is a new repository with no commits, the “dinghy” option does not appear. You must first create a dinghyfile in any branch.
Select Require status checks to pass before merging and make dinghy required. Select Include administrators as well so that all PRs get validated, regardless of user.

The following screenshot shows what your GitHub settings should resemble:

Bitbucket has both cloud and server offerings. See the Atlassian docs for more on the name change from Stash to Bitbucket Server. Consult your company’s Bitbucket support desk if you need help determining what flavor and version of Bitbucket you are using.

Add the following to your config file:

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 enabled: true
 templateOrg: <repo-org>
 templateRepo: <dinghy-templates-repo>
 stashUsername: <stash_user>
 stashToken: <abc>
 stashEndpoint: <https://my-endpoint>

All fields are required.

templateRepo: VCS repository where module templates are located
stashUsername: Stash username
stashToken: Stash token. This field supports “encrypted” field references; see Secrets for details.
stashEndpoint: Stash API endpoint. If you’re using Bitbucket Server, update the endpoint to include the api e.g. https://your-endpoint-here.com/rest/api/1.0

If you’re using Bitbucket Server, update the endpoint to include the api, e.g. --stash-endpoint https://your-endpoint-here.com/rest/api/1.0

You need to set up webhooks for each project that has the dinghyfile or module separately. Make the webhook POST to: https://spinnaker.your-company.com:8084/webhooks/git/bitbucket. If you’re using Stash <v3.11.6, you need to install the webhook plugin to be able to set up webhooks.

Add the following to your config file:

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 enabled: true
 templateOrg: <repo-org>
 templateRepo: <dinghy-templates-repo>
 gitlabToken: <abc>
 gitlabEndpoint: <https://my-endpoint>

All fields are required.

templateOrg: VCS organization or namespace where application and template repositories are located
templateRepo: VCS repository where module templates are located
gitlabToken: GitLab token. This field supports “encrypted” field references; see Secrets for details.
gitlabEndpoint: GitLab endpoint

Under Settings -> Integrations on your project page, point your webhooks to https://<your-gate-url>/webhooks/git/gitlab. Make sure the server your GitLab install is running on can connect to your Gate URL. Armory also needs to communicate with your GitLab installation. Ensure that connectivity works as well.

Deploy

Apply your updates.

kubectl apply -k <kustomization-directory-path>

kubectl -n spinnaker apply -f spinnakerservice.yml

What’s next

Configure Pipelines-as-Code Optional Features

Plugins: Enable the Terraform Integration Stage in Armory Continuous Deployment

Mon, 01 Jan 0001 00:00:00 +0000

Overview of enabling Terraform Integration

Enabling the Terraform Integration stage consists of these steps:

Configure Armory CD
Enable Terraform Integration
Apply the update

Compatibility

Spinnaker Version	Terraform Integration Service Version	Terraform Integration Plugin Version
1.30.x	2.30	0.0.2
1.29.x	2.28	0.0.1
1.28.x	2.28	0.0.1

Before you begin

You have read the Terraform Integration Overview.
You are running Armory Continuous Deployment.
You manage your instance using the Armory Operator.

Terraform Integration is a built-in feature of Armory CD.

If you are running open source Spinnaker, see the Terraform Integration Overview for installation paths based on whether you are using Halyard or the Spinnaker Operator.

Terraform Integration requirements

Basic auth credentials for the Git repository where your store your Terraform scripts. The Terraform Integration plugin needs access to credentials to download directories that house your Terraform templates.
- You can configure your Git repo with any of the following:
  - A Personal Access Token (potentially associated with a service account).
  - SSH protocol in the form of an SSH key or an SSH key file
  - Basic auth in the form of a user and password, or a user-password file
A source for Terraform Input Variable files (tfvar) or a backend config. You must have a separate artifact provider that can pull your tfvar file(s). The Terraform Integration plugin supports the following artifact providers for tfvar files and backend configs:
- GitHub
- BitBucket
- HTTP artifact
A dedicated external Redis instance
- Armory requires configuring a dedicated external Redis instance for production usage of the Terraform Integration plugin. This is to ensure that you do not encounter scaling or stability issues in production.

Configure Armory CD

Configure Redis

Terraform Integration uses Redis to store Terraform logs and plans.

You can only configure the Terraform Integration feature to use a password with the default Redis user.

Configure Redis settings in your Armory CD configuration and then apply your changes.

You need to modify spinnaker-kustomize-patches/armory/features/patch-terraformer.yml. Add Redis configuration in the profiles section.

profiles:
 redis:
 baseUrl: "<your-redis-url>"
 password: "<your-redis-password>"

spec:
 spinnakerConfig:
 profiles:
 terraformer:
 redis:
 baseUrl: "<your-redis-url>"
 password: "<your-redis-password>"

Configure your artifact account

The Terraform Integration uses the following artifact accounts:

Git Repo - To fetch the repo housing your main Terraform files.
GitHub, BitBucket or HTTP - Optional. To fetch single files such as var-files or backend config files.

Spinnaker uses the Git Repo Artifact Provider to download the repo containing your main Terraform templates. For more configuration options, see Configure a Git Repo Artifact Account.

You need to modify spinnaker-kustomize-patches/armory/features/patch-terraformer.yml. Configure artifacts in the spec.spinnakerConfig.config.artifacts section.

spec:
 spinnakerConfig:
 config:
 armory:
 terraform:
 enabled: true
 artifacts:
 gitrepo:
 enabled: true
 accounts:
 - name: gitrepo
 username: <username>
 token: <git-token>
 # password:
 # tokenFile: 
 # usernamePasswordFile: 
 # sshPrivateKeyFilePath:
 # sshPrivateKeyPassphrase:
 # sshKnownHostsFilePath: 
 # sshTrustUnknownHosts:

spec:
 spinnakerConfig:
 profiles:
 clouddriver:
 artifacts:
 gitRepo:
 enabled: true
 accounts:
 - name: gitrepo
 token: <your-personal-access-token>

Configure additional repos

You need to modify spinnaker-kustomize-patches/armory/features/patch-terraformer.yml. Configure additional artifacts in the spec.spinnakerConfig.config.artifacts section.

This step is optional.

These optional steps describe how to configure GitHub as an artifact provider for the Terraform Integration.

Spinnaker uses the Github Artifact Provider to download any referenced tfvar files.

Configure your GitHub artifact:

spec:
 spinnakerConfig:
 config:
 artifacts:
 github:
 accounts:
 - name: <github-for-terraform>
 token: <your-github-personal-access-token>
 enabled: true

name: the name for this account; replace github-for-terraform with a unique identifier for the artifact account.
token: GitHub personal access token; this field supports “encrypted” field references.

Spinnaker uses the BitBucket Artifact Provider to download any referenced tfvar files, so it must be configured with the BitBucket token to pull these files.

spec:
 spinnakerConfig:
 config:
 artifacts:
 bitbucket:
 enabled: true
 accounts:
 - name: <bitbucket-for-terraform>
 username: <your-bitbucket-username>
 password: <your-bitbucket-password>

name: the name for this account; replace <bitbucket-for-terraform> with a unique identifier for the artifact account.
username: Your Bitbucket username.
password: Your Bitbucket password; this field supports “encrypted” field references.

Enable Terraform Integration

You need to modify your Kustomization recipe to include patch-terraformer.yml.

patchesStrategicMerge:
 - armory/features/patch-terraformer.yml

Add enabled: true to your terraform section.

spec:
 spinnakerConfig:
 config:
 armory:
 terraform:
 enabled: true

Apply the update

After you finish your Terraform Integration configuration, apply your changes. Confirm that the Terraform Integration service (Terraformer) is deployed with your Armory CD deployment:

kubectl get pods -n <your-spinnaker-namespace>

In the command output, look for a line similar to the following:

spin-terraformer-d4334g795-sv4vz 2/2 Running 0 0d

What’s next

Plugins: AWS CloudWatch Integration Plugin Overview

Mon, 01 Jan 0001 00:00:00 +0000

What the AWS CloudWatch Integration plugin does

The AWS CloudWatch Integration Plugin for Spinnaker enables using AWS CloudWatch as a metrics provider for your canary deployments. For example, you can have an analysis stage that compares CPU utilization across two versions of a service using AWS CloudWatch metrics and then a judgment that determines if the deployment proceeds or rolls back based on the metrics.

See Canary Overview for more information on using canary analysis with Spinnaker.

Installation paths

Spinnaker

Make sure you have enabled canary deployments (the Kayenta service) in your Spinnaker instance.
Enable AWS CloudWatch as a metrics provider.
Install the plugin in Spinnaker using the Spinnaker Operator or Halyard.
Use AWS CloudWatch in your pipeline.

Instructions

Armory CD

Armory CD includes the AWS Cloudwatch Integration Plugin. You do not have to install it.

Make sure you have enabled canary deployments (the Kayenta service) in your Armory CD instance.
Enable AWS CloudWatch as a metrics provider.
Use AWS CloudWatch in your pipeline.

Instructions

Spinnaker compatibility matrix

Spinnaker Version	AWS CloudWatch Integration Plugin Version
1.33.x	0.1.0

Release notes

0.1.0: Initial release

Plugins: Overview

Mon, 01 Jan 0001 00:00:00 +0000

AWS Event Cache features

The AWS Event Cache Plugin provides the following features:

Manual cache refresh within Spinnaker
- Enables fetching the latest data from AWS providers
- Useful in scenarios where you’ve reached rate limits and need real-time data
Dynamic polling interval adjustment for data retrieval from AWS providers
- Provides flexibility in managing the frequency of API calls, helping to mitigate rate limit issues
Seamless integration with AWS SNS for event-driven communication
- The plugin receives notifications from SNS whenever a change is made, ensuring timely responses to rate limit issues.
An event scheduler
- Coordinates with the notification handling service
- Designed to be invoked by AWS SNS, ensuring efficient processing of events related to rate limit changes
Different configurations for non-production environments
- You can set a longer polling interval in non-production environments to reduce the frequency of API calls without compromising overall functionality.

The plugin uses AWS Config to send events to Spinnaker through a new endpoint in the Gate service.

How the plugin works

AWS SNS Integration

The plugin seamlessly integrates with AWS SNS to establish a reliable communication channel. AWS SNS is configured to send notifications whenever a change is detected in the AWS environment, such as rate limit adjustments or IAM role modifications.

Event Scheduler Initialization

Upon receiving a notification from AWS SNS, the plugin’s event scheduler is initialized. This scheduler acts as the orchestrator, coordinating the subsequent actions to manage rate limit issues. Event Handling Workflow:

The Event Scheduler triggers an event handling workflow that consists of the following steps:

Event Validation: The plugin validates the incoming event, ensuring it is legitimate and corresponds to a relevant change in the AWS environment.
Decision Logic: The plugin determines the appropriate action to take based on the type of event, such as rate limit increase or IAM role modification.

Compatibility matrix

Armory CD Version	Spinnaker Version	AWS Event Cache Plugin Version
2.31.x	1.31.x	0.2.1
2.30.x	1.29.x, 1.30.x	0.2.1
2.28.x	1.28.x	0.2.1

Installation paths

Armory CD
Armory Operator

Use a Kustomize patch to install the plugin.

Install the plugin.
Create your AWS Simple Notification Service topic and subscription.

Instructions

Spinnaker
Spinnaker Operator

Use a Kustomize patch to install the plugin.

Install the plugin.
Create your AWS Simple Notification Service topic and subscription.

Instructions

Spinnaker
Halyard

Use Spinnaker local config files to install the plugin.

Install the plugin.
Create your AWS Simple Notification Service topic and subscription.

Instructions

Plugins: GitHub Integration Plugin for Spinnaker Overview

Mon, 01 Jan 0001 00:00:00 +0000

GitHub Integration Plugin features

The GitHub Integration Plugin provides the following GitHub integration features:

Trigger a GitHub Actions workflow from a Spinnaker pipeline using workflow_dispatch or repository_dispatch events.
Trigger a Spinnaker pipeline automatically when a GitHub workflow finishes successfully.
Trigger a Spinnaker pipeline when GitHub creates a new GitHub Deployment.
Monitor a GitHub workflow and finish pipeline execution based on the GitHub workflow result.
Update GitHub deployment status based on Spinnaker pipeline outcome.
View GitHub Action Logs in Spinnaker – there is no need to navigate to GitHub to view the logs.
Validate GitHub access based on configuration assigned to a GitHub App account.
Create GitHub commit statuses using Echo.
Use AuthZ for your GitHub Accounts.

The GitHub Integration plugin uses GitHub Apps to integrate with GitHub. GitHup Apps provide webhooks and narrow, specific permissions. You can install a GitHub App that gives the GitHub Integration plugin access to all the repos in your GitHub organization, or you can install a Github App that gives the GitHub Integration plugin access to specific repos. You can install as many GitHub Apps as your use case requires.

How the plugin works with GitHub

graph TD
Orca -->|Workflow Trigger| Igor
Gate --> |Trigger based on Deployment event|Echo
Igor -->|Trigger/Monitor triggered workflows| GitHub
Echo -->|Pipeline triggers|Orca
Orca -->|Pipeline notifications|Echo
GitHub --> |Deployment event| Gate
Echo --> |Notifications|GitHub

For example, the plugin processes a GitHub Deployment event like this:

sequenceDiagram
participant ghActions as "GitHub Workflow job"
participant gh as "GitHub"
participant gate as "Gate"
participant echo as "Echo"
participant orca as "Orca"
ghActions ->> gh: "Create Deployment"
gh ->> ghActions: "Deployment created"
gh ->> gate: "Deployment Event"
gate ->> echo: "Deployment trigger event"
echo ->> orca: "Trigger pipelines matching the Trigger event"
orca ->> gh: "Deployment status update: in_progress, success, failure, or error"

Compatibility matrix

Armory CD Version	Spinnaker Version	GitHub Integration Plugin Version
2.30.x	1.30.x	0.1.2

Installation paths

Armory CD
Armory Operator

Use a Kustomize patch to install the plugin.

Create a GitHub App and install it in your repo or organization.
Configure the plugin with your GitHub repo(s) and/or organization(s).
Install the plugin using the Armory Operator.

Instructions

Spinnaker
Spinnaker Operator

Use a Kustomize patch to install the plugin.

Create a GitHub App and install it in your repo.
Configure the plugin with your GitHub repo(s) and/or organization(s).
Install the plugin using the Spinnaker Operator.

Instructions

Spinnaker
Halyard

Use Spinnaker local config files to install the plugin.

Create a GitHub App and install it in your repo.
Configure the plugin with your GitHub repo(s) and/or organization(s).
Install the plugin in local config files and apply those changes using Halyard.

Instructions

Plugins: Quick Start: Spinnaker and the Armory Scale Agent

Mon, 01 Jan 0001 00:00:00 +0000

Quick start overview

In this guide, you deploy a basic instance of Spinnaker 1.28+ and the corresponding Scale Agent plugin and service. You can evaluate:

Dynamic accounts for dynamically adding and managing Kubernetes accounts
Automated scanning for newly created accounts in Clouddriver and migrating those accounts to Scale Agent management
Intercepting and processing requests sent to Clouddriver’s <GATE-URL>/credentials endpoint

Objectives

Meet the requirements listed in the Before you begin section.
Learn the options for migrating Clouddriver accounts to the Scale Agent.
Deploy the Spinnaker Operator.
Get the spinnaker-kustomize-patches repo.
Configure Spinnaker.
Deploy Spinnaker and the Scale Agent.

Since this guide is for installing the Armory Scale Agent in a test environment, it does not include mTLS configuration. The Scale Agent service and plugin do not communicate securely.

Before you begin

You are familiar with Kubernetes Operators, which use custom resources to manage applications and their components.
You understand the concept of managing Kubernetes resources using manifests.
You have read how Armory’s operators deploy Spinnaker or Armory CD.
You have a cluster with at least least 4 cores and 16 GB of RAM available.

Options for migrating Kubernetes accounts

In Spinnaker, you can configure Kubernetes accounts in multiple places:

Clouddriver configuration files: clouddriver.yml, clouddriver-local.yml, spinnaker.yml, spinnaker-local.yml
Clouddriver database: clouddriver.accounts table
Spring Cloud Config Server reading accounts from Git, Vault, or another supported backend
Plugins

You have the following options for migrating accounts to the Scale Agent:

You can configure the Scale Agent service to manage specific accounts by adding those accounts to a ConfigMap. This approach means you should remove the accounts from the Clouddriver credential source before you deploy the service.
You can dynamically migrate accounts after the service has been deployed. This requires kubectl access to the cluster so you can port-forward the endpoint to your local machine.

This guide shows you how to statically add an account to the Scale Agent service configuration before deployment.

Deploy the Spinnaker Operator

Decide which Spinnaker Operator release you need based on the Kubernetes version you are using.

Kubernetes Version	Spinnaker Operator Version	Spinnaker Version
1.22+	1.3+	1.27+
1.21	1.2.5	1.27+

Fetch the Spinnaker Operator.

Replace <release-version> with a specific version or use latest to fetch the latest release.

mkdir -p spinnaker-operator && cd spinnaker-operator
bash -c 'curl -L https://github.com/armory/spinnaker-operator/releases/<release-version>/download/manifests.tgz | tar -xz'

From the root of your spinnaker-operator directory, install the Spinnaker Operator CRDs cluster-wide.
```
kubectl apply -f deploy/crds/
```

Install the Spinnaker Operator in namespace spinnaker.

kubectl create ns spinnaker
kubectl -n spinnaker apply -f deploy/operator/cluster

Verify that the Spinnaker Operator is running before you deploy Spinnaker.

kubectl get pods -n spinnaker | grep operator

Output is similar to:

spinnaker-operator-79599cbf55-js5pg 2/2 Running 0 159m

Get the spinnaker-kustomize-patches repo

Armory maintains the spinnakaker-kustomize-patches repo, which contains common configuration options for Armory Continuous Deployment or Spinnaker as well as helper scripts. The patches in this repo give you a reliable starting point when adding and removing features.

Configuration in this repository is meant for Armory Continuous Delivery. To make it compatible with Spinnaker instead, apply the utilities/switch-to-oss.yml patch.

To start, create your own copy of the spinnaker-kustomize-patches repository by clicking the Use this template button:

If you intend to update your copy from upstream, use Fork instead. See Creating a repository from a template for the difference between Use this template and Fork.

Once created, clone this repository to your local machine.

Configure Spinnaker

You can find the recipe for deploying Spinnaker and the Scale Agent in recipes/kustomization-oss-agent.yml.

#-------------------------------------------------------------------------------
# Minimum Starting Point Recipe with Armory Scale Agent.
#
# Self contained Spinnaker installation with no external dependencies and no
# additional configuration needed. This is intended as a starting point for any
# kubernetes cluster. Not for production use.
#
# Features:
# - Spinnaker Operator
# - One Kubernetes account (Spinnaker's own cluster) using the Scale Agent
# - Spinnaker authentication disabled
# - Self hosted minio as a persistent storage
# - Self hosted redis backend for caching and temporal storage of services
#-------------------------------------------------------------------------------
apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

namespace: spinnaker

resources:
 - infrastructure/mysql.yml # (Optional, not for production use). MySQL server needed if using SQL backend in Spinnaker

components:
 - core/base # Defines base configuration across the cluster
 - core/persistence/in-cluster # Enables persistence using MinIO in-cluster
 - targets/kubernetes/scale-agent # Enables the plugin version of the Scale Agent

patchesStrategicMerge:
 - core/patches/oss-version.yml # Sets the OSS version to use 
 - persistence/patch-sql-clouddriver.yml # setup clouddriver to use SQL for storage

transformers:
 - utilities/unique-service-account.yml # Ensures that ServiceAccounts are unique 

# This patch ensures that the correct OSS apiVersion is used.
patches:
 - target:
 kind: SpinnakerService
 path: utilities/switch-to-oss.yml

The resources section contains files that install apps that you want Spinnaker to use, such as MySQL.
The components section contains paths to directories that define collections of Kubernetes resources. This section contains a link to the targets/kubernetes/scale-agent directory, which contains the Scale Agent installation files.
The patchesStrategicMerge section contains links to files that contain partial resource definitions. Kustomize uses these patch files to overwrite sections of components or resources, such as the SpinnakerService definition.
The patches section is a list of files that Kustomize executes to add or replace fields on resources. The utilities/switch-to-oss.yml patch instructs Kustomize to replace apiVersion: spinnaker.armory.io/v1alpha2 with apiVersion: spinnaker.io/v1alpha2 in the SpinnakerService manifest.
The transformers section contains links to files that define Kustomize transformers.

What this recipe does

Configures MinIO as the persistent storage provider (instead of Redis or cloud storage)
Installs MySQL and configures Clouddriver to use MySQL
Enables Clouddriver Account Management
Installs the plugin
Creates a ServiceAccount, ClusterRole, and ClusterRoleBinding for the Scale Agent service
Deploys the service

What this recipe does not do

Publicly expose Spinnaker services
Configure mTLS; communication between the plugin and service is not secure

Spinnaker version

To change the Spinnaker version, update spec.spinnakerConfig.config.version in core/patches/oss-version.yml.

If you chose a Spinnaker version earlier than 1.28, you should modify the targets/kubernetes/scale-agent/plugin-config file to disable Clouddriver Account Management as in the following example:

spec:
 spinnakerConfig:
 profiles:
 clouddriver:
 account:
 storage:
 enabled: false # This enables Clouddriver Account Management; requires Armory CD 2.28+ or Spinnaker 1.28+

Configure your Kubernetes account

You should configure a Kubernetes account or accounts for the Scale Agent service to manage. You do this in targets/kubernetes/scale-agent/armory-agent.yml.

Add your Kubernetes accounts to the kubernetes.accounts section. For example:

kubernetes:
 accounts:
 - kubeconfigFile: /kubeconfigfiles/kubeconfig
 name: agent-demo

Deploy Spinnaker

Execute all commands from the root of spinnaker-kustomize-patches.

Set the kustomize recipe.

The kustomization.yml file in the project root is a symlink to recipes/kustomization-all.yml. Update to point to recipes/kustomization-oss-agent.yml.
```
ln -vfns ./recipes/kustomization-oss-agent.yml kustomization.yml
```
(Optional) Verify the Kustomize build output.
```
kubectl kustomize kustomization.yml
```
This prints out the contents of the manifest file that Kustomize built based on your kustomization file.
Apply the manifest.
```
kubectl apply -k .
```

Verify the installation.

kubectl -n spinnaker get spinsvc && echo "" && kubectl -n spinnaker get pods

You can also access the Clouddriver log to verify that the plugin is running and communicating with the service.

kubectl -n spinnaker logs deployment/spin-clouddriver | grep -E "Start plugin|Starting Kubesvc plugin|Registering agent with"

Confirm success

If you haven’t publicly exposed Spinnaker based on your cloud provider’s guides, you should port-forward in order to access the Spinnaker UI and API:

# port-forward for the UI
kubectl port-forward svc/spin-deck 9000:9000 -n spinnaker
# port-forward for the API
kubectl port-forward svc/spin-gate 8084:8084 -n spinnaker

Create a pipeline with a Deploy manifest stage. You should see your target cluster available in the Accounts list. Deploy a static manifest.

What’s next

Dynamic Accounts Architecture and Features
Migrate Clouddriver Kubernetes Accounts to the Armory Scale Agent
Troubleshoot the Armory Scale Agent Service and Plugin page if you run into issues.

Plugins: Armory Scale Agent Service Deployment Modes

Mon, 01 Jan 0001 00:00:00 +0000

Deployment modes

Spinnaker Service mode

In this mode, you install the Armory Scale Agent service as a new Spinnaker service (spin-armory-agent), so you can configure it like other services.

If you provision clusters automatically, the Armory Scale Agent service can dynamically reload accounts when armory-agent.yaml changes. You could, for example, configure accounts in a ConfigMap mounting to /opt/armory/config/armory-agent-local.yaml. The Agent service reflects ConfigMap changes within seconds after etcd sync.

Pros

You do not have to configure external Network/Application Load Balancers to expose the Clouddriver gRPC port unless you want to use the Dynamic Accounts REST API.
The Agent service can be managed centrally, so it is easy to get logs or configs and upgrade.

Cons

You need to create kubeconfig file for each Kubernetes account.
The API servers of the target clusters need to be accessible from the Armory CD (Spinnaker) cluster.

Infrastructure mode

In infrastructure mode, multiple Agent service deployments handle different groups of Kubernetes clusters. Each service deployment is configured separately.

Keep the following pros and cons in mind when deciding if Infrastructure mode fits your use case:

Pro

The Agent service can be managed centrally, so it is easy to get logs or configs and upgrade.

Cons

You need to create a kubeconfig file for each Kubernetes account.
The API servers of the target clusters need to be accessible from the Armory Scale Agent cluster.
You need to expose gRPC port for Clouddriver through an external load balancer capable of handling HTTP/2 for gRPC communication.

Kubernetes account names must be unique across all your infrastructure. Clouddriver rejects new accounts with a name that matches a different cluster.

Agent mode

In this mode, the Armory Scale Agent service acts as a piece of infrastructure. It authenticates using a service account token. You use RBAC service account permissions to configure what the Armory Scale Agent service is authorized to do.

If the Clouddriver plugin is unable to communicate with the Scale Agent service, the plugin attempts to reconnect during a defined grace period. If the plugin still can’t communicate with the Scale Agent service after the grace period has expired, the plugin removes the cluster associated with that Scale Agent service from Armory CD.

In this mode, Armory CD never gets credentials, and Kubernetes account registration is dynamic.

Keep the following pros and cons in mind when deciding if Agent mode fits your use case:

Pros

Agent mode is scalable because each agent only manages one Kubernetes account.
Initial setup is easier because there’s no need to create kubeconfig files.
Target clusters can remain private or in separate VPCs from the Armory CD (Spinnaker) cluster because Scale Agents initiate the connection to Armory CD (Spinnaker).

Cons

It is difficult to get agent logs, upgrade the Agent service, or check configurations because agents (often) run in third-party clusters that the DevOps team operating Armory CD (Spinnaker) doesn’t have access.
There is no authentication/authorization, so any team can start an Agent and register itself with Armory CD (Spinnaker). mTLS encryption can be used so that only agents with the right certificate can register. For information about how to configure mTLS, see Configure Mutual TLS Authentication.
You need to expose gRPC port for Clouddriver through an external load balancer capable of handling HTTP/2 for gRPC communication.

Scalability

Each Agent can scale to hundreds of Kubernetes clusters. The more types of Kubernetes objects the Armory Scale Agent has to watch, the more memory it uses. Memory usage is bursty. You can control burst with budget. See Agent options for configuration information.

Scaling the Armory Scale Agent can mean:

Scaling the Kubernetes Deployment the Armory Scale Agent service is part of.
Sharding Kubernetes clusters into groups that can in turn be scaled as described in Infrastructure mode above.

You can also mix deployment strategies if you have complex Kubernetes infrastructure and permissions:

Run as a Spinnaker service
Run in target clusters
Run next to traditional Spinnaker Kubernetes accounts

Plugins: Install the AWS Event Cache Plugin in Spinnaker (Operator)

Mon, 01 Jan 0001 00:00:00 +0000

Installation overview

Enabling the AWS Event Cache plugin consists of the following steps:

Configure the plugin
Install the plugin
Create an AWS SNS topic and subscription

Before you begin

You have read the AWS Event Cache overview.
You are running open source Spinnaker.
You manage your instance using the Spinnaker Operator and the spinnaker-kustomize-patches repo. If you are using Halyard, see Install the AWS Event Cache Plugin in Spinnaker (Halyard).

Compatibility

Armory CD Version	Spinnaker Version	AWS Event Cache Plugin Version
2.31.x	1.31.x	0.2.1
2.30.x	1.29.x, 1.30.x	0.2.1
2.28.x	1.28.x	0.2.1

Configure the plugin

Create an aws-event-cache-plugin.yml file with the following contents:

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
metadata:
 name: spinnaker
spec:
 spinnakerConfig:
 profiles:
 spinnaker:
 spinnaker:
 extensibility:
 repositories:
 awscatsOnEvent:
 version: <version>
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 clouddriver: &clouddriver-cats
 spinnaker:
 extensibility:
 plugins:
 Armory.AWSCATsOnEvent:
 enabled: true
 clouddriver-ro:
 *clouddriver-cats
 clouddriver-rw:
 *clouddriver-cats
 clouddriver-caching:
 *clouddriver-cats
 gate:
 spinnaker:
 extensibility:
 plugins:
 Armory.AWSCATsOnEvent:
 enabled: true

Replace <version> with the plugin version compatible with your Spinnaker version.

Save the file to your spinnaker-kustomize-patches/plugins/oss directory.

Install the plugin

Add the plugin patch to your Kustomize recipe’s patchesStrategicMerge section. For example:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18


apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

namespace: spinnaker

components:
 - core/base
 - core/persistence/in-cluster
 - targets/kubernetes/default

patchesStrategicMerge:
 - core/patches/oss-version.yml
 - plugins/oss/aws-event-cache-plugin.yml

patches:
 - target:
 kind: SpinnakerService
 path: utilities/switch-to-oss.yml

Apply the updates to your Kustomization recipe.

kubectl apply -k <kustomization-directory-path>

In the Details section:

Type: Select Standard
Name: Create a meaningful name, such as AWS Event Cache Plugin

In the Access policy section:

Select Advanced and add the following policy:

 {
 "Version": "2008-10-17",
 "Statement": [
 {
 "Sid": "AWSConfigSNSPolicy",
 "Effect": "Allow",
 "Principal": {
 "Service": "config.amazonaws.com"
 },
 "Action": "sns:Publish",
 "Resource": "arn:aws:sns:us-west-2:568975057762:config-topic-568975057762"
 }
 ]
 }

Protocol: Select either HTTP or HTTPS depending on your Gate endpoint.
Endpoint: This is your Gate endpoint.

Plugins: Install the GitHub Integration Plugin in Spinnaker (Operator)

Mon, 01 Jan 0001 00:00:00 +0000

Installation overview

Enabling the GitHub Integration plugin consists of the following steps:

Meet the prerequisites
Create and install a GitHub App
Configure the plugin
Install the plugin

Before you begin

You have read the GitHub Integration Plugin overview.
You are familiar with GitHub Apps.

You are running open source Spinnaker.
You manage your instance using the Spinnaker Operator and the spinnaker-kustomize-patches repo. If you are using Halyard, see Install the GitHub Integration Plugin in Spinnaker (Halyard).

Compatibility

Armory CD Version	Spinnaker Version	GitHub Integration Plugin Version
2.30.x	1.30.x	0.1.2

Create and install a GitHub App

You need to create and install a GitHub App that interacts with the GitHub Integration plugin.

Create a GitHub App. Follow the instructions in GitHub’s Registering a GitHub App guide.
- Provide values for GitHub App name. Homepage URL, and Repository permissions. You do not need to fill out the Identifying and authorizing users, Post installation, or Webhook sections.
- Your GitHub App should have the following Repository permissions:
  - Actions: Read and write
  - Contents: Read and write
  - Deployments: Read and write
  - Environments: Read and write
  - Metadata: Read-only
- You do need to generate a private key (Private keys section).
- Be sure to note the GitHub App’s App ID and Private key. You need these to configure the GitHub Integration plugin.
Install the GitHub App you created either in a specific repo or organization-wide. Follow the instructions in GitHub’s Installing your own GitHub App guide.

Configure the plugin

Create a github-integration-plugin.yml file with the following contents:

apiVersion: spinnaker.io/v1alpha2
kind: SpinnakerService
metadata:
 name: spinnaker
spec:
 spinnakerConfig:
 profiles:
 spinnaker:
 github:
 plugin:
 accounts: []
 spinnaker:
 extensibility:
 repositories:
 repository:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 deck:
 settings-local.js:
 gate:
 spinnaker:
 extensibility:
 plugins:
 Armory.Integration:
 enabled: true
 version: <version>
 deck-proxy:
 enabled: true
 plugins:
 Armory.GithubApi:
 enabled: true
 version: <version>
 orca:
 spinnaker:
 extensibility:
 plugins:
 Armory.Integration:
 enabled: true
 version: <version>
 igor:
 spinnaker:
 extensibility:
 plugins:
 Armory.Integration:
 enabled: true
 version: <version>
 echo:
 spinnaker:
 extensibility:
 plugins:
 Armory.Integration:
 enabled: true
 version: <version>

For example:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37


spec:
 spinnakerConfig:
 profiles:
 spinnaker:
 github:
 plugin:
 accounts: []
 spinnaker:
 extensibility:
 repositories:
 repository:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 deck:
 settings-local.js: |
 window.spinnakerSettings = {
 ... (content omitted for brevity)
 triggerTypes: [
 'artifactory',
 'concourse',
 'cron',
 'docker',
 'git',
 'githubWorkflow',
 'githubEvent',
 'helm',
 'jenkins',
 'nexus',
 'pipeline',
 'plugin',
 'pubsub',
 'travis',
 'webhook',
 'wercker',
 ]
 ... (content omitted for brevity)
 }

version: Replace <version> with the plugin version compatible with your Spinnaker version.
accounts: Configure the GitHub location(s) where you installed the GitHub App you created. The configuration differs depending on whether you installed the GitHub App organization-wide or with access to individual repositories.

- name: <name>
 organization: <github-organization>
 repository: <github-repository>
 defaultBranch: <default-github-branch>
 githubAppId: <github-app-id>
 githubAppPrivateKey: <github-app-private-key>
 permissions: []

All fields are required.

name: Unique name; this name appears in the GitHub Integration stages’ GitHub Account select list.
organization: GitHub organization that you installed the GitHub App in
repository: The GitHub repository to access
defaultBranch: Default repository branch; for example, main or master
githubAppId: The GitHub App’s App ID
githubAppPrivateKey: The GitHub App’s private key; this field supports encrypted field references; see Work with Secrets in Spinnaker for details.

- name: <name>
 organization: <github-organization>
 orgWideInstallation: true
 includePublicRepositories: false
 defaultBranch: <default-github-branch>
 githubAppId: <github-app-id>
 githubAppPrivateKey: <github-app-private-key>
 permissions: []

All fields are required.

name: Unique name; this name appears in the GitHub Integration stages’ GitHub Account select list.
organization: GitHub organization that you installed the GitHub App in
orgWideInstallation: true
includePublicRepositories: true/false (Optional) Defaults to false. Flag to limit the Spinnaker triggers to only PRIVATE/INTERNAL repositories that the Github App installation has access to.
defaultBranch: Default repository branch; for example, main or master
githubAppId: The GitHub App’s App ID
githubAppPrivateKey: The GitHub App’s private key; this field supports encrypted field references; see Work with Secrets in Spinnaker for details.

Save the file to your spinnaker-kustomize-patches/plugins/oss directory.

Accounts config example

In this example, you have company-public and company-private GitHub organizations, so you created two GitHub Apps, one for each org.

You installed the GitHub App for the company-private org with access to all repos in the org.
You installed the GitHub App for the company-public org with access to two specific repos in the org.

Your accounts config looks like this:

github:
 plugin:
 accounts:
 - name: FirstAppRepo
 organization: company-public
 repository: first-app-repo
 defaultBranch: master
 githubAppId: 9753
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-9753-privatekey
 permissions: []
 - name: SecondAppRepo
 organization: company-public
 repository: second-app-repo
 defaultBranch: main
 githubAppId: 9753
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-9753-privatekey
 permissions: []
 - name: CompanyPrivateOrgAllRepos
 organization: company-private
 orgWideInstallation: true
 includePublicRepositories: false
 defaultBranch: main
 githubAppId: 1357
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-1357-privatekey
 permissions: []

Install the plugin

Add the plugin patch to your Kustomize recipe’s patchesStrategicMerge section. For example:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18


apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

namespace: spinnaker

components:
 - core/base
 - core/persistence/in-cluster
 - targets/kubernetes/default

patchesStrategicMerge:
 - core/patches/oss-version.yml
 - plugins/oss/github-integration-plugin.yml

patches:
 - target:
 kind: SpinnakerService
 path: utilities/switch-to-oss.yml

Apply the updates to your Kustomization recipe.

kubectl apply -k <kustomization-directory-path>

What’s next

Learn how to use the GitHub Integration plugin.

Plugins: Install the AWS Event Cache Plugin in Spinnaker (Halyard)

Mon, 01 Jan 0001 00:00:00 +0000

Installation overview

Enabling the AWS Event Cache plugin consists of the following steps:

Configure the plugin
Install the plugin
Create an AWS SNS topic and subscription

Before you begin

You have read the AWS Event Cache overview.
You are running open source Spinnaker.
You manage your instance using Halyard. If you are using the Spinnaker Operator, see Install the AWS Event Cache Plugin in Spinnaker (Operator).

A note about installing plugins in Spinnaker

When Halyard adds a plugin to a Spinnaker installation, it adds the plugin repository information to all services, not just the ones the plugin is for. This means that when you restart Spinnaker, each service restarts, downloads the plugin, and checks if an extension exists for that service. Each service restarting is not ideal for large Spinnaker installations due to service restart times. Clouddriver can take an hour or more to restart if you have many accounts configured.

The AWS Event Cache plugin extends Clouddriver and Gate. To avoid every Spinnaker service restarting and downloading the plugin, do not add the plugin using Halyard. Instead, follow the local config installation method, in which you configure the plugin in each extended service’s local profile.

Compatibility

Armory CD Version	Spinnaker Version	AWS Event Cache Plugin Version
2.31.x	1.31.x	0.2.1
2.30.x	1.29.x, 1.30.x	0.2.1
2.28.x	1.28.x	0.2.1

Configure the plugin

Update clouddriver-local.yml, and gate-local.yml config files with the following:

spinnaker:
 extensibility:
 plugins:
 Armory.Integration:
 id: Armory.AWSCATsOnEvent
 enabled: true
 version: <version>
 repositories:
 githubIntegration:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json

Replace <version> with the plugin version compatible with your Spinnaker version.

Install the plugin

Once you’ve apply your changes:

hal deploy apply

In the Details section:

Type: Select Standard
Name: Create a meaningful name, such as AWS Event Cache Plugin

In the Access policy section:

Select Advanced and add the following policy:

 {
 "Version": "2008-10-17",
 "Statement": [
 {
 "Sid": "AWSConfigSNSPolicy",
 "Effect": "Allow",
 "Principal": {
 "Service": "config.amazonaws.com"
 },
 "Action": "sns:Publish",
 "Resource": "arn:aws:sns:us-west-2:568975057762:config-topic-568975057762"
 }
 ]
 }

Protocol: Select either HTTP or HTTPS depending on your Gate endpoint.
Endpoint: This is your Gate endpoint.

Plugins: Install the GitHub Integration Plugin in Spinnaker (Halyard)

Mon, 01 Jan 0001 00:00:00 +0000

Installation overview

Enabling the GitHub Integration plugin consists of the following steps:

Meet the prerequisites
Create and install a GitHub App
Add the plugin to local config files
Install the plugin

Before you begin

You have read the GitHub Integration Plugin overview.
You are familiar with GitHub Apps.

You are running open source Spinnaker.
You manage your instance using Halyard. If you are using the Spinnaker Operator, see Install the GitHub Integration Plugin in Spinnaker (Operator).

A note about installing plugins in Spinnaker

The GitHub Integration plugin extends Deck, Echo, Gate, Igor, and Orca. To avoid every Spinnaker service restarting and downloading the plugin, do not add the plugin using Halyard. Instead, follow the local config installation method, in which you configure the plugin in each extended service’s local profile.

Compatibility

Armory CD Version	Spinnaker Version	GitHub Integration Plugin Version
2.30.x	1.30.x	0.1.2

Create and install a GitHub App

You need to create and install a GitHub App that interacts with the GitHub Integration plugin.

Create a GitHub App. Follow the instructions in GitHub’s Registering a GitHub App guide.
- Provide values for GitHub App name. Homepage URL, and Repository permissions. You do not need to fill out the Identifying and authorizing users, Post installation, or Webhook sections.
- Your GitHub App should have the following Repository permissions:
  - Actions: Read and write
  - Contents: Read and write
  - Deployments: Read and write
  - Environments: Read and write
  - Metadata: Read-only
- You do need to generate a private key (Private keys section).
- Be sure to note the GitHub App’s App ID and Private key. You need these to configure the GitHub Integration plugin.
Install the GitHub App you created either in a specific repo or organization-wide. Follow the instructions in GitHub’s Installing your own GitHub App guide.

Add the plugin to local config files

settings-local.js

Add github to the triggerTypes array in your existing settings-local.js file:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
21
22


window.spinnakerSettings = {
...
triggerTypes: [
 'artifactory',
 'concourse',
 'cron',
 'docker',
 'git',
 'githubWorkflow',
 'githubEvent',
 'helm',
 'jenkins',
 'nexus',
 'pipeline',
 'plugin',
 'pubsub',
 'travis',
 'webhook',
 'wercker',
 ]
...
}

Service config files

Update echo-local.yml, gate-local.yml, igor-local.yml, and orca-local.yml config files with the following:

spinnaker:
 extensibility:
 plugins:
 Armory.Integration:
 id: Armory.Integration
 enabled: true
 version: <version>
 repositories:
 githubIntegration:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
github:
 plugin:
 accounts: []

version: Replace <version> with the plugin version compatible with your Spinnaker version.
accounts: Configure the GitHub location(s) where you installed the GitHub App you created. The configuration differs depending on whether you installed the GitHub App organization-wide or with access to individual repositories.

- name: <name>
 organization: <github-organization>
 repository: <github-repository>
 defaultBranch: <default-github-branch>
 githubAppId: <github-app-id>
 githubAppPrivateKey: <github-app-private-key>
 permissions: []

All fields are required.

name: Unique name; this name appears in the GitHub Integration stages’ GitHub Account select list.
organization: GitHub organization that you installed the GitHub App in
repository: The GitHub repository to access
defaultBranch: Default repository branch; for example, main or master
githubAppId: The GitHub App’s App ID
githubAppPrivateKey: The GitHub App’s private key; this field supports encrypted field references; see Work with Secrets in Spinnaker for details.

- name: <name>
 organization: <github-organization>
 orgWideInstallation: true
 includePublicRepositories: false
 defaultBranch: <default-github-branch>
 githubAppId: <github-app-id>
 githubAppPrivateKey: <github-app-private-key>
 permissions: []

All fields are required.

name: Unique name; this name appears in the GitHub Integration stages’ GitHub Account select list.
organization: GitHub organization that you installed the GitHub App in
orgWideInstallation: true
includePublicRepositories: true/false (Optional) Defaults to false. Flag to limit the Spinnaker triggers to only PRIVATE/INTERNAL repositories that the Github App installation has access to.
defaultBranch: Default repository branch; for example, main or master
githubAppId: The GitHub App’s App ID
githubAppPrivateKey: The GitHub App’s private key; this field supports encrypted field references; see Work with Secrets in Spinnaker for details.

Accounts config example

In this example, you have company-public and company-private GitHub organizations, so you created two GitHub Apps, one for each org.

You installed the GitHub App for the company-private org with access to all repos in the org.
You installed the GitHub App for the company-public org with access to two specific repos in the org.

Your accounts config looks like this:

github:
 plugin:
 accounts:
 - name: FirstAppRepo
 organization: company-public
 repository: first-app-repo
 defaultBranch: master
 githubAppId: 9753
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-9753-privatekey
 permissions: []
 - name: SecondAppRepo
 organization: company-public
 repository: second-app-repo
 defaultBranch: main
 githubAppId: 9753
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-9753-privatekey
 permissions: []
 - name: CompanyPrivateOrgAllRepos
 organization: company-private
 orgWideInstallation: true
 includePublicRepositories: false
 defaultBranch: main
 githubAppId: 1357
 githubAppPrivateKey: encrypted:k8s!n:spin-secrets!k:github-app-1357-privatekey
 permissions: []

Deck plugin

Configure the Deck plugin in your gate-local.yml config file:

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20


spinnaker:
 extensibility:
 plugins:
 Armory.Integration:
 id: Armory.Integration
 enabled: true
 version: <version>
 repositories:
 githubIntegration:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 deck-proxy:
 enabled: true
 plugins:
 Armory.Integration:
 enabled: true
 version: <version>
github:
 plugin:
 accounts: [] 

Install the plugin

Apply your changes:

hal deploy apply

What’s next

Learn how to use the GitHub Integration plugin.

Plugins: Install Pipelines-as-Code in Spinnaker (Spinnaker Operator)

Mon, 01 Jan 0001 00:00:00 +0000

Overview

In this guide, you use the Kustomize files in the spinnaker-kustomize-patches repo to deploy the service and install the plugin. You do need to update the contents of some files.

Compatibility

Spinnaker Version	Pipelines-as-Code Service Version	Pipelines-as-Code Plugin Version
1.30.x	2.30	0.0.5
1.28.x	2.28	0.0.5
1.27.x	2.27	0.0.5
1.26.x	2.26	0.0.5

Before you begin

You are running open source Spinnaker.
You manage your instance using the Spinnaker Operator and the spinnaker-kustomize-patches repo. If you are using Halyard, see Install Pipelines-as-Code in Spinnaker (Halyard).

Find the files

You can find the Pipelines-as-Code files in the spinnaker-kustomize-patches repo’s plugins/oss/pipelines-as-code directory.

kustomization.yml: Kustomize build file
deployment.yml: spin-dinghy Deployment manifest
dinghy.yml: service config
pac-plugin-config.yml: plugin config
service.yml: spin-dinghy Service manifest
spinnaker.yml: Spinnaker service mapping
versions directory: contains version-specific values that Kustomize inserts into the manifest during generation

The spinnaker-kustomize-patches/recipes directory contains the example kustomization-oss-pac.yml recipe. You can use that recipe or copy the entries to your recipe. This guide uses the kustomization-oss-pac.yml recipe for examples.

Configure the service

Set your Spinnaker version

Make sure the service version is compatible with your Spinnaker version.

You specify the version in the patchesStrategicMerge section of plugins/oss/pipelines-as-code/kustomization.yml. You can find supported versions in the plugins/oss/pipelines-as-code/versions directory. For example, if you are running Spinnaker 1.27.x, replace ./versions/v-1.28.yml with ./versions/v-1.27.yml.

patchesStrategicMerge:
 - ./pac-plugin-config.yml
 - ./versions/v-1.28.yml

Configure your repo

Important

Configure your repo in the plugins/oss/pipelines-as-code/dinghy.yml file.

Before configuring your repos, ensure you have the following:

A personal access token that has read access to the repo where you store your dinghyfile and the repo where you store module files. You should create a Kubernetes Secret for your personal access token so you don’t store the token in plain text in your config file.
The organization where the app repos and templates reside; for example, if your repo is armory-io/dinghy-templates, your template-org is armory-io.
The name of the repo containing your modules; for example, if your repo is armory-io/dinghy-templates, your template-repo is dinghy-templates.

Add the following to your dinghy.yml config:

templateOrg: <repo-org>
templateRepo: <dinghy-templates-repo>
githubToken: <abc>
githubEndpoint: <https://api.github.com>

All fields are required.

templateOrg: VCS organization or namespace where application and template repositories are located
templateRepo: VCS repository where module templates are located
githubToken: GitHub token; This field supports “encrypted” field references; see Secrets for details.
githubEndpoint: (Default: https://api.github.com) GitHub API endpoint. Useful if you’re using GitHub Enterprise.

GitHub webhooks

Set up webhooks at the organization level for push events. You can do this by going to https://github.com/organizations/<your_org_here>/settings/hooks.

Set content-type to application/json.
Set the Payload URL to your Gate URL. Depending on whether you configured Gate to use its own DNS name or a path on the same DNS name as Deck, the URL follows one of the following formats:
- https://<your-gate-url>/webhooks/git/github if you have a separate DNS name or port for Gate
- https://<your-spinnaker-url>/api/v1/webhooks/git/github if you’re using a different path for Gate

Pull request validations

Make PR validations mandatory to ensure users only merge working dinghyfiles.

Perform the following steps to configure mandatory PR validation:

Go to your GitHub repository.
Click on Settings > Branches.
In Branch protection rules, select Add rule.
Add master in Branch name pattern so that the rule gets enforced on the master branch. Note that if this is a new repository with no commits, the “dinghy” option does not appear. You must first create a dinghyfile in any branch.
Select Require status checks to pass before merging and make dinghy required. Select Include administrators as well so that all PRs get validated, regardless of user.

The following screenshot shows what your GitHub settings should resemble:

Add the following to your dinghy.yml config:

templateOrg: <repo-org>
templateRepo: <dinghy-templates-repo>
stashUsername: <stash_user>
stashToken: <abc>
stashEndpoint: <https://my-endpoint>

All fields are required.

templateRepo: VCS repository where module templates are located
stashUsername: Stash username
stashToken: Stash token. This field supports “encrypted” field references; see Secrets for details.
stashEndpoint: Stash API endpoint. If you’re using Bitbucket Server, update the endpoint to include the api e.g. https://your-endpoint-here.com/rest/api/1.0

If you’re using Bitbucket Server, update the endpoint to include the api, e.g. --stash-endpoint https://your-endpoint-here.com/rest/api/1.0

Add the following to your dinghy.yml config:

templateOrg: <repo-org>
templateRepo: <dinghy-templates-repo>
gitlabToken: <abc>
gitlabEndpoint: <https://my-endpoint>

All fields are required.

templateOrg: VCS organization or namespace where application and template repositories are located
templateRepo: VCS repository where module templates are located
gitlabToken: GitLab token. This field supports “encrypted” field references; see Secrets for details.
gitlabEndpoint: GitLab endpoint

Configure the plugin

In pac-plugin-config.yml, make sure the version number is compatible with your Spinnaker instance.

Show the manifest

#------------------------------------------------------------------------------
# Example configuration for enabling the Pipeline as a Code plugin
#------------------------------------------------------------------------------
apiVersion: spinnaker.armory.io/v1alpha2
kind: SpinnakerService
metadata:
 name: spinnaker
spec:
 spinnakerConfig:
 profiles:
 # Configs in the spinnaker profile get applied to all services
 spinnaker:
 spinnaker:
 extensibility:
 repositories:
 repository:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 gate:
 spinnaker:
 extensibility:
 plugins:
 Armory.PipelineAsACode:
 enabled: true
 version: 0.0.5
 echo:
 armorywebhooks:
 enabled: true
 forwarding:
 baseUrl: http://spin-dinghy:8081
 endpoint: v1/webhooks
 spinnaker:
 extensibility:
 plugins:
 Armory.PipelineAsACode:
 enabled: true
 version: 0.0.5

Deploy

This step deploys the Dinghy service and installs the plugin. If you want to see the generated manifest before you deploy, execute kubectl kustomize.

Apply the updates to your Kustomization file.

kubectl apply -k <kustomization-directory-path>

What’s next

Configure Pipelines-as-Code Optional Features

Plugins: Install Terraform Integration in Spinnaker (Spinnaker Operator)

Mon, 01 Jan 0001 00:00:00 +0000

Overview of installing Terraform Integration

In this guide, you use the Kustomize files in the spinnaker-kustomize-patches repo to install the plugin. You do need to update the contents of some files.

Configure Spinnaker
Get the Terraform Integration installation files
Configure the service
Configure the plugin
Deploy Terraform Integration

Compatibility

Spinnaker Version	Terraform Integration Service Version	Terraform Integration Plugin Version
1.30.x	2.30	0.0.2
1.29.x	2.28	0.0.1
1.28.x	2.28	0.0.1

Before you begin

You have read the Terraform Integration Overview.

Spinnaker requirements

You are running open source Spinnaker.
You manage your instance using the Spinnaker Operator and the spinnaker-kustomize-patches repo. If you are using Halyard, see Install Terraform Integration in Spinnaker (Halyard).

Terraform Integration requirements

Basic auth credentials for the Git repository where your store your Terraform scripts. The Terraform Integration plugin needs access to credentials to download directories that house your Terraform templates.
- You can configure your Git repo with any of the following:
  - A Personal Access Token (potentially associated with a service account).
  - SSH protocol in the form of an SSH key or an SSH key file
  - Basic auth in the form of a user and password, or a user-password file
A source for Terraform Input Variable files (tfvar) or a backend config. You must have a separate artifact provider that can pull your tfvar file(s). The Terraform Integration plugin supports the following artifact providers for tfvar files and backend configs:
- GitHub
- BitBucket
- HTTP artifact
A dedicated external Redis instance
- Armory requires configuring a dedicated external Redis instance for production usage of the Terraform Integration plugin. This is to ensure that you do not encounter scaling or stability issues in production.

Configure Spinnaker

Configure Redis

Terraform Integration uses Redis to store Terraform logs and plans.

You can only configure the Terraform Integration feature to use a password with the default Redis user.

Configure Redis settings in your configuration and then apply.

spec:
 spinnakerConfig:
 profiles:
 terraformer:
 redis:
 baseUrl: "redis://spin-redis:6379"
 password: "password"

Configure your artifact account

The Terraform Integration uses the following artifact accounts:

Git Repo - To fetch the repo housing your main Terraform files.
GitHub, BitBucket or HTTP - Optional. To fetch single files such as var-files or backend config files.

Configure the Git Repo artifact

Spinnaker uses the Git Repo Artifact Provider to download the repo containing your main Terraform templates.

Edit your configuration to add the following:

spec:
 spinnakerConfig:
 profiles:
 clouddriver:
 artifacts:
 gitRepo:
 enabled: true
 accounts:
 - name: gitrepo
 token: <your-personal-access-token> # personal access token

For more configuration options, see Configure a Git Repo Artifact Account.

Configure additional repos

This step is optional.

These optional steps describe how to configure GitHub as an artifact provider for the Terraform Integration.

Spinnaker uses the Github Artifact Provider to download any referenced tfvar files.

Configure your GitHub artifact:

spec:
 spinnakerConfig:
 config:
 artifacts:
 github:
 accounts:
 - name: <github-for-terraform>
 token: <your-github-personal-access-token>
 enabled: true

name: the name for this account; replace github-for-terraform with a unique identifier for the artifact account.
token: GitHub personal access token; this field supports “encrypted” field references.

Spinnaker uses the BitBucket Artifact Provider to download any referenced tfvar files, so it must be configured with the BitBucket token to pull these files.

spec:
 spinnakerConfig:
 config:
 artifacts:
 bitbucket:
 enabled: true
 accounts:
 - name: <bitbucket-for-terraform>
 username: <your-bitbucket-username>
 password: <your-bitbucket-password>

name: the name for this account; replace <bitbucket-for-terraform> with a unique identifier for the artifact account.
username: Your Bitbucket username.
password: Your Bitbucket password; this field supports “encrypted” field references.

Get the Terraform Integration installation files

You can find the Terraform Integration service and plugin files in the spinnaker-kustomize-patches repo’s plugins/oss/terraformer directory.

kustomization.yml: Kustomize build file
deployment.yml: spin-terraformer Deployment manifest
service.yml: spin-terraformer Service manifest
terraformer-plugin-config.yml: plugin installation
terraformer.yml: config file
terraformer-local.yml: config file for Named Profiles
spinnaker.yml: Spinnaker service mapping
versions directory: contains version-specific values that Kustomize inserts into the manifest during generation

The spinnaker-kustomize-patches/recipes directory contains the example kustomization-oss-terraformer.yml recipe. You can use that recipe or copy the entries to your recipe. This guide uses the kustomization-oss-terraformer.yml recipe for examples.

Configure the service

Make sure the service version is compatible with your Spinnaker version.

You specify the version in the patchesStrategicMerge section of plugins/oss/terraformer/kustomization.yml. You can find supported versions in the plugins/oss/terraformer/versions directory. For example, if you are running Spinnaker 1.27.x, replace ./versions/v-1.28.yml with ./versions/v-1.27.yml.

patchesStrategicMerge:
 - ./pac-plugin-config.yml
 - ./versions/v-1.28.yml

Configure the plugin

In terraformer-plugin-config.yml, make sure the version number is compatible with your Spinnaker instance.

...
 spinnaker:
 extensibility:
 plugins:
 Armory.Terraformer:
 enabled: true
 version: &pluginversion 0.0.1

For example, if you want to use plugin version 0.0.2, your version value would be &pluginversion 0.0.2.

Deploy Terraform Integration

This step deploys the Terraformer service and installs the plugin. If you want to see the generated manifest before you deploy, execute kubectl kustomize.

Apply the updates to your Kustomization file.

kubectl apply -k <kustomization-directory-path>

What’s next

Plugins: Deploy the Armory Scale Agent Service Using Kubernetes Manifests

Mon, 01 Jan 0001 00:00:00 +0000

Before you begin

You have installed the Scale Agent plugin and obtained its LoadBalancer address.

Create a namespace

In the deployment target cluster, execute kubectl create ns spin-agent to create a namespace for the Armory Scale Agent service.

Configure permissions

The Agent can run with most features on the default ServiceAccount. However, if you want the Scale Agent to load balance connections or assign a precise Zone ID, the Scale Agent needs permissions to get Pods, Deployments, ReplicaSets, and Namespaces in your cluster. Rather than modifying the default ServiceAccount permissions, Armory recommends creating a new ServiceAccount, ClusterRole, and ClusterRoleBinding for the Scale Agent.

Apply the following manifest in your spin-agent namespace:

Show me a manifest

apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
 name: spin-cluster-role
rules:
- apiGroups:
 - ""
 resources:
 - configmaps
 - endpoints
 - events
 - ingresses
 - ingresses/status
 - jobs
 - jobs/status
 - namespaces
 - namespaces/finalize
 - namespaces/status
 - pods
 - pods/log
 - pods/status
 - secrets
 - services
 - services/status
 - services/finalizers
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
- apiGroups:
 - batch
 resources:
 - jobs
 - jobs/status
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
- apiGroups:
 - apps
 - extensions
 resources:
 - daemonsets
 - daemonsets/status
 - deployments
 - deployments/finalizers
 - deployments/scale
 - deployments/status
 - replicasets
 - replicasets/finalizers
 - replicasets/scale
 - replicasets/status
 - statefulsets
 - statefulsets/finalizers
 - statefulsets/scale
 - statefulsets/status
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
- apiGroups:
 - monitoring.coreos.com
 resources:
 - servicemonitors
 verbs:
 - get
 - create
- apiGroups:
 - spinnaker.armory.io
 resources:
 - '*'
 - spinnakerservices
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
- apiGroups:
 - apiextensions.k8s.io
 resources:
 - customresourcedefinitions
 verbs:
 - '*'
- apiGroups:
 - admissionregistration.k8s.io
 resources:
 - validatingwebhookconfigurations
 verbs:
 - '*'
- apiGroups:
 - argoproj.io
 resources:
 - '*'
 verbs:
 - '*'
---
apiVersion: v1
kind: ServiceAccount
metadata:
 namespace: spin-agent
 name: spin-sa
---
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
 name: spin-cluster-role-binding
subjects:
 - kind: ServiceAccount
 name: spin-sa
 namespace: spin-agent
roleRef:
 apiGroup: rbac.authorization.k8s.io
 kind: ClusterRole
 name: spin-cluster-role

Configure the service

Configure the Armory Scale Agent service using a ConfigMap. Define armory-agent.yml in the data section:

apiVersion: v1
kind: ConfigMap
metadata:
 name: armory-agent-config
 namespace: spin-agent
data:
 armory-agent.yml: |
 server:
 port: 8082

Clouddriver plugin LoadBalancer

Replace spin-clouddriver-grpc with the IP address of your Clouddriver service.

apiVersion: v1
kind: ConfigMap
metadata:
 name: armory-agent-config
 namespace: spin-agent
data:
 armory-agent.yaml: |
 clouddriver:
 grpc: spin-clouddriver-grpc:9091
 insecure: true

Kubernetes account

Add your Kubernetes account configuration for your cluster:

apiVersion: v1
kind: ConfigMap
metadata:
 name: kubesvc-config
 namespace: spin-agent
data:
 armory-agent.yaml: |
 clouddriver:
 grpc: spin-clouddriver-grpc:9091
 insecure: true
 kubernetes:
 accounts:
 - name:
 kubeconfigFile:
 insecure:
 context:
 oAuthScopes:
 serviceAccount: true
 serviceAccountName: spin-sa
 namespaces: []
 omitNamespaces: []
 onlyNamespacedResources:
 kinds: []
 omitKinds: []
 customResourceDefinitions: [{kind:}]
 metrics:
 permissions: []
 maxResumableResourceAgeMs:
 onlySpinnakerManaged:
 noProxy:

See the Agent options for field explanations.

Apply the manifest to your spin-agent namespace.

Deploy the Armory Scale Agent service

Apply the following Agent deployment manifest in your spin-agent namespace:

Show me the manifest

apiVersion: apps/v1
kind: Deployment
metadata:
 labels:
 app: spin
 app.kubernetes.io/name: armory-agent
 app.kubernetes.io/part-of: spinnaker
 cluster: spin-armory-agent
 name: spin-armory-agent
spec:
 replicas: 1
 selector:
 matchLabels:
 app: spin
 cluster: spin-armory-agent
 template:
 metadata:
 labels:
 app: spin
 app.kubernetes.io/name: armory-agent
 app.kubernetes.io/part-of: spinnaker
 cluster: spin-armory-agent
 spec:
 serviceAccount: spin-sa
 containers:
 - image: armory/agent-k8s:<version> # must be compatible with your Spinnaker or Armory CD version
 imagePullPolicy: IfNotPresent
 name: armory-agent
 ports:
 - name: health
 containerPort: 8082
 protocol: TCP
 - name: metrics
 containerPort: 8008
 protocol: TCP
 readinessProbe:
 httpGet:
 port: health
 path: /health
 failureThreshold: 3
 periodSeconds: 10
 successThreshold: 1
 timeoutSeconds: 1
 terminationMessagePath: /dev/termination-log
 terminationMessagePolicy: File
 volumeMounts:
 - mountPath: /opt/armory/config
 name: volume-armory-agent-config
 # - mountPath: /kubeconfigfiles
 # name: volume-armory-agent-kubeconfigs
 restartPolicy: Always
 volumes:
 - name: volume-armory-agent-config
 configMap:
 name: armory-agent-config
 # - name: volume-armory-agent-kubeconfigs
 # secret:
 # defaultMode: 420
 # secretName: kubeconfigs-secret

Confirm success

Create a pipeline with a Deploy manifest stage. You should see your target cluster available in the Accounts list. Deploy a static manifest.

What’s next

Troubleshoot the Armory Scale Agent Service and Plugin page if you run into issues.
Learn how to Integrate Prometheus. Agent CPU usage is low, but the amount of memory depends on the size of the cluster the Armory Scale Agent is monitoring. The gRPC buffer consumes about 4MB of memory.
Configure Mutual TLS Authentication
Read about Kubernetes Permissions for the Armory Scale Agent

Plugins: Install the Armory Scale Agent in an Existing Spinnaker Instance

Mon, 01 Jan 0001 00:00:00 +0000

How to get started using the Scale Agent with open source Spinnaker

This guide assumes you want to evaluate the Scale Agent with an existing Spinnaker test instance. With that in mind:

Your Spinnaker test instance is running in the spinnaker namespace.
You have Kubernetes accounts configured in Clouddriver so you can evaluate account migration.
You are going to deploy the Scale Agent service in the same cluster and namespace as your Spinnaker test instance.

The following features require Spinnaker 1.28+ and Clouddriver Account Management:

Automated scanning for newly created accounts in Clouddriver and migrating those accounts to Scale Agent management
Intercepting and processing requests sent to Clouddriver’s <GATE-URL>/credentials endpoint

Objectives

Meet the prerequisites outlined in the Before you begin section.
Configure the Clouddriver plugin in your clouddriver-local.yml file and deploy using Halyard.
Learn the options for migrating Clouddriver accounts to the Scale Agent.
Configure and deploy the Scale Agent service in the cluster and namespace where Spinnaker is running (Spinnaker Service mode).
Confirm success.

Since this guide is for installing the Armory Scale Agent in a test environment, it does not include mTLS configuration. The Armory Agent service and plugin do not communicate securely.

Before you begin

You are familiar with how plugins work in Spinnaker. See open source Spinnaker’s Plugin User Guide.
You have read the Scale Agent overview.
You have configured Clouddriver to use MySQL or PostgreSQL. See the Configure Clouddriver to use a SQL Database guide for instructions. The Scale Agent plugin uses the SQL database to store cache data and dynamically created Kubernetes accounts.

For Clouddriver pods, you have mounted a service account with permissions to list and watch the Kubernetes kind Endpoint in the namespace where Clouddriver is running.

apiVersion: rbac.authorization.k8s.io/v1
kind: Role
metadata:
 name: spin-sa
rules:
 - apiGroups:
 - ""
 resources:
 - endpoints
 verbs:
 - list
 - watch

Verify that there is a Kubernetes Service with prefix name spin-clouddriver (configurable) routing HTTP traffic to Clouddriver pods, having a port with name http (configurable).
You have at least one Kubernetes cluster to serve as your deployment target cluster.

Choose the Scale Agent version that is compatible with your Spinnaker version.

Armory CD (Spinnaker) Version	Scale Agent Plugin Version	Scale Agent Service Version
2.28.x (1.28.x)	0.11.56	1.0.84
1.29.x	0.12.21	1.0.84
2.30.x (1.30.x)	0.13.20	1.0.84
2.31.x (1.31.x)	0.14.1	1.0.84
2.32.x (1.32.x)	0.14.1	1.0.84
2.35.x (1.35.x)	0.16.2	1.0.84

Database compatibility:

MySQL	PostgreSQL
5.7; AWS Aurora	10+

Install the plugin

Warning

The Scale Agent plugin extends Clouddriver. When Halyard adds a plugin to a Spinnaker installation, it adds the plugin repository information to each service. This means that when you restart Spinnaker, each service restarts, downloads the plugin, and checks if an extension exists for that service. Each service restarting is not ideal for large Spinnaker installations due to service restart times. To avoid each service restarting and downloading the plugin, configure the plugin in Clouddriver’s local profile.

This guide show how to install the plugin using a plugin repository. You can also install the plugin from Docker if you want to cache the plugin and run security scans on it before installation.

If you don’t have a Clouddriver local profile, create one in the same directory as the other Halyard configuration files. This is usually ~/.hal/default/profiles on the machine where Halyard is running.

Add the following to your clouddriver-local.yml file:

This code snippet includes enabling Clouddriver Account Management configuration so you can evaluate the Scale Agent’s interceptor and automatic scanning features.

spinnaker:
 extensibility:
 repositories:
 armory-agent-k8s-spinplug-releases:
 enabled: true
 url: https://raw.githubusercontent.com/armory-io/agent-k8s-spinplug-releases/master/repositories.json
 plugins:
 Armory.Kubesvc:
 enabled: true
 version: 0.16.2 # check compatibility matrix for your Armory CD version
 extensions:
 armory.kubesvc:
 enabled: true
 # Plugin config
 kubesvc:
 cluster: kubernetes
spinnaker:
 extensibility:
 repositories:
 armory-agent-k8s-spinplug-releases:
 enabled: true
 url: https://raw.githubusercontent.com/armory-io/agent-k8s-spinplug-releases/master/repositories.json
 plugins:
 Armory.Kubesvc:
 enabled: true
 version: 0.11.32
 extensions:
 armory.kubesvc:
 enabled: true
kubesvc:
 cluster: kubernetes
kubernetes:
 enabled: true
# enable Clouddriver Account Management https://spinnaker.io/docs/setup/other_config/accounts/
account:
 storage:
 enabled: true

This code snippet does not enable Clouddriver Account Management, which is not supported in Spinnaker versions 1.27.x and earlier.

spinnaker:
 extensibility:
 repositories:
 armory-agent-k8s-spinplug-releases:
 enabled: true
 url: https://raw.githubusercontent.com/armory-io/agent-k8s-spinplug-releases/master/repositories.json
 plugins:
 Armory.Kubesvc:
 enabled: true
 version: 0.14.1 # check compatibility matrix for your Spinnaker version
 extensions:
 armory.kubesvc:
 enabled: true
kubesvc:
 cluster: kubernetes
kubernetes:
 enabled: true

Save your file and apply your changes by running hal deploy apply. Kubernetes terminates the existing Clouddriver pod and creates a new one. You can validate plugin installation by executing kubectl -n spinnaker logs deployments/spin-clouddriver | grep "Plugin". Output is similar to:

org.pf4j.AbstractPluginManager : Plugin 'Armory.Kubesvc@0.11.32' resolved
org.pf4j.AbstractPluginManager : Start plugin 'Armory.Kubesvc@0.11.32'
io.armory.kubesvc.KubesvcPlugin : Starting Kubesvc plugin...

Expose Clouddriver as a LoadBalancer

To expose Clouddriver as a Kubernetes-type LoadBalancer, kubectl apply the following manifest:

apiVersion: v1
kind: Service
metadata:
 namespace: spinnaker
 labels:
 app: spin
 cluster: spin-clouddriver
 name: spin-clouddriver-grpc
spec:
 ports:
 - name: grpc
 port: 9091
 protocol: TCP
 targetPort: 9091
 selector:
 app: spin
 cluster: spin-clouddriver

Various cloud providers may require additional annotations for LoadBalancer. Consult your cloud provider’s documentation.

Apply the manifest using kubectl.

Get the LoadBalancer IP address

Use kubectl get svc spin-clouddriver-grpc -n spinnaker to make note of the LoadBalancer IP external address. You need this address when you configure the Scale Agent service.

Confirm Clouddriver is listening

Use netcat to confirm Clouddriver is listening on port 9091 by executing nc -zv [LB address] 9091. Perform this check from a node in your Spinnaker cluster and one in your target cluster.

Options for migrating accounts

In Spinnaker, you can configure Kubernetes accounts in multiple places:

Clouddriver configuration files: clouddriver.yml, clouddriver-local.yml, spinnaker.yml, spinnaker-local.yml
Clouddriver database: clouddriver.accounts table
Spring Cloud Config Server reading accounts from Git, Vault, or another supported backend
Plugins

You have the following options for migrating accounts:

You can configure the Scale Agent service to manage specific accounts by adding those accounts to a ConfigMap. This approach means you should remove the accounts from the Clouddriver credential source before you deploy the service.
You can dynamically migrate accounts after the service has been deployed. This requires kubectl access to the cluster so you can port-forward the endpoint to your local machine.

This guide shows you how to statically add an account to the Scale Agent service configuration before deployment.

Deploy the service using manifests

The Scale Agent service can run with most features on the default ServiceAccount. However, if you want the Scale Agent service to load balance connections or assign a precise Zone ID, the Scale Agent service needs permissions to get Pods, Deployments, ReplicaSets, and Namespaces in your cluster. Rather than modifying the default ServiceAccount permissions, Armory recommends creating a new ServiceAccount, ClusterRole, and ClusterRoleBinding for the Scale Agent.

Configure permissions

The following manifest creates a ServiceAccount, ClusterRole, and ClusterRoleBinding. Apply the manifest in your spinnaker namespace.

# Create agent cluster role
apiVersion: rbac.authorizati
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
 name: scale-agent-cluster-role
rules:
 - apiGroups:
 - ""
 resources:
 - configmaps
 - endpoints
 - events
 - ingresses
 - ingresses/status
 - jobs
 - jobs/status
 - namespaces
 - namespaces/finalize
 - namespaces/status
 - pods
 - pods/log
 - pods/status
 - secrets
 - services
 - services/status
 - services/finalizers
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
 - apiGroups:
 - batch
 resources:
 - jobs
 - jobs/status
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
 - apiGroups:
 - apps
 - extensions
 resources:
 - daemonsets
 - daemonsets/status
 - deployments
 - deployments/finalizers
 - deployments/scale
 - deployments/status
 - replicasets
 - replicasets/finalizers
 - replicasets/scale
 - replicasets/status
 - statefulsets
 - statefulsets/finalizers
 - statefulsets/scale
 - statefulsets/status
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
 - apiGroups:
 - monitoring.coreos.com
 resources:
 - servicemonitors
 verbs:
 - get
 - create
 - apiGroups:
 - spinnaker.armory.io
 resources:
 - "*"
 - spinnakerservices
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - apiGroups:
 - apiextensions.k8s.io
 resources:
 - customresourcedefinitions
 verbs:
 - "*"
 - apiGroups:
 - admissionregistration.k8s.io
 resources:
 - validatingwebhookconfigurations
 verbs:
 - "*"
 - apiGroups:
 - argoproj.io
 resources:
 - "*"
 verbs:
 - "*"
---
# Create agent service account
apiVersion: v1
kind: ServiceAccount
metadata:
 namespace: spinnaker
 name: scale-agent-sa
---
# Bind agent cluster role and service account
kind: ClusterRoleBinding
apiVersion: rbac.authorization.k8s.io/v1
metadata:
 name: scale-agent-cluster-role-binding
subjects:
 - kind: ServiceAccount
 name: scale-agent-sa
 namespace: spinnaker
roleRef:
 apiGroup: rbac.authorization.k8s.io
 kind: ClusterRole
 name: scale-agent-cluster-role

Configure the service

Configure the Armory Scale Agent service using a ConfigMap. In the data section, configure the LoadBalancer and and the Kubernetes account you want the Scale Agent to manage.

Define armory-agent.yml in the data section:

apiVersion: v1
kind: ConfigMap
metadata:
 name: armory-agent-config
 namespace: spinnaker
data:
 armory-agent.yml: |

Clouddriver plugin LoadBalancer

Replace with the IP address you obtained in the Get the LoadBalancer IP address section.

apiVersion: v1
kind: ConfigMap
metadata:
 name: armory-agent-config
 namespace: spinnaker
data:
 armory-agent.yaml: |
 clouddriver:
 grpc: <LoadBalancer-exposed-address>:9091
 insecure: true

Kubernetes account

Add your Kubernetes account configuration. This account should not exist in Clouddriver.

apiVersion: v1
kind: ConfigMap
metadata:
 name: armory-agent-config
 namespace: spinnaker
data:
 armory-agent.yaml: |
 clouddriver:
 grpc: <LoadBalancer-exposed-address>:9091
 insecure: true
 kubernetes:
 accounts:
 - name:
 kubeconfigFile:
 insecure:
 context:
 oAuthScopes:
 serviceAccount: true
 serviceAccountName: spin-sa
 namespaces: []
 omitNamespaces: []
 onlyNamespacedResources:
 kinds: []
 omitKinds: []
 customResourceDefinitions: [{kind:}]
 metrics:
 permissions: []
 maxResumableResourceAgeMs:
 onlySpinnakerManaged:
 noProxy:

See the Agent options for field explanations.

Apply the manifest in your spinnaker namespace.

Deploy the Armory Scale Agent service

Apply the following manifest in your spinnaker namespace:

apiVersion: apps/v1
kind: Deployment
metadata:
 namespace: spinnaker
 labels:
 app: spin
 app.kubernetes.io/name: armory-agent
 app.kubernetes.io/part-of: spinnaker
 cluster: spin-armory-agent
 name: spin-armory-agent
spec:
 replicas: 1
 selector:
 matchLabels:
 app: spin
 cluster: spin-armory-agent
 template:
 metadata:
 labels:
 app: spin
 app.kubernetes.io/name: armory-agent
 app.kubernetes.io/part-of: spinnaker
 cluster: spin-armory-agent
 spec:
 serviceAccount: scale-agent-sa
 containers:
 - image: armory/agent-k8s:<version> # must be compatible with your Armory CD version
 imagePullPolicy: IfNotPresent
 name: armory-agent
 ports:
 - name: health
 containerPort: 8082
 protocol: TCP
 - name: metrics
 containerPort: 8008
 protocol: TCP
 readinessProbe:
 httpGet:
 port: health
 path: /health
 failureThreshold: 3
 periodSeconds: 10
 successThreshold: 1
 timeoutSeconds: 1
 terminationMessagePath: /dev/termination-log
 terminationMessagePolicy: File
 volumeMounts:
 - mountPath: /opt/armory/config
 name: volume-armory-agent-config
 # - mountPath: /kubeconfigfiles
 # name: volume-armory-agent-kubeconfigs
 restartPolicy: Always
 volumes:
 - name: volume-armory-agent-config
 configMap:
 name: armory-agent-config
 # - name: volume-armory-agent-kubeconfigs
 # secret:
 # defaultMode: 420
 # secretName: kubeconfigs-secret

Verify that the plugin and service are communicating

You can access the Clouddriver log to verify that the plugin is running and communicating with the service.

kubectl -n spinnaker logs deployment/spin-clouddriver | grep -E "Start plugin|Starting Kubesvc plugin|Registering agent with"

Confirm success

Create a pipeline with a Deploy manifest stage. You should see your target cluster available in the Accounts list. Deploy a static manifest.

Uninstall the plugin

Remove the Scale Agent plugin config from clouddriver-local.yml and hal deploy apply the changes.

Uninstall the service

You can use kubectl to delete all Scale Agent service’s Deployment objects and their accompanying ConfigMap and Secret.

What’s next

Dynamic Accounts Architecture and Features
Migrate Clouddriver Kubernetes Accounts to the Armory Scale Agent
Troubleshoot the Armory Scale Agent Service and Plugin page if you run into issues.

Plugins: Install Pipelines-as-Code in Spinnaker (Halyard)

Mon, 01 Jan 0001 00:00:00 +0000

Installation overview

Installing Pipelines-as-Code consists of these steps:

Configure Kubernetes permissions.
Configure the Pipelines-as-Code service.
Deploy the Pipelines-as-Code service in the same Kubernetes cluster as Spinnaker.
Install the plugin into Spinnaker.

Compatibility

Spinnaker Version	Pipelines-as-Code Service Version	Pipelines-as-Code Plugin Version
1.30.x	2.30	0.0.5
1.28.x	2.28	0.0.5
1.27.x	2.27	0.0.5
1.26.x	2.26	0.0.5

Before you begin

You are running open source Spinnaker.
You manage your instance using Halyard. If you are using the Spinnaker Operator, see Install Pipelines-as-Code in Spinnaker (Spinnaker Operator)
You have permissions to create ServiceAccount, ClusterRole, and ClusterRoleBinding objects in your cluster.

Warning

The examples in this guide are for a vanilla Spinnaker installation. You may need to adjust them for your environment.

Configure Kubernetes permissions

The following manifest creates a ServiceAccount, ClusterRole, and ClusterRoleBinding. Apply the manifest in your spinnaker namespace.

apiVersion: v1
kind: ServiceAccount
metadata:
 name: dinghy-sa
 namespace: spinnaker
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
 name: dinghy-cluster-role
rules:
- apiGroups:
 - extensions
 resources:
 - ingresses
 - ingresses/status
 verbs:
 - get
 - list
 - watch
 - create
 - update
 - patch
 - delete
- apiGroups:
 - networking.k8s.io
 resources:
 - ingresses
 - ingresses/status
 verbs:
 - get
 - list
 - watch
 - create
 - update
 - patch
 - delete
- apiGroups:
 - ""
 resources:
 - pods
 - endpoints
 verbs:
 - get
 - list
 - watch
 - create
 - update
 - patch
 - delete
- apiGroups:
 - ""
 resources:
 - services
 - services/finalizers
 - events
 - configmaps
 - secrets
 - namespaces
 - jobs
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
- apiGroups:
 - batch
 resources:
 - jobs
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
- apiGroups:
 - apps
 - extensions
 resources:
 - deployments
 - deployments/finalizers
 - deployments/scale
 - daemonsets
 - replicasets
 - statefulsets
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
- apiGroups:
 - monitoring.coreos.com
 resources:
 - servicemonitors
 verbs:
 - get
 - create
- apiGroups:
 - spinnaker.armory.io
 resources:
 - '*'
 - spinnakerservices
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
- apiGroups:
 - admissionregistration.k8s.io
 resources:
 - validatingwebhookconfigurations
 verbs:
 - '*'
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
 name: dinghy-cluster-role-binding
roleRef:
 apiGroup: rbac.authorization.k8s.io
 kind: ClusterRole
 name: dinghy-cluster-role
subjects:
- kind: ServiceAccount
 name: dinghy-sa
 namespace: spinnaker

Configure the service

Create a ConfigMap to contain your Dinghy service configuration. Be sure to check the spinnaker.yml entry in the data section to ensure the values match your Spinnaker installation.

apiVersion: v1
kind: ConfigMap
metadata:
 name: spin-dinghy-config
 namespace: spinnaker
data:
 dinghy.yml: |
 autoLockPipelines: false
 dinghyFilename: dinghyfile
 dinghyIgnoreRegexp2Enabled: false
 echo:
 baseURL: ${services.echo.baseUrl}
 enabled: true
 fiat:
 baseUrl: ${services.fiat.baseUrl}
 enabled: ${services.fiat.enabled}
 front50:
 baseUrl: ${services.front50.baseUrl}
 enabled: ${services.front50.enabled}
 orca:
 baseUrl: ${services.orca.baseUrl}
 enabled: ${services.orca.enabled}
 redis:
 baseUrl: ${services.redis.baseUrl}
 repositoryRawdataProcessing: false
 spectator:
 applicationName: ${spring.application.name}
 webEndpoint:
 enabled: false
 spinnaker:
 extensibility:
 plugins: {}
 plugins-root-path: /opt/dinghy/plugins
 repositories: {}
 strict-plugin-loading: false
 githubEndpoint: https://api.github.com
 githubToken: CHANGEME
 templateOrg: CHANGEME
 templateRepo: CHANGEME
 spinnaker.yml: |
 global.spinnaker.timezone: America/Los_Angeles
 services:
 clouddriver:
 baseUrl: http://spin-clouddriver:7002
 enabled: true
 host: 0.0.0.0
 port: 7002
 clouddriverCaching:
 baseUrl: http://spin-clouddriver-caching:7002
 enabled: false
 host: 0.0.0.0
 port: 7002
 clouddriverRo:
 baseUrl: http://spin-clouddriver-ro:7002
 enabled: false
 host: 0.0.0.0
 port: 7002
 clouddriverRoDeck:
 baseUrl: http://spin-clouddriver-ro-deck:7002
 enabled: false
 host: 0.0.0.0
 port: 7002
 clouddriverRw:
 baseUrl: http://spin-clouddriver-rw:7002
 enabled: false
 host: 0.0.0.0
 port: 7002
 deck:
 baseUrl: http://localhost:9000
 enabled: true
 host: 0.0.0.0
 port: 9000
 dinghy:
 baseUrl: http://spin-dinghy:8081
 enabled: true
 host: 0.0.0.0
 port: 8081
 echo:
 baseUrl: http://spin-echo:8089
 enabled: true
 host: 0.0.0.0
 port: 8089
 echoScheduler:
 baseUrl: http://spin-echo-scheduler:8089
 enabled: false
 host: 0.0.0.0
 port: 8089
 echoWorker:
 baseUrl: http://spin-echo-worker:8089
 enabled: false
 host: 0.0.0.0
 port: 8089
 fiat:
 baseUrl: http://spin-fiat:7003
 enabled: false
 host: 0.0.0.0
 port: 7003
 front50:
 baseUrl: http://spin-front50:8080
 enabled: true
 host: 0.0.0.0
 port: 8080
 gate:
 baseUrl: http://localhost:8084
 enabled: true
 host: 0.0.0.0
 port: 8084
 igor:
 baseUrl: http://spin-igor:8088
 enabled: false
 host: 0.0.0.0
 port: 8088
 kayenta:
 baseUrl: http://spin-kayenta:8090
 enabled: false
 host: 0.0.0.0
 port: 8090
 monitoringDaemon:
 baseUrl: http://spin-monitoring-daemon:8008
 enabled: false
 host: 0.0.0.0
 port: 8008
 orca:
 baseUrl: http://spin-orca:8083
 enabled: true
 host: 0.0.0.0
 port: 8083
 redis:
 baseUrl: redis://spin-redis:6379
 enabled: true
 host: 0.0.0.0
 port: 6379
 rosco:
 baseUrl: http://spin-rosco:8087
 enabled: true
 host: 0.0.0.0
 port: 8087
 terraformer:
 baseUrl: http://spin-terraformer:7088
 enabled: false
 host: 0.0.0.0
 port: 7088

Configure your repo

Before configuring your repos, ensure you have the following:

A personal access token that has read access to the repo where you store your dinghyfile and the repo where you store module files. You should create a Kubernetes Secret for your personal access token so you don’t store the token in plain text in your config file.
The organization where the app repos and templates reside; for example, if your repo is armory-io/dinghy-templates, your template-org is armory-io.
The name of the repo containing your modules; for example, if your repo is armory-io/dinghy-templates, your template-repo is dinghy-templates.

Add the following to your dinghy.yml config:

templateOrg: <repo-org>
templateRepo: <dinghy-templates-repo>
githubToken: <abc>
githubEndpoint: <https://api.github.com>

All fields are required.

templateOrg: VCS organization or namespace where application and template repositories are located
templateRepo: VCS repository where module templates are located
githubToken: GitHub token; This field supports “encrypted” field references; see Secrets for details.
githubEndpoint: (Default: https://api.github.com) GitHub API endpoint. Useful if you’re using GitHub Enterprise.

GitHub webhooks

Set up webhooks at the organization level for push events. You can do this by going to https://github.com/organizations/<your_org_here>/settings/hooks.

Set content-type to application/json.
Set the Payload URL to your Gate URL. Depending on whether you configured Gate to use its own DNS name or a path on the same DNS name as Deck, the URL follows one of the following formats:
- https://<your-gate-url>/webhooks/git/github if you have a separate DNS name or port for Gate
- https://<your-spinnaker-url>/api/v1/webhooks/git/github if you’re using a different path for Gate

Pull request validations

Make PR validations mandatory to ensure users only merge working dinghyfiles.

Perform the following steps to configure mandatory PR validation:

Go to your GitHub repository.
Click on Settings > Branches.
In Branch protection rules, select Add rule.
Add master in Branch name pattern so that the rule gets enforced on the master branch. Note that if this is a new repository with no commits, the “dinghy” option does not appear. You must first create a dinghyfile in any branch.
Select Require status checks to pass before merging and make dinghy required. Select Include administrators as well so that all PRs get validated, regardless of user.

The following screenshot shows what your GitHub settings should resemble:

Add the following to your dinghy.yml config:

templateOrg: <repo-org>
templateRepo: <dinghy-templates-repo>
stashUsername: <stash_user>
stashToken: <abc>
stashEndpoint: <https://my-endpoint>

All fields are required.

templateRepo: VCS repository where module templates are located
stashUsername: Stash username
stashToken: Stash token. This field supports “encrypted” field references; see Secrets for details.
stashEndpoint: Stash API endpoint. If you’re using Bitbucket Server, update the endpoint to include the api e.g. https://your-endpoint-here.com/rest/api/1.0

If you’re using Bitbucket Server, update the endpoint to include the api, e.g. --stash-endpoint https://your-endpoint-here.com/rest/api/1.0

Add the following to your dinghy.yml config:

templateOrg: <repo-org>
templateRepo: <dinghy-templates-repo>
gitlabToken: <abc>
gitlabEndpoint: <https://my-endpoint>

All fields are required.

templateOrg: VCS organization or namespace where application and template repositories are located
templateRepo: VCS repository where module templates are located
gitlabToken: GitLab token. This field supports “encrypted” field references; see Secrets for details.
gitlabEndpoint: GitLab endpoint

Deploy the service

Replace <version> with the Pipelines-as-Code service version compatible with your Spinnaker version.

apiVersion: v1
kind: Service
metadata:
 name: spin-dinghy
 labels:
 app: spin
 cluster: spin-dinghy
spec:
 selector:
 app: spin
 cluster: spin-dinghy
 type: ClusterIP
 ports:
 - protocol: TCP
 port: 8081
 targetPort: 8081
---
apiVersion: apps/v1
kind: Deployment
metadata:
 name: spin-dinghy
 annotations:
 moniker.spinnaker.io/application: '"spin"'
 moniker.spinnaker.io/cluster: '"dinghy"'
 labels:
 app: spin
 cluster: spin-dinghy
 app.kubernetes.io/name: dinghy
 app.kubernetes.io/managed-by: armory
 app.kubernetes.io/part-of: spinnaker
 app.kubernetes.io/version: <version>
spec:
 replicas: 1
 selector:
 matchLabels:
 app: spin
 cluster: spin-dinghy
 template:
 metadata:
 annotations: null
 labels:
 app: spin
 cluster: spin-dinghy
 app.kubernetes.io/name: dinghy
 app.kubernetes.io/managed-by: armory
 app.kubernetes.io/part-of: spinnaker
 app.kubernetes.io/version: <version>
 spec:
 containers:
 - name: dinghy
 image: docker.io/armory/dinghy
 ports:
 - containerPort: 8081
 startupProbe:
 httpGet:
 path: /health
 port: 8081
 failureThreshold: 3
 periodSeconds: 10
 successThreshold: 1
 timeoutSeconds: 1
 readinessProbe:
 exec:
 command:
 - wget
 - --no-check-certificate
 - --spider
 - -q
 - http://localhost:8081/health
 failureThreshold: 3
 initialDelaySeconds: 90
 periodSeconds: 10
 successThreshold: 1
 timeoutSeconds: 1
 volumeMounts:
 - name: spin-dinghy-config-file
 mountPath: /opt/spinnaker/config
 volumes:
 - name: spin-dinghy-config-file
 secret:
 secretName: spin-dinghy-config-file

Apply the ConfigMap and Deployment manifests in your spinnaker namespace.

Install the plugin

A note about installing plugins in Spinnaker

The Pipelines-as-Code plugin extends Gate and Echo. To avoid every Spinnaker service restarting and downloading the plugin, do not add the plugin using Halyard. Instead, follow the Local Config installation method, in which you configure the plugin in each extended service’s local profile.

The Pipelines-as-Code plugin extends Gate and Echo. You should create or update the extended service’s local profile in the same directory as the other Halyard configuration files. This is usually ~/.hal/default/profiles on the machine where Halyard is running.

Replace <version> with the plugin version that’s compatible with your Spinnaker instance.

Add the following to gate-local.yml:

spinnaker:
 extensibility:
 plugins:
 Armory.PipelinesAsCode:
 enabled: true
 version: <version>
 repositories:
 pipelinesAsCode:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json

Add the following to echo-local.yml:

armorywebhooks:
 enabled; true
 forwarding:
 baseUrl: http://spin-dinghy:8081
 endpoint: v1/webhooks
spinnaker:
 extensibility:
 plugins:
 Armory.PipelinesAsCode:
 enabled: true
 version: <version>
 repositories:
 pipelinesAsCode:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json

armorywebhooks config tells the service where to forward events it receives from the repo.

Save your files and apply your changes by running hal deploy apply.

What’s next

Configure Pipelines-as-Code Optional Features

Plugins: Install Terraform Integration in Spinnaker (Halyard)

Mon, 01 Jan 0001 00:00:00 +0000

Overview of installing Terraform Integration

Installing the Terraform Integration plugin consists of these steps:

Configure Spinnaker: Redis, gitrepo artifact, and optional repos
Install the service: Kubernetes manifests
Install the plugin: Local config files

Compatibility

Spinnaker Version	Terraform Integration Service Version	Terraform Integration Plugin Version
1.30.x	2.30	0.0.2
1.29.x	2.28	0.0.1
1.28.x	2.28	0.0.1

Before you begin

You have read the Terraform Integration Overview.

Spinnaker requirements

You are running open source Spinnaker.
You manage your instance using Halyard. If you are using the Spinnaker Operator, see Install Terraform Integration in Spinnaker (Spinnaker Operator)

Warning

The examples in this guide are for a vanilla Spinnaker installation. You may need to adjust them for your environment.

Terraform Integration requirements

Basic auth credentials for the Git repository where your store your Terraform scripts. The Terraform Integration plugin needs access to credentials to download directories that house your Terraform templates.
- You can configure your Git repo with any of the following:
  - A Personal Access Token (potentially associated with a service account).
  - SSH protocol in the form of an SSH key or an SSH key file
  - Basic auth in the form of a user and password, or a user-password file
A source for Terraform Input Variable files (tfvar) or a backend config. You must have a separate artifact provider that can pull your tfvar file(s). The Terraform Integration plugin supports the following artifact providers for tfvar files and backend configs:
- GitHub
- BitBucket
- HTTP artifact
A dedicated external Redis instance
- Armory requires configuring a dedicated external Redis instance for production usage of the Terraform Integration plugin. This is to ensure that you do not encounter scaling or stability issues in production.

Configure Spinnaker

Configure Redis

Terraform Integration uses Redis to store Terraform logs and plans.

You can only configure the Terraform Integration feature to use a password with the default Redis user.

Configure Redis settings in your configuration and then apply.

spec:
 spinnakerConfig:
 profiles:
 terraformer:
 redis:
 baseUrl: "redis://spin-redis:6379"
 password: "password"

Configure your artifact account

The Terraform Integration uses the following artifact accounts:

Git Repo - To fetch the repo housing your main Terraform files.
GitHub, BitBucket or HTTP - Optional. To fetch single files such as var-files or backend config files.

Configure the Git Repo artifact

Spinnaker uses the Git Repo Artifact Provider to download the repo containing your main Terraform templates.

Edit your configuration to add the following:

spec:
 spinnakerConfig:
 profiles:
 clouddriver:
 artifacts:
 gitRepo:
 enabled: true
 accounts:
 - name: gitrepo
 token: <your-personal-access-token> # personal access token

For more configuration options, see Configure a Git Repo Artifact Account.

Configure additional repos

This step is optional.

These optional steps describe how to configure GitHub as an artifact provider for the Terraform Integration.

Spinnaker uses the Github Artifact Provider to download any referenced tfvar files.

Configure your GitHub artifact:

spec:
 spinnakerConfig:
 config:
 artifacts:
 github:
 accounts:
 - name: <github-for-terraform>
 token: <your-github-personal-access-token>
 enabled: true

name: the name for this account; replace github-for-terraform with a unique identifier for the artifact account.
token: GitHub personal access token; this field supports “encrypted” field references.

Spinnaker uses the BitBucket Artifact Provider to download any referenced tfvar files, so it must be configured with the BitBucket token to pull these files.

spec:
 spinnakerConfig:
 config:
 artifacts:
 bitbucket:
 enabled: true
 accounts:
 - name: <bitbucket-for-terraform>
 username: <your-bitbucket-username>
 password: <your-bitbucket-password>

name: the name for this account; replace <bitbucket-for-terraform> with a unique identifier for the artifact account.
username: Your Bitbucket username.
password: Your Bitbucket password; this field supports “encrypted” field references.

Install the service

Configure Kubernetes permissions

The following manifest creates a ServiceAccount, ClusterRole, and ClusterRoleBinding. Apply the manifest in your spinnaker namespace.

apiVersion: v1
kind: ServiceAccount
metadata:
 name: terraformer-sa
 namespace: spinnaker
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
 name: terraformer-cluster-role
rules:
- apiGroups:
 - extensions
 resources:
 - ingresses
 - ingresses/status
 verbs:
 - get
 - list
 - watch
 - create
 - update
 - patch
 - delete
- apiGroups:
 - networking.k8s.io
 resources:
 - ingresses
 - ingresses/status
 verbs:
 - get
 - list
 - watch
 - create
 - update
 - patch
 - delete
- apiGroups:
 - ""
 resources:
 - pods
 - endpoints
 verbs:
 - get
 - list
 - watch
 - create
 - update
 - patch
 - delete
- apiGroups:
 - ""
 resources:
 - services
 - services/finalizers
 - events
 - configmaps
 - secrets
 - namespaces
 - jobs
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
- apiGroups:
 - batch
 resources:
 - jobs
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
- apiGroups:
 - apps
 - extensions
 resources:
 - deployments
 - deployments/finalizers
 - deployments/scale
 - daemonsets
 - replicasets
 - statefulsets
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
 - delete
- apiGroups:
 - monitoring.coreos.com
 resources:
 - servicemonitors
 verbs:
 - get
 - create
- apiGroups:
 - spinnaker.armory.io
 resources:
 - '*'
 - spinnakerservices
 verbs:
 - create
 - get
 - list
 - update
 - watch
 - patch
- apiGroups:
 - admissionregistration.k8s.io
 resources:
 - validatingwebhookconfigurations
 verbs:
 - '*'
---
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRoleBinding
metadata:
 name: terraformer-cluster-role-binding
roleRef:
 apiGroup: rbac.authorization.k8s.io
 kind: ClusterRole
 name: terraformer-cluster-role
subjects:
- kind: ServiceAccount
 name: terraformer-sa
 namespace: spinnaker

Configure the service

Create a ConfigMap to contain your Terraformer Integration service configuration. Be sure to check the spinnaker.yml entry in the data section to ensure the values match your Spinnaker installation.

apiVersion: v1
kind: ConfigMap
metadata:
 name: spin-terraformer-config
 namespace: spinnaker
data:
 terraformer.yml: |
 clouddriver:
 baseUrl: ${services.clouddriver.baseUrl}
 enabled: true
 executor:
 scrapeLogsIntervalSecs: 5
 workers: 3
 git:
 enabled: false
 redis:
 baseUrl: ${services.redis.baseUrl}
 enabled: ${services.redis.enabled}
 server:
 host: ${services.terraformer.host}
 port: ${services.terraformer.port}
 spectator:
 applicationName: ${spring.application.name}
 webEndpoint:
 enabled: false
 spinnaker:
 extensibility:
 plugins: {}
 plugins-root-path: /opt/terraformer/plugins
 repositories: {}
 strict-plugin-loading: false
 spinnaker.yml: |
 global.spinnaker.timezone: America/Los_Angeles
 services:
 clouddriver:
 baseUrl: http://spin-clouddriver:7002
 enabled: true
 host: 0.0.0.0
 port: 7002
 clouddriverCaching:
 baseUrl: http://spin-clouddriver-caching:7002
 enabled: false
 host: 0.0.0.0
 port: 7002
 clouddriverRo:
 baseUrl: http://spin-clouddriver-ro:7002
 enabled: false
 host: 0.0.0.0
 port: 7002
 clouddriverRoDeck:
 baseUrl: http://spin-clouddriver-ro-deck:7002
 enabled: false
 host: 0.0.0.0
 port: 7002
 clouddriverRw:
 baseUrl: http://spin-clouddriver-rw:7002
 enabled: false
 host: 0.0.0.0
 port: 7002
 deck:
 baseUrl: http://localhost:9000
 enabled: true
 host: 0.0.0.0
 port: 9000
 dinghy:
 baseUrl: http://spin-dinghy:8081
 enabled: true
 host: 0.0.0.0
 port: 8081
 echo:
 baseUrl: http://spin-echo:8089
 enabled: true
 host: 0.0.0.0
 port: 8089
 echoScheduler:
 baseUrl: http://spin-echo-scheduler:8089
 enabled: false
 host: 0.0.0.0
 port: 8089
 echoWorker:
 baseUrl: http://spin-echo-worker:8089
 enabled: false
 host: 0.0.0.0
 port: 8089
 fiat:
 baseUrl: http://spin-fiat:7003
 enabled: false
 host: 0.0.0.0
 port: 7003
 front50:
 baseUrl: http://spin-front50:8080
 enabled: true
 host: 0.0.0.0
 port: 8080
 gate:
 baseUrl: http://localhost:8084
 enabled: true
 host: 0.0.0.0
 port: 8084
 igor:
 baseUrl: http://spin-igor:8088
 enabled: false
 host: 0.0.0.0
 port: 8088
 kayenta:
 baseUrl: http://spin-kayenta:8090
 enabled: false
 host: 0.0.0.0
 port: 8090
 monitoringDaemon:
 baseUrl: http://spin-monitoring-daemon:8008
 enabled: false
 host: 0.0.0.0
 port: 8008
 orca:
 baseUrl: http://spin-orca:8083
 enabled: true
 host: 0.0.0.0
 port: 8083
 redis:
 baseUrl: redis://spin-redis:6379
 enabled: true
 host: 0.0.0.0
 port: 6379
 rosco:
 baseUrl: http://spin-rosco:8087
 enabled: true
 host: 0.0.0.0
 port: 8087
 terraformer:
 baseUrl: http://spin-terraformer:7088
 enabled: false
 host: 0.0.0.0
 port: 7088

Deploy the service

Replace <version> with the Terraform Integration service version compatible with your Spinnaker version.

apiVersion: v1
kind: Service
metadata:
 name: spin-terraformer
 labels:
 app: spin
 cluster: spin-terraformer
spec:
 selector:
 app: spin
 cluster: spin-terraformer
 ports:
 - name: http
 port: 7088
 protocol: TCP
 targetPort: 7088
---
apiVersion: apps/v1
kind: Deployment
metadata:
 name: spin-terraformer
 annotations:
 deployment.kubernetes.io/revision: "1"
 moniker.spinnaker.io/application: '"spin"'
 moniker.spinnaker.io/cluster: '"terraformer"'
 labels:
 app: spin
 app.kubernetes.io/managed-by: armory
 app.kubernetes.io/name: terraformer
 app.kubernetes.io/part-of: spinnaker
 app.kubernetes.io/version: <version> # CHANGE
 cluster: spin-terraformer
spec:
 progressDeadlineSeconds: 600
 replicas: 1
 revisionHistoryLimit: 10
 selector:
 matchLabels:
 app: spin
 cluster: spin-terraformer
 strategy:
 rollingUpdate:
 maxSurge: 25%
 maxUnavailable: 25%
 type: RollingUpdate
 template:
 metadata:
 labels:
 app: spin
 app.kubernetes.io/managed-by: armory
 app.kubernetes.io/name: terraformer
 app.kubernetes.io/part-of: spinnaker
 app.kubernetes.io/version: <version> # CHANGE
 cluster: spin-terraformer
 spec:
 affinity: {}
 containers:
 - env:
 - name: SPRING_PROFILES_ACTIVE
 value: local
 image: docker.io/armory/terraformer
 imagePullPolicy: IfNotPresent
 lifecycle: {}
 name: terraformer
 ports:
 - containerPort: 7088
 protocol: TCP
 readinessProbe:
 exec:
 command:
 - wget
 - --no-check-certificate
 - --spider
 - -q
 - http://localhost:7088/health
 failureThreshold: 3
 periodSeconds: 10
 successThreshold: 1
 timeoutSeconds: 1
 resources: {}
 terminationMessagePath: /dev/termination-log
 terminationMessagePolicy: File
 volumeMounts:
 - mountPath: /opt/spinnaker/config
 name: spin-terraformer-config-file
 dnsPolicy: ClusterFirst
 restartPolicy: Always
 schedulerName: default-scheduler
 securityContext:
 fsGroup: 1000
 runAsUser: 1000
 terminationGracePeriodSeconds: 60
 volumes:
 - name: spin-terraformer-config-file
 secret:
 secretName: spin-terraformer-config-file

Apply the ConfigMap and Deployment manifests in your spinnaker namespace.

Install the plugin

A note about installing plugins in Spinnaker

The Terraform plugin extends Deck, Gate, and Orca. To avoid every Spinnaker service restarting and downloading the plugin, do not add the plugin using Halyard. Instead, follow the local config installation method, in which you configure the plugin in each extended service’s local profile.

Replace <version> with the plugin version [that’s compatible with your Spinnaker instance].

Add the following to gate-local.yml:

proxies:
 - id: terraform
 uri: http://spin-terraformer:7088
 methods:
 - GET
services:
 terraformer:
 enabled: true
 baseUrl: http://spin-terraformer:7088
spinnaker:
 extensibility:
 plugins:
 Armory.Terraformer:
 enabled: true
 version: <version>
 repositories:
 terraformer:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json
 deck-proxy:
 enabled: true
 plugins:
 Armory.Terraformer:
 enabled: true
 version: <version>

Add the following to orca-local.yml:

services:
 terraformer:
 enabled: true
 baseUrl: http://spin-terraformer:7088
spinnaker:
 extensibility:
 plugins:
 Armory.Terraformer:
 enabled: true
 version: <version>
 repositories:
 terraformer:
 enabled: true
 url: https://raw.githubusercontent.com/armory-plugins/pluginRepository/master/repositories.json

Save your files and apply your changes by running hal deploy apply.

What’s next

Plugins: Architecture of Pipelines-as-Code for Spinnaker and Armory Continuous Deployment

Mon, 01 Jan 0001 00:00:00 +0000

Components

The Pipelines-as-Code feature has the following components:

Dinghy Service:
- Keeps your repo pipeline definitions in sync with the corresponding pipelines in Spinnaker
- Communicates with repos over SSL or TLS
Spinnaker Plugin: extends Gate and Echo by adding endpoints that the Dinghy service uses

Database

Dinghy works out-of-the-box with in-cluster Redis. You can configure Pipelines-as-Code to use an external Redis or a MySQL database.

How Pipelines-as-Code works

sequenceDiagram
actor User
participant Repo
participant Dinghy Service
participant Spinnaker Plugin
User->>Repo: update pipeline template
Repo->>Dinghy Service: send notification
Dinghy Service->>Repo: fetch updated .dinghyfile
Dinghy Service->>Spinnaker Plugin: update pipeline

Your repo sends webhooks when you modify either the Templates or the Module definitions.
The Pipelines-as-Code service looks for and fetches all dependent modules and parses the template. Then the service updates the pipelines in Spinnaker.
The pipelines are automatically updated whenever a module that is used by a pipeline is updated in the version control system. This is done by maintaining a dependency graph. The Pipelines-as-Code service looks for a dinghyfile in all directories, not just the root path. The only exception is when you have modules in a local setting. In this case, you must update the dinghyfile in order to pull new updates from modules it is using.
Dinghy processes changes found in a specific branch. By default, this branch is master. If you are using a repo that uses a different branch for the base branch, an administrator must configure the service to track that branch. For more information, see Custom branches.

Plugins: Armory Scale Agent Architecture

Mon, 01 Jan 0001 00:00:00 +0000

Key Components

Scale Agent plugin for Clouddriver

The Scale Agent plugin runs inside Clouddriver and manages migrated accounts and accounts created specifically for Scale Agent management. The plugin does not engage in outbound communication. Through Clouddriver, the plugin exposes an internally-accessible REST API that you can use to dynamically migrate and manage Kubernetes accounts.

Scale Agent service for Kubernetes

You Scale Agent service monitors your Kubernetes clusters and sends information to the Scale Agent plugin running inside Clouddriver.

The Agent service sends the following information about the cluster it is watching to the Clouddriver plugin:

Account properties as configured in kubernetes.accounts[].
Kubernetes API server host, certificate fingerprint, and version.
All the Kubernetes objects it is configured to watch and has permissions to access. You can ignore certain Kubernetes kinds (kubernetes.accounts[].omitKinds) or configure specific kinds to watch (kubernetes.accounts[].kinds).

The Agent service always scrubs data from Secret in memory before it is sent and even before that data makes it onto the Armory Scale Agent’s memory heap.

Kubernetes permissions for the service

The Agent service should have ClusterRole authorization if you need to deploy pods across your cluster. If you only deploy pods only to a single namespace, the service needs Role authorization.

See Kubernetes Permissions for the Armory Scale Agent for detailed information.

Communication and networking

Communication from the Scale Agent service to the Clouddriver plugin occurs over gRPC port 9091. Communication between the service and the plugin must be http/2. http/1.1 is not compatible and causes communication issues between the Armory Agent service and Clouddriver plugin.

Except for a local health check, the Agent service makes outbound calls only to the Clouddriver plugin over a single gPRC connection. The connection can be over TLS or mTLS. You can terminate TLS:

On Clouddriver: in the case of running the Armory Scale Agent in Spinnaker Service mode or if declaring spin-clouddriver-grpc as a network load balancer.
On a gRPC proxy that directs request to the spin-clouddriver-grpc service.

The Clouddriver plugin uses the bidirectional communication channel to receive changes from Kubernetes accounts as well as send operations to the Armory Scale Agent service.

See the Armory Scale Agent Communication With Clouddriver Instances in Kubernetes page for detailed information.

Security

Since the Armory Scale Agent service does outbound calls only, you can have Agent services running on-premises or in public clouds such as AWS, GCP, Azure, Oracle, or Alibaba.

What the Scale Agent service can do in the target cluster is limited by what it is running as:

a serviceAccount in Agent mode
a kubeconfig setup for infrastructure or Spinnaker service mode

Communications are secured with TLS and optionally mTLS.

What’s next

Plugins: Install the Armory Scale Agent in an Existing Armory CD Instance

Mon, 01 Jan 0001 00:00:00 +0000

Before you begin

This guide assumes you want to evaluate the Scale Agent with an existing Armory CD test instance that you deployed using the Armory Operator and Kustomize patches (spinnaker-kustomize-patches repo). With that in mind:

Your Armory CD test instance is running in the spinnaker namespace.
Your Clouddriver service uses a SQL backend. The Scale Agent plugin uses the SQL database to store cache data and dynamically created Kubernetes accounts.
You have Kubernetes accounts configured in Clouddriver so you can evaluate account migration.
You are going to deploy the Scale Agent service in the same cluster and namespace as your Armory CD test instance.
You are not going to configure mTLS, so the Scale Agent service and plugin are not going to communicate securely.

Choose the Scale Agent version that is compatible with your Armory CD version.

Armory CD (Spinnaker) Version	Scale Agent Plugin Version	Scale Agent Service Version
2.28.x (1.28.x)	0.11.56	1.0.84
1.29.x	0.12.21	1.0.84
2.30.x (1.30.x)	0.13.20	1.0.84
2.31.x (1.31.x)	0.14.1	1.0.84
2.32.x (1.32.x)	0.14.1	1.0.84
2.35.x (1.35.x)	0.16.2	1.0.84

Database compatibility:

MySQL	PostgreSQL
5.7; AWS Aurora	10+

Scale Agent Features Limitation

The following Scale Agent features require Armory CD 2.28+ and Clouddriver Account Management:

Automated scanning for newly created accounts in Clouddriver and migrating those accounts to Scale Agent management
Intercepting and processing requests sent to Clouddriver’s <GATE-URL>/credentials endpoint

If your Armory CD version is earlier than 2.28, see the Configure the plugin section for how to disable Clouddriver Account Management.

Objectives

Read about options for migrating Kubernetes accounts.
Access the latest Scale Agent installation files.
Update your local kustomization recipe.
Configure the plugin.
Configure the service
Install the Scale Agent

Options for migrating Kubernetes accounts

In Armory CD, you can configure Kubernetes accounts in multiple places:

Clouddriver configuration files: clouddriver.yml, clouddriver-local.yml, spinnaker.yml, spinnaker-local.yml
Clouddriver database: clouddriver.accounts table
Spring Cloud Config Server reading accounts from Git, Vault, or another supported backend
Plugins

You have the following options for migrating accounts to the Scale Agent:

You can configure the Scale Agent service to manage specific accounts by adding those accounts to a ConfigMap. This approach means you should remove the accounts from the Clouddriver credential source before you deploy the service.
You can dynamically migrate accounts after the service has been deployed. This requires kubectl access to the cluster so you can port-forward the endpoint to your local machine.

This guide shows you how to statically add an accounts to the Scale Agent service configuration before deployment.

Access the installation files

You can find the files that install the Scale Agent in the spinnaker-kustomize-patches/targets/kubernetes/scale-agent repo. Update your local copy from master to get the latest updates.

Update your Kustomization recipe

components section: add targets/kubernetes/scale-agent
transformers section: add utilities/unique-service-account.yml

Configure the plugin

Set the plugin version that is compatible with your Armory CD version

In plugin-config.yml, check that the version listed is compatible with your Armory CD version. If it isn’t, replace with a plugin version that is.

spec:
 spinnakerConfig:
 profiles:
 clouddriver:
 spinnaker:
 extensibility:
 repositories:
 armory-agent-k8s-spinplug-releases:
 enabled: true
 url: https://raw.githubusercontent.com/armory-io/agent-k8s-spinplug-releases/master/repositories.json
 plugins:
 Armory.Kubesvc:
 enabled: true
 version: 0.11.32 # Replace with a version compatible with your Armory CD version
 extensions:
 armory.kubesvc:
 enabled: true

(Optional) Disable Clouddriver Account Management if your Armory CD version is earlier than 2.28.

Set spec.spinnakerConfig.profiles.clouddriver.account.storage.enabled to false.
```
spec:
 spinnakerConfig:
 profiles:
 clouddriver:
 account:
 storage:
 enabled: true
```

Configure the service

Version

The Scale Agent service version is set in spinnaker-kustomize-patches/targets/kubernetes/scale-agent/scale-agent-deployment.yml. You don’t have to configure a version in the spec.template.spec.containers.image field. The manifest pulls the latest version, which is compatible with Armory CD 2.26+ and corresponding plugin versions.

Kubernetes account

You should configure a Kubernetes account for the Scale Agent service to manage. You do this in targets/kubernetes/scale-agent/armory-agent.yml. The Kubernetes account should not exist in Clouddriver.

Add your Kubernetes accounts to the kubernetes.accounts section. For example:

kubernetes:
 accounts:
 - kubeconfigFile: /kubeconfigfiles/kubeconfig
 name: agent-demo

Install the Scale Agent

Execute all commands from the root of spinnaker-kustomize-patches. The following commands assume your Kustomization recipe is named kustomization.yml and is in the root of your spinnaker-patches-kustomize directory.

(Optional) Verify the Kustomize build output.
```
kubectl kustomize kustomization.yml
```
This prints out the contents of the manifest file that Kustomize built based on your kustomization file.
Apply the manifest.
```
kubectl apply -k .
```

Verify the installation.

kubectl -n spinnaker get spinsvc && echo "" && kubectl -n spinnaker get pods

You can also access the Clouddriver log to verify that the plugin is running and communicating with the service.

kubectl -n spinnaker logs deployment/spin-clouddriver | grep -E "Start plugin|Starting Kubesvc plugin|Registering agent with"

Confirm success

Create a pipeline with a Deploy manifest stage. You should see your target cluster available in the Accounts list. Deploy a static manifest.

What’s next

Dynamic Accounts Architecture and Features
Migrate Clouddriver Kubernetes Accounts to the Armory Scale Agent
Troubleshoot the Armory Scale Agent Service and Plugin page if you run into issues.

Plugins: spinnaker.execution.stages.before.bake

Mon, 01 Jan 0001 00:00:00 +0000

More information about the bake stage can be found in Bake Amazon Machine Images in a Spinnaker Pipeline

Click to expand

{
 "input": {
 "pipeline": {
 "application": "test",
 "authentication": {
 "allowedAccounts": [
 "spinnaker",
 "staging",
 "staging-ecs"
 ],
 "user": "myUserName"
 },
 "buildTime": 1620926703486,
 "canceled": false,
 "canceledBy": null,
 "cancellationReason": null,
 "description": null,
 "endTime": 1620926705283,
 "id": "01F5KC59TRGWKCP31C4N51CDSB",
 "initialConfig": {},
 "keepWaitingPipelines": false,
 "limitConcurrent": true,
 "name": "test",
 "notifications": [],
 "origin": "api",
 "partition": null,
 "paused": null,
 "pipelineConfigId": "6a4cff2e-8265-4584-8993-2da2eb6254f5",
 "source": null,
 "spelEvaluator": "v4",
 "stages": [
 {
 "context": {
 "exception": {
 "details": {
 "error": "Internal Server Error",
 "errors": [
 "Bake failed: Error: file '/tmp/rosco-2833166343726058950/f547ea98-52eb-4b6c-8c17-173d21535456' does not appear to be a gzipped archive; got 'text/plain; charset=utf-8'\n"
 ],
 "kind": "HTTP",
 "responseBody": "{\"timestamp\":\"2021-05-13T17:25:05.658+00:00\",\"status\":500,\"error\":\"Internal Server Error\",\"message\":\"Bake failed: Error: file '/tmp/rosco-2833166343726058950/f547ea98-52eb-4b6c-8c17-173d21535456' does not appear to be a gzipped archive; got 'text/plain; charset=utf-8'\\n\"}",
 "status": 500,
 "url": "http://spin-rosco.spinnaker:8087/api/v2/manifest/bake/HELM2"
 },
 "exceptionType": "RetrofitError",
 "operation": "createBake",
 "shouldRetry": false,
 "timestamp": 1620926705665
 },
 "expectedArtifacts": [
 {
 "defaultArtifact": {
 "customKind": true,
 "id": "f9275bbf-fef7-4339-88f4-b2a18ec7b0ab"
 },
 "displayName": "pink-dog-80",
 "id": "eb9e5a6c-e9d1-489b-9f3b-4d414ba33b73",
 "matchArtifact": {
 "artifactAccount": "embedded-artifact",
 "customKind": false,
 "id": "301e50f0-2bc6-4d3e-894b-31dbf0b67bf0",
 "name": "test",
 "type": "embedded/base64"
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ],
 "inputArtifacts": [
 {
 "account": "",
 "id": "05ad020e-73a6-49f2-9988-2073831219e9"
 }
 ],
 "namespace": "testns",
 "outputName": "test",
 "overrides": {},
 "templateRenderer": "HELM2"
 },
 "endTime": null,
 "id": "01F5KC59VXSVC287E96M310EF5",
 "lastModified": null,
 "name": "Bake (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "10",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703574,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.manifests.CreateBakeManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createBake",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703700,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "bakeManifest"
 }
 ],
 "startTime": 1620926703525,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "systemNotifications": [],
 "templateVariables": null,
 "trigger": {
 "artifacts": [
 {
 "artifactAccount": "myUsername",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUsername/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 }
 ],
 "correlationId": null,
 "isDryRun": false,
 "isRebake": false,
 "isStrategy": false,
 "notifications": [],
 "other": {
 "artifacts": [
 {
 "artifactAccount": "myUsername",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUsername/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 }
 ],
 "dryRun": false,
 "enabled": false,
 "eventId": "c1090782-f485-490e-a2d7-31763b3bd4d8",
 "executionId": "01F5KC59TRGWKCP31C4N51CDSB",
 "expectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUsername",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUsername/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUsername",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUsername/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUsername",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "notifications": [],
 "parameters": {},
 "preferred": false,
 "rebake": false,
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUsername",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUsername/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUsername",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUsername/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUsername",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "strategy": false,
 "type": "manual",
 "user": "myUserName"
 },
 "parameters": {},
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUsername",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUsername/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUsername",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUsername/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUsername",
 "customKind": true,
 "location": null,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": null,
 "type": "github/file",
 "uuid": null,
 "version": null
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "type": "manual",
 "user": "myUserName"
 },
 "type": "PIPELINE"
 },
 "stage": {
 "context": {
 "amiSuffix": "20210513172504",
 "baseLabel": "release",
 "baseOs": "ubuntu",
 "cloudProviderType": "aws",
 "extendedAttributes": {},
 "name": "Bake in us-east-2",
 "package": "nginx vim",
 "rebake": true,
 "region": "us-east-2",
 "storeType": "ebs",
 "type": "bake",
 "user": "myUsername",
 "vmType": "hvm"
 },
 "endTime": null,
 "id": "01F5KC5AJECT88MA2PHYG6TT3G",
 "lastModified": null,
 "name": "Bake in us-east-2",
 "outputs": {},
 "parentStageId": "01F5KC59VXEMS65RNVKF5HJJ9S",
 "refId": "8<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704513,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.CreateBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createBake",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926705585,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.MonitorBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorBake",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.CompletedBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "completedBake",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "bake"
 },
 "user": {
 "isAdmin": false,
 "roles": [],
 "username": "myUserName"
 }
 }
}

Example Policy

Requires that baked images are of type hvm.

package spinnaker.execution.stages.before.bake

deny["all baked images must be of type hvm"]{
 input.stage.context.vmType!="hvm"
}

Keys

Parameters related to the stage against which the policy is executing can be found in the input.stage.context object.

input.pipeline

Key	Type	Description
`input.pipeline.application`	`string`	The name of the Spinnaker application to which this pipeline belongs.
`input.pipeline.authentication.allowedAccounts[]`	`string`	The list of accounts to which the user this stage runs as has access.
`input.pipeline.authentication.user`	`string`	The Spinnaker user initiating the change.
`input.pipeline.buildTime`	`number`
`input.pipeline.canceled`	`boolean`	Has the pipeline execution been cancelled. This is always false since the policy check requires that the pipeline is running.
`input.pipeline.canceledBy`	`string`	The userID of the user that cancelled the pipeline.
`input.pipeline.cancellationReason`
`input.pipeline.description`	`string`	Description of the pipeline defined in the UI.
`input.pipeline.endTime`	`number`
`input.pipeline.id`	`string`	The unique ID of the pipeline.
`input.pipeline.keepWaitingPipelines`	`boolean`	If false and concurrent pipeline execution is disabled, then the pipelines in the waiting queue get canceled when the next execution starts.
`input.pipeline.limitConcurrent`	`boolean`	True if only 1 concurrent execution of this pipeline is allowed.
`input.pipeline.name`	`string`	The name of this pipeline.
`input.pipeline.origin`	`string`
`input.pipeline.partition`
`input.pipeline.paused`
`input.pipeline.pipelineConfigId`	`string`
`input.pipeline.source`
`input.pipeline.spelEvaluator`	`string`	Which version of spring expression language is being used to evaluate SpEL.
`input.pipeline.stages[]`	`[array]`	An array of the stages in the pipeline. Typically if you are writing a policy that examines multiple pipeline stages, it is better to write that policy against either the `opa.pipelines package`, or the `spinnaker.execution.pipelines.before` package.
`input.pipeline.startTime`	`number`	Timestamp from when the pipeline was started.
`input.pipeline.startTimeExpiry`	`date`	Unix epoch date at which the pipeline expires.
`input.pipeline.status`	`string`
`input.pipeline.templateVariables`
`input.pipeline.type`	`string`

input.pipeline.trigger

See input.pipeline.trigger for more information.

input.stage

See input.stage for more information.

input.stage.context

Key	Type	Description
`input.stage.context.amiSuffix`	`string`	A suffix to apply to the ami. By default, a string of the date in format `YYYYMMDDHHmm`.
`input.stage.context.baseLabel`	`string`	A base label to use for the AMI.
`input.stage.context.baseOs`	`string`	What operating system should be used to find a baseAMI to base the AMI from.
`input.stage.context.baseAmi`	`string`	If Base AMI is specified, this is used instead of the Base OS provided.
`input.stage.context.cloudProviderType`	`string`	The type of the cloud provider for which an image is baked.
`input.stage.context.name`	`string`
`input.stage.context.package`	`string`	The package that should be installed in the new AMI.
`input.stage.context.rebake`	`boolean`	Rebake image without regard to the status of any existing bake.
`input.stage.context.region`	`string`	The region in which to perform the backe.
`input.stage.context.storeType`	`string`	What type of storage the baked image will use.
`input.stage.context.type`	`string`	Always `bake`.
`input.stage.context.user`	`string`	The ID of the user that started the bake.
`input.stage.context.vmType`	`string`	`HVM` or `PV`. The type of virtual machine for which the image should be baked.

input.user

This object provides information about the user performing the action. This can be used to restrict actions by role. See input.user for more information.

Plugins: spinnaker.execution.stages.before.cloneServerGroup

Mon, 01 Jan 0001 00:00:00 +0000

More information on the clone server group stage can be found in Spinnaker’s documentation.

Example Payload

Click to expand

{
 "input": {
 "pipeline": {
 "application": "test",
 "authentication": {
 "allowedAccounts": [
 "spinnaker",
 "staging",
 "staging-ecs"
 ],
 "user": "myUserName"
 },
 "buildTime": 1620926703486,
 "canceled": false,
 "canceledBy": null,
 "cancellationReason": null,
 "description": null,
 "endTime": 1620926705283,
 "id": "01F5KC59TRGWKCP31C4N51CDSB",
 "initialConfig": {},
 "keepWaitingPipelines": false,
 "limitConcurrent": true,
 "name": "test",
 "notifications": [],
 "origin": "api",
 "partition": null,
 "paused": null,
 "pipelineConfigId": "6a4cff2e-8265-4584-8993-2da2eb6254f5",
 "source": null,
 "spelEvaluator": "v4",
 "stages": [],
 "startTime": 1620926703525,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "systemNotifications": [],
 "templateVariables": null,
 "trigger": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 }
 ],
 "correlationId": null,
 "isDryRun": false,
 "isRebake": false,
 "isStrategy": false,
 "notifications": [],
 "other": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 }
 ],
 "dryRun": false,
 "enabled": false,
 "eventId": "c1090782-f485-490e-a2d7-31763b3bd4d8",
 "executionId": "01F5KC59TRGWKCP31C4N51CDSB",
 "expectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "notifications": [],
 "parameters": {},
 "preferred": false,
 "rebake": false,
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "strategy": false,
 "type": "manual",
 "user": "myUserName"
 },
 "parameters": {},
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "location": null,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": null,
 "type": "github/file",
 "uuid": null,
 "version": null
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "type": "manual",
 "user": "myUserName"
 },
 "type": "PIPELINE"
 },
 "stage": {
 "context": {
 "application": "test",
 "attempt": 2,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "consecutiveNotFound": 0,
 "copySourceCustomBlockDeviceMappings": false,
 "credentials": "staging",
 "freeFormDetails": "",
 "lastException": "Unable to locate current_asg_dynamic in staging/us-east-2/test\ncom.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroup$NotFoundException: Unable to locate current_asg_dynamic in staging/us-east-2/test\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n\tat java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)\n\tat org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:80)\n\tat org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:74)\n\tat org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:237)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:249)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver.resolveByTarget(TargetServerGroupResolver.groovy:75)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:101)\n\tat groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)\n\tat org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:351)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:64)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:156)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:176)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver$_resolveByParams_closure1.doCall(TargetServerGroupResolver.groovy:56)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:101)\n\tat groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)\n\tat org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:263)\n\tat groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1041)\n\tat groovy.lang.Closure.call(Closure.java:405)\n\tat groovy.lang.Closure.call(Closure.java:421)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3574)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3559)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3659)\n\tat org.codehaus.groovy.runtime.dgm$87.invoke(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:244)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:53)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver.resolveByParams(TargetServerGroupResolver.groovy:54)\n\tat com.netflix.spinnaker.orca.kato.pipeline.support.SourceResolver.getSource(SourceResolver.groovy:79)\n\tat com.netflix.spinnaker.orca.kato.pipeline.support.SourceResolver$getSource.call(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask.execute(DetermineSourceServerGroupTask.groovy:59)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n",
 "region": "us-east-2",
 "stack": "",
 "target": "current_asg_dynamic",
 "targetCluster": "test",
 "useAmiBlockDeviceMappings": false,
 "useSourceCapacity": true
 },
 "endTime": null,
 "id": "01F5KC59VXW75H7Q7Z2C87CXET",
 "lastModified": null,
 "name": "Clone Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "12",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703580,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineSourceServerGroup",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703830,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.pipeline.providers.aws.CaptureSourceServerGroupCapacityTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "snapshotSourceServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.CloneServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "cloneServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.instance.WaitForUpInstancesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForUpInstances",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "8",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "9",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetCommitsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getCommits",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "cloneServerGroup"
 },
 "user": {
 "isAdmin": false,
 "roles": [],
 "username": "myUserName"
 }
 }
}

Example Policy

package spinnaker.execution.stages.before.cloneServerGroup

productionAccounts :=["prod1","prod2"]

deny["ASGs running in production must have a minimum of 2 instances to avoid having a single point of failure."]{
 input.stage.context.credentials==productionAccounts[_]
 input.stage.context.useSourceCapacity==false
 object.get(input.stage.context.capacity,"min",0)<2
}{
 input.stage.context.credentials==productionAccounts[_]
 input.stage.context.useSourceCapacity==false
 object.get(input.stage.context,"capacity",null)==null
}

Keys

Parameters related to the stage against which the policy is executing can be found in the input.stage.context object.

input.pipeline

Key	Type	Description
`input.pipeline.application`	`string`	The name of the Spinnaker application to which this pipeline belongs.
`input.pipeline.authentication.allowedAccounts[]`	`string`	The list of accounts to which the user this stage runs as has access.
`input.pipeline.authentication.user`	`string`	The Spinnaker user initiating the change.
`input.pipeline.buildTime`	`number`
`input.pipeline.canceled`	`boolean`
`input.pipeline.canceledBy`
`input.pipeline.cancellationReason`
`input.pipeline.description`	`string`	Description of the pipeline defined in the UI.
`input.pipeline.endTime`	`number`
`input.pipeline.id`	`string`	The unique ID of the pipeline.
`input.pipeline.keepWaitingPipelines`	`boolean`	If false and concurrent pipeline execution is disabled, then the pipelines in the waiting queue gets canceled when the next execution starts.
`input.pipeline.limitConcurrent`	`boolean`	True if only 1 concurrent execution of this pipeline is allowed.
`input.pipeline.name`	`string`	The name of this pipeline.
`input.pipeline.origin`	`string`
`input.pipeline.partition`
`input.pipeline.paused`
`input.pipeline.pipelineConfigId`	`string`
`input.pipeline.source`
`input.pipeline.spelEvaluator`	`string`	Which version of spring expression language is being used to evaluate SpEL.
`input.pipeline.stages[]`	`[array]`	An array of the stages in the pipeline. Typically if you are writing a policy that examines multiple pipeline stages, it is better to write that policy against either the `opa.pipelines package`, or the `spinnaker.execution.pipelines.before` package.
`input.pipeline.startTime`	`number`	Timestamp from when the pipeline was started.
`input.pipeline.startTimeExpiry`	`date`	Unix epoch date at which the pipeline expires.
`input.pipeline.status`	`string`
`input.pipeline.templateVariables`
`input.pipeline.type`	`string`

input.pipeline.trigger

See input.pipeline.trigger for more information.

input.stage

See input.stage for more information.

input.stage.context

Key	Type	Description
`input.stage.context.application`	`string`	The name of the Spinnaker application for this pipeline.
`input.stage.context.attempt`	`number`	How many times has this stage attempted to execute.
`input.stage.context.capacity.desired`	`number`	If `useSourceCapacity` is false, the desired number of instances to run in the group.
`input.stage.context.capacity.max`	`number`	If `useSourceCapacity` is false, the maximum number of instances to run in the group.
`input.stage.context.capacity.min`	`number`	If `useSourceCapacity` is false, the minimum number of instances to run in the group.
`input.stage.context.cloudProvider`	`string`	The name of the cloud provider that executes the stage.
`input.stage.context.cloudProviderType`	`string`	The type of the cloud provider that executes the stage.
`input.stage.context.consecutiveNotFound`	`number`
`input.stage.context.copySourceCustomBlockDeviceMappings`	`boolean`
`input.stage.context.credentials`	`string`	The account/credential set that’s used to execute this stage.
`input.stage.context.freeFormDetails`	`string`
`input.stage.context.lastException`	`string`	The last exception that occurred when executing this stage.
`input.stage.context.region`	`string`	The region in which the new server group is deployed.
`input.stage.context.stack`	`string`
`input.stage.context.target`	`string`	Which server group should be selected when this stage starts.
`input.stage.context.targetCluster`	`string`	The cluster that contains the target.
`input.stage.context.useAmiBlockDeviceMappings`	`boolean`	Spinnaker will use the block device mappings from the selected AMI when deploying a new server group.
`input.stage.context.useSourceCapacity`	`boolean`	Spinnaker will use the current capacity of the existing server group when deploying a new server group. This setting is intended to support a server group with auto-scaling enabled, where the bounds and desired capacity are controlled by an external process. In the event that there is no existing server group, the deploy will fail.

input.user

This object provides information about the user performing the action. This can be used to restrict actions by role. See input.user for more information.

Plugins: spinnaker.execution.stages.before.concourse

Mon, 01 Jan 0001 00:00:00 +0000

Example Payload

Click to expand

{
 "input": {
 "pipeline": {
 "application": "test",
 "authentication": {
 "allowedAccounts": [
 "spinnaker",
 "staging",
 "staging-ecs"
 ],
 "user": "myUserName"
 },
 "buildTime": 1620926703486,
 "canceled": false,
 "canceledBy": null,
 "cancellationReason": null,
 "description": null,
 "endTime": 1620926705283,
 "id": "01F5KC59TRGWKCP31C4N51CDSB",
 "initialConfig": {},
 "keepWaitingPipelines": false,
 "limitConcurrent": true,
 "name": "test",
 "notifications": [],
 "origin": "api",
 "partition": null,
 "paused": null,
 "pipelineConfigId": "6a4cff2e-8265-4584-8993-2da2eb6254f5",
 "source": null,
 "spelEvaluator": "v4",
 "stages": [],
 "startTime": 1620926703525,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "systemNotifications": [],
 "templateVariables": null,
 "trigger": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 }
 ],
 "correlationId": null,
 "isDryRun": false,
 "isRebake": false,
 "isStrategy": false,
 "notifications": [],
 "other": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 }
 ],
 "dryRun": false,
 "enabled": false,
 "eventId": "c1090782-f485-490e-a2d7-31763b3bd4d8",
 "executionId": "01F5KC59TRGWKCP31C4N51CDSB",
 "expectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "notifications": [],
 "parameters": {},
 "preferred": false,
 "rebake": false,
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "strategy": false,
 "type": "manual",
 "user": "myUserName"
 },
 "parameters": {},
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "location": null,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": null,
 "type": "github/file",
 "uuid": null,
 "version": null
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "type": "manual",
 "user": "myUserName"
 },
 "type": "PIPELINE"
 },
 "stage": {
 "context": {
 "failOnFailedExpressions": true
 },
 "endTime": null,
 "id": "01F5KC59VX419V14RWY4JCWEHK",
 "lastModified": null,
 "name": "Concourse",
 "outputs": {},
 "parentStageId": null,
 "refId": "13",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703586,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.WaitForConcourseJobStartTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForConcourseJobStartTask",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703684,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.WaitForConcourseJobCompletionTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForConcourseJobCompletionTask",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "concourse"
 },
 "user": {
 "isAdmin": false,
 "roles": [],
 "username": "myUserName"
 }
 }
}

Example Policy

This example disables the use of concourse stages.

package spinnaker.execution.stages.before.concourse

deny["Pipelines may not use the 'Concourse' stage."]

Keys

input.pipeline

Key	Type	Description
`input.pipeline.application`	`string`	The name of the Spinnaker application to which this pipeline belongs.
`input.pipeline.authentication.allowedAccounts[]`	`string`	The list of accounts to which the user this stage runs as has access.
`input.pipeline.authentication.user`	`string`	The Spinnaker user initiating the change.
`input.pipeline.buildTime`	`number`
`input.pipeline.canceled`	`boolean`
`input.pipeline.canceledBy`
`input.pipeline.cancellationReason`
`input.pipeline.description`	`string`	Description of the pipeline defined in the UI.
`input.pipeline.endTime`	`number`
`input.pipeline.id`	`string`	The unique ID of the pipeline.
`input.pipeline.keepWaitingPipelines`	`boolean`	If false and concurrent pipeline execution is disabled, then the pipelines in the waiting queue gets canceled when the next execution starts.
`input.pipeline.limitConcurrent`	`boolean`	True if only 1 concurrent execution of this pipeline is allowed.
`input.pipeline.name`	`string`	The name of this pipeline.
`input.pipeline.origin`	`string`
`input.pipeline.partition`
`input.pipeline.paused`
`input.pipeline.pipelineConfigId`	`string`
`input.pipeline.source`
`input.pipeline.spelEvaluator`	`string`	Which version of spring expression language is being used to evaluate SpEL.
`input.pipeline.stages[]`	`[array]`	An array of the stages in the pipeline. Typically if you are writing a policy that examines multiple pipeline stages, it is better to write that policy against either the `opa.pipelines package`, or the `spinnaker.execution.pipelines.before` package.
`input.pipeline.startTime`	`number`	Timestamp from when the pipeline was started.
`input.pipeline.startTimeExpiry`	`date`	Unix epoch date at which the pipeline expires.
`input.pipeline.status`	`string`
`input.pipeline.templateVariables`
`input.pipeline.type`	`string`

input.pipeline.trigger

See input.pipeline.trigger for more information.

input.stage

See input.stage for more information.

input.user

This object provides information about the user performing the action. This can be used to restrict actions by role. See input.user for more information.

Plugins: Configure Pipelines-as-Code Optional Features

Mon, 01 Jan 0001 00:00:00 +0000

Where to configure the Dinghy service

Spinnaker (Halyard): dinghy.yml section of your ConfigMap
Spinnaker (Spinnaker Operator): spinnaker-kustomize-patches/plugins/oss/pipelines-as-code/dinghy.yml
Armory CD: Either spinnaker-kustomize-patches/armory/features/pipelines-as-code/features.yml or spinnakerservice.yml

Auto lock pipelines - disable

Set autoLockPipelines: false to disable lock pipelines in the UI before overwriting changes.

Add the following to your dinghy.yml config:

autoLockPipelines: false

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 autoLockPipelines: false

Branches

Custom branches

Configuring a custom branch is required if you are using a repo that does not use master or main as the default branch, or you want to use a branch other than master or main.

By default, Dinghy uses the master branch in your repository and fallbacks to main if master doesn’t exist. If you wish to use a different branch in your repository, you can configure that using the repoConfig tag in your YAML configuration.

The repoConfig tag supports a collection of the following values:

branch - the name of the branch you wish to use
provider - the name of the provider. Pipelines-as-Code supports the following:
- github
- bitbucket-cloud
- bitbucket-server
repo - the name of the repository

Add the following to your dinghy.yml config:

repoConfig:
- branch: some_branch
 provider: bitbucket-server
 repo: my-bitbucket-repository
- branch: some_branch
 provider: github
 repo: my-github-repository

spec:
 spinnakerConfig:
 profiles:
 dinghy:
 repoConfig:
 - branch: some_branch
 provider: bitbucket-server
 repo: my-bitbucket-repository
 - branch: some_branch
 provider: github
 repo: my-github-repository

Multiple branches

Early Access

The information below is written for an Early Access feature. Contact us if you are interested in using this feature! Your feedback will help shape the development of this feature.

Do not use Early Access features for production environments.

Each branch in a repository must be explicitly configured in a separate repoConfig item. In the example below, Dinghy properly handles changes from two branches, branch_a and branch_b in repository-GitHub-repository. Add the following to your dinghy.yml profile config:

multipleBranchesEnabled: true
repoConfig:
- branch: branch_a
 provider: github
 repo: my-github-repository
- branch: branch_b
 provider: github
 repo: my-github-repository
- branch: some_branch
 provider: bitbucket-server
 repo: my-bitbucket-repository

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 multipleBranchesEnabled: true
 profiles:
 dinghy:
 repoConfig:
 - branch: some_branch
 provider: bitbucket-server
 repo: my-bitbucket-repository
 - branch: some_branch
 provider: github
 repo: my-github-repository

Custom dinghyfile name

This changes the name of the file that describes pipelines.

Add the following to your dinghy.yml config:

dinghyFilename: <your-filename>

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 dinghyFilename: <your-filename>

External persistent database

The Pipelines-as-Code service uses an in-cluster Redis instance to store relationships between pipeline templates and pipeline config files (.dinghyfile). You can, however, configure the service to use an external persistent database.

Configure Redis

Armory highly recommends that you use an external Redis instance for production use. If Redis becomes unavailable, you need to update your pipeline config files in order for the service to repopulate Redis with the relationships.

You can only configure Dinghy to use a password with the default Redis user.

Add the following to your dinghy.yml config:

redis:
 baseUrl: "redis://spin-redis:6379"
 password: "password"

spec:
 spinnakerConfig:
 profiles:
 dinghy:
 redis: "redis://spin-redis:6379"
 password: "<password>"

Configure MySQL

Early Access

The Pipelines-as-Code service can use MySQL to store relationships between pipeline templates and pipeline Dinghy files. Armory recommends an external MySQL instance for production use because it can provide more durability for Pipelines-as-Code. If MySQL becomes unavailable, you need to update your Dinghy files in order to repopulate MySQL with the relationships.

Configure the RDBMS driver exactly as described in Set up Clouddriver to use SQL - Database Setup. The MySQL database schema must be configured to with:

Default character set utfmb4
Default collate utf8mb4_unicode_ci

First make sure the schema exists in your database.

CREATE SCHEMA IF NOT EXISTS dinghy DEFAULT CHARACTER SET utf8mb4 COLLATE utf8mb4_unicode_ci;
 CREATE USER IF NOT EXISTS 'dinghy_service'@'%' IDENTIFIED BY '${SOME_PASSWORD_HERE}';
 CREATE USER IF NOT EXISTS 'dinghy_migrate'@'%' IDENTIFIED BY '${SOME_PASSWORD_HERE}';
 GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, EXECUTE, SHOW VIEW ON dinghy.* TO 'dinghy_service'@'%';
 GRANT SELECT, INSERT, UPDATE, DELETE, CREATE, DROP, REFERENCES, INDEX, ALTER, LOCK TABLES, EXECUTE, SHOW VIEW ON dinghy.* TO dinghy_migrate@'%';

Next, configure Pipelines-as-Code to use your MySQL database.

Add the following to your dinghy.yml config:

sql:
 baseUrl: mysql:3306
 databaseName: dinghy
 enabled: true
 password: <password>
 user: <user>

spec:
 spinnakerConfig:
 profiles:
 dinghy:
 sql:
 baseUrl: mysql:3306
 databaseName: dinghy
 enabled: true
 password: password
 user: user

Migration from Redis to SQL

There is a migration strategy to move the relationships from Redis to SQL. In order to do that, you need to have the configuration from your Redis and add the configuration for MySQL as shown previously. When you do this and the pod starts, what happens is that the migration is done automatically by a job. To verify that the migration was done successfully, you can access your database and run the following query:

select * from executions;
select * from fileurls;
select * from fileurl_childs;

In the executions table, you should be able to see one record with the name REDIS_TO_SQL_MIGRATION.

In fileurls and fileurl_childs, you should be able to see the migration information with the Dinghyfiles, modules, and their relationships.

After Dinghy finishes the migration, it closes the Redis connection and works in full MySQL mode.

Fiat

If you have enabled Fiat, add the field fiatUser: <your-service-account> to your config. Note that the service account has to be in a group that has read/write access to the pipelines you are updating.

If you have app specific permissions configured, make sure you add the service account. For information on how to create a service account, see Creating service accounts.

Add the following to your dinghy.yml config:

fiatUser: <your-service-account>

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 fiatUser: <your-service-account>

Negative expressions support

The Regexp2 engine supports negative expressions, so you don’t need to define patterns for all files to be ignored. You can ignore everything other than required files. For example, in your project you have some project-specific files: file.js, file.ts, file.css. You also have files used by Dinghy: dinghyfile, minimum-wait.stage.module, maximum-wait.stage.module. If you enable dinghyIgnoreRegexp2Enabled, you can create your .dinghyfile with one of the following regular expressions:

file.(js|ts|css)
^(?!.(.stage.module)|(dinghyfile)).

Both of those regular expressions product the same result:

file.js -> ignored
file.ts -> ignored
file.css -> ignored
dinghyfile -> processed by Dinghy
minimum-wait.stage.module -> processed by Dinghy
maximum-wait.stage.module -> processed by Dinghy

Add dinghyIgnoreRegexp2Enabled: true if you want Dinghy to ignore everything other than required files.

Add the following to your dinghy.yml config:

dinghyIgnoreRegexp2Enabled: true

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 dinghyIgnoreRegexp2Enabled: true

Notifications

Slack notifications

If you configured Armory CD or Spinnaker to send Slack notifications for pipeline events, you can configure Pipelines-as-Code to send pipeline update results to Slack.

Add the following to your dinghy.yml config:

notifiers:
 enabled: true # Enable to allow any notifier type to occur
 slack:
 enabled: true # Whether or not Slack notifications are enabled for Dinghy events
 channel: <my-channel> # Slack channel where notifications will be sent to
 github:
 enabled: false # (Default: true) Whether or not github notifications are enabled for Dinghy events; once `spec.spinnakerConfig.profiles.dinghy.notifiers` are enabled, only enable this if you want both Slack and GitHub notifications at the same time

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 enabled: true
 notifiers:
 enabled: true # Enable to allow any notifier type to occur
 slack:
 enabled: true # Whether or not Slack notifications are enabled for dinghy events
 channel: my-channel # Slack channel where notifications will be sent to
 github:
 enabled: false # (Default: true) Whether or not github notifications are enabled for Dinghy events, once spec.spinnakerConfig.prifles.dinghy.notifiers are enabled. Only enable if you want both slack and github notifications at the same time

GitHub notifications

Dinghy can provide more robust information to GitHub about executed pipeline changes. This information appears as a comment in the PR.

Keep the following in mind when enabling GitHub notifications:

When using Armory CD versions below 2.26.2, GitHub notifications are not supported with custom endpoints and should be disabled due to a known issue. This issue has been resolved as of 2.26.2, Dinghy Change #447.
Enabling this functionality may lead to a large number of comments on a pull request if, for example, you update a module that is used by multiple pipelines. This can lead to the GitHub UI not loading or GitHub rate limiting cause of related API calls.

Add the following to your dinghy.yml config:

notifiers:
 enabled: true
 github:
 enabled: true # (Default: true) Whether or not github notifications are enabled for Dinghy events; once `notifiers` are enabled, only enable this if you want both Slack and GitHub notifications at the same time

spec:
 spinnakerConfig:
 profiles:
 dinghy:
 notifiers:
 enabled: true
 github:
 enabled: true # (Default: true) Whether or not github notifications are enabled for Dinghy events, once spec.spinnakerConfig.profles.dinghy.notifiers are enabled

Permissions check for a commit

The userWritePermissionsCheckEnabled feature, when enabled, verifies if the author of a commit that changed app parameters has sufficient WRITE permission for that app. You can specify a list of authors whose permissions are not valid. This option’s purpose is to skip permissions checks for bots and tools.

How this feature works

A webhook generated by commits pushed to a branch contains information about the commit author. Dinghy extracts the author’s email and fetches user roles for that email from Fiat. Given the roles, Dinghy fetches app permissions and compares the app’s WRITE roles with the roles of the author. If they match, Dinghy processes the webhook and applies changes from the commit to the app or pipelines. If permissions don’t match, Dinghy rejects the webhook since the author doesn’t have the required write permissions.

How to enable

This feature is disabled by default to prevent users from experiencing unexpected application behavior. You can enable the feature by setting userWritePermissionsCheckEnabled to true. When you omit userWritePermissionsCheckEnabled or set it to false, Dinghy does not check permissions.

To skip permissions checks for users such as bots or service accounts, set the value of ignoreUsersWritePermissions to the comma-delimited list of repo user email addresses.

When userWritePermissionsCheckEnabled is false or omitted, ignoreUsersWritePermissions has no effect.

Add the following to your dinghy.yml config:

userWritePermissionsCheckEnabled: true
ignoreUsersWritePermissions: “user1@example.com,user2@example.com”

spec:
 spinnakerConfig:
 config:
 armory:
 dinghy:
 userWritePermissionsCheckEnabled: true
 ignoreUsersWritePermissions: “user1@example.com,user2@example.com”

Template formats

Pipelines-as-Code supports two additional template formats in addition to the default JSON:

HCL
YAML

Selecting one of these parsers means that all of your templates must also be in that format.

Add the following to your dinghy.yml config:

parserFormat: <parser-format>

spec:
 spinnakerConfig:
 profiles:
 dinghy:
 parserFormat: <parser-format>

Replace <parser-format with one of the parsers:

json (Default)
yaml
hcl

What’s next

Use Pipelines-as-Code in Armory Continuous Deployment

Plugins: Configure Terraform Integration Optional Features

Mon, 01 Jan 0001 00:00:00 +0000

Where to configure the Terraform Integration service

Spinnaker (Spinnaker Operator): spinnaker-kustomize-patches/plugins/oss/pipelines-as-code/terraformer.yml; use spinnaker-kustomize-patches/plugins/oss/pipelines-as-code/terraformer-local.yml for Named Profiles
Spinnaker (Halyard): terraformer.yml section of your ConfigMap; create a new terraformer-local.yml section to configure Named Profiles
Armory CD: spinnaker-kustomize-patches/armory/features/patch-terraformer.yml

Cloud provider

Terraform Integration is cloud provider agnostic. Terraform commands execute against the terraform binary. All methods of configuring authentication are supported as per Terraform’s compatibility and capabilities.

You can also configure a Named Profile that grants access to resources such as AWS.

Logging and metrics

If the logging URL is not responsive, Terraform Integration may not process deploys until the URL can be reached.

You can enable logging and metrics for Prometheus by adding the following configuration to the spec.spinnakerConfig.profiles.terraformer.logging.remote block in your SpinnakerService manifest:

Add the following to your terraformer.yml config:

logging:
 remote:
 enabled: true
 endpoint: <TheLoggingEndPoint> # For example, https://debug.armory.io
 version: 1.2.3
 customerId: someCustomer123 # Your Armory Customer ID
 metrics:
 enabled: true
 frequency: <Seconds> # Replace with an integer value for seconds based on how frequently you want metrics to be scraped
 prometheus:
 enabled: true
 commonTags: # The following tags are examples. Use tags that are relevant for your environment
 # env: dev
 # nf_app: exampleApp
 # nf_region: us-west-1

spec:
 spinnakerConfig:
 profiles:
 terraformer:
 logging:
 remote:
 enabled: true
 endpoint: <TheLoggingEndPoint> # For example, https://debug.armory.io
 version: 1.2.3
 customerId: someCustomer123 # Your Armory Customer ID
 metrics:
 enabled: true
 frequency: <Seconds> # Replace with an integer value for seconds based on how frequently you want metrics to be scraped
 prometheus:
 enabled: true
 commonTags: # The following tags are examples. Use tags that are relevant for your environment
 # env: dev
 # nf_app: exampleApp
 # nf_region: us-west-1

Named Profiles

When creating pipelines, a Named Profile gives you the ability to reference certain kinds of external sources, such as a private remote repository. The supported credentials are described in Types of credentials.

Configure a Named Profile

Configure profiles that you can select when creating a Terraform Integration stage.

Add profiles to the terraformer-local.yml file. The following example adds a profile named pixel-git for an SSH key secured in Vault. You can find additional profile examples at Types of credentials.

- name: pixel-git # Unique profile name displayed in Deck
 variables:
 - kind: git-ssh
 options:
 sshPrivateKey: encrypted:vault!e:<secret engine>!p:<path to secret>!k:<key>!b:<is base64 encoded?>

Add profiles to the terraformer-local.yml section of your ConfigMap. The following example adds a profile named pixel-git for an SSH key secured in Vault. You can find additional profile examples at Types of credentials.

apiVersion: v1
kind: ConfigMap
metadata:
 name: spin-terraformer-config
 namespace: spinnaker
data:
 terraformer-local.yml |
 profiles:
 - name: pixel-git # Unique profile name displayed in Deck
 variables:
 - kind: git-ssh
 options:
 sshPrivateKey: encrypted:vault!e:<secret engine>!p:<path to secret>!k:<key>!b:<is base64 encoded?>

Add profiles to the spec.spinnakerConfig.profiles.terraformer.profiles section. The following example adds a profile named pixel-git for an SSH key secured in Vault. You can find additional profile examples at Types of credentials.

- name: pixel-git # Unique profile name displayed in Deck
 variables:
 - kind: git-ssh
 options:
 sshPrivateKey: encrypted:vault!e:<secret engine>!p:<path to secret>!k:<key>!b:<is base64 encoded?>

Keep in mind:

When you create or edit a Terraform Integration stage in the UI, you can select the profile pixel-git from a dropdown.
When adding profiles:
- You can add multiple profiles under the profiles section.
- As a best practice, do not commit plain text secrets to spec.spinnakerConfig.profiles.terraformer. Instead, use a secret store: Vault, an encrypted S3 bucket, an AWS Secrets Manager, or an encrypted GCS bucket.
- For SSH keys, each profile supports only one option parameter at a time. This means that you can use a private key file (sshPrivateKeyFilePath) or the key (sshPrivateKey) as the option. To use the key file path, use sshPrivateKeyFilePath for the option and provide the path to the key file. You can also encrypt the path using a secret store such as Vault. The following option example uses sshPrivateKeyFilePath:
```
options:
sshPrivateKeyFilePath: encryptedFile:<secret_store>!e:...
```
  For more information, see the documentation for your secret store.

Add authz to Named Profiles

Armory recommends that you enable authorization for your Named Profiles to provide more granular control and give App Developers better guardrails. When you configure authz for Named Profiles, you need to explicitly grant permission to the roles you want to have access to the profile. Users who do not have permission to use a certain Named Profile do not see it as an option in the UI. Also, any stage that uses a Named Profile that a user is not authorized for fails.

Note

Before you start, make sure you enable Fiat. For more information about Fiat, see Fiat Overview and Authorization (RBAC).

This example does the following:

Grants access to the resources and accounts that you need, such as permissions to deploy to AWS via FIAT in Cloud
Enables FIAT authz to work with Terraformer

spec:
 spinnakerConfig:
 profiles:
 terraformer:
 profiles:
 fiat:
 enabled: true
 baseUrl: https://spin-fiat:7003 # ${services.fiat.baseUrl}

Types of credentials

The Terraform integration supports multiple types of credentials for Named Profiles:

AWS
SSH
Static
Terraform remote backend

If you’re not using AWS, you should configure one of the other credential types in your Named Profile.

AWS

Use the aws credential type to provide authentication to AWS. There are two methods you can use to provide authentication - by defining a static key pair or a role that should be assumed before a Terraform action is executed.

For defining a static key pair, supply an accessKeyId and a secretAccessKey:

- name: devops # Unique name for the profile. Shows up in Deck.
 variables:
 - kind: aws # Type of credential
 options:
 accessKeyId: AKIAIOWQXTLW36DV7IEA
 secretAccessKey: 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

For assuming a role instead of defining a static set of credentials, supply the ARN of the role to assume:

- name: devops # Unique name for the profile. Shows up in Deck.
 variables:
 - kind: aws # Type of credential
 options:
 assumeRole: arn:aws:iam::012345567:role/roleAssume

When assuming a role, if accessKeyId and secretAccessKey are supplied, the Terraform integration uses these credentials to assume the role. Otherwise, the environment gets used for authentication, such as a machine role or a shared credentials file.

SSH Key

Use the git-ssh credential kind to provide authentication to private Git repositories used as modules within your Terraform actions. The supplied SSH key will be available to Terraform for the duration of your execution, allowing it to fetch any modules it needs:

- name: pixel-git # Unique name for the profile. Shows up in Deck.
 variables:
 - kind: git-ssh # Type of credential
 options:
 sshPrivateKey: encrypted:vault!e:<secret engine>!p:<path to secret>!k:<key>!b:<is base64 encoded?>

Static

Use the static credential kind to provide any arbitrary key/value pair that isn’t supported by any of the other credential kinds. For example, if you want all users of the devops profile to execute against the AWS_REGION=us-west-2, use the following static credential configuration.

- name: devops # Unique name for the profile. Shows up in Deck.
 variables:
 - kind: static # Type of credential
 options:
 name: AWS_REGION
 value: us-west-2

Terraform remote backend

Use the tfc credential kind to provide authentication to remote Terraform backends.

- name: milton-tfc # Unique name for the profile. Shows up in Deck.
 variables:
 - kind: tfc
 options:
 domain: app.terraform.io # or Terraform Enterprise URL
 token: <authentication-token> # Replace with your token

Remote backends

The Terraform Integration feature supports using remote backends provided by Terraform Cloud and Terraform Enterprise.

When using remote backends, keep the following in mind:

The Terraform stage must use the same Terraform version that your Terraform Cloud/Enterprise workspace is configured to run.
The minimum supported Terraform version is 0.12.0.
In the Terraform Cloud/Enterprise UI, the type of plan action that the Terraform Integration stage performs is a “speculative plan.” For more information, see Speculative Plans in the Terraform docs.
You cannot save and apply a plan file.

Enable remote backend support

You can use remote backends by configuring the Terraform Integration stage with the following parameters:

A Terraform version that is 0.12.0 or later and matches the version that your Terraform Cloud/Enterprise runs.
Reference a remote backend in your Terraform code.

To enable support, add the following config to your terraformer-local.yml file in the .hal/default/profiles directory:

terraform:
 remoteBackendSupport: true

Retries

The Terraformer service can retry connections if it fails to fetch artifacts from Clouddriver. Configure the retry behavior in your terraformer-local.yml file by adding the following snippet:

# terraformer-local.yml
clouddriver:
 retry:
 enabled: true
 minWait: 4s # must be a duration, such as 4s for 4 seconds
 maxWait: 8s # must be a duration, such as 8s for 8 seconds
 maxRetries: 5

The preceding example enables retries and sets the minimum wait between attempts to 4 seconds, the maximum wait between attempts to 8s, and the maximum number of retries to 5.

What’s next

Use the Terraform Integration stage

Plugins: Armory Scale Agent Service Configuration

Mon, 01 Jan 0001 00:00:00 +0000

Where to configure the Armory Scale Agent

If you install the Armory Scale Agent service using kubectl, configure the Armory Scale Agent using a ConfigMap. See the kubectl installation instruction’s Configure the service section for an example.
See Deploy the Armory Scale Agent Service Using a Helm Chart for both CLI and values.yml configuration options.

Configure Kubernetes accounts

You can configure Kubernetes accounts in Spinnaker in multiple places:

Clouddriver configuration files: clouddriver.yml, clouddriver-local.yml, spinnaker.yml, spinnaker-local.yml
Spring Cloud Config Server reading accounts from Git, Vault, or another supported backend
Plugins

Behavior when reading Kubernetes account configuration from multiple sources:

When you configure different accounts in Agent and Armory CD, Agent merges both sources.
If you configure an account with the same name in Agent as well as Armory CD (Clouddriver or Spring Cloud Config Server backends), Agent account configuration always overrides the Armory CD configuration.
If you configure an account with the same name in Agent as well as in the Clouddriver plugin, the account that is used depends on the order of precedence defined in the plugin’s CredentialsDefinitionSource interface. The Agent has an order precedence of 1000. Check with your plugin provider for the plugin’s order of precedence.
- If the plugin has a higher precedence than the Armory Scale Agent, the plugin’s account is used. For example, if the plugin’s precedence is 500, the plugin’s account is used.
- If the plugin has no precedence defined or a lower precedence than the Armory Scale Agent, the account defined in the Armory Scale Agent is used.

Migrate accounts from Clouddriver to Agent

Copy the account definition from its original source, such as Clouddriver, to Agent’s configuration. Depending on how you installed Agent, this configuration could be in the armory-agent.yml data section of a ConfigMap or in the armory-agent.yml file in the Armory Scale Agent pod.

Agent may not use all the properties you copy from the original source definition. Unused properties are ignored.

Agent mode

In Agent mode, your configuration should look similar to this:

kubernetes:
 accounts:
 - name: account-01
 serviceAccount: true
 ...

Spinnaker Service and Infrastructure modes

You set up multiple accounts per Agent in these modes. Your configuration should look similar to this:

kubernetes:
 accounts:
 - name: account-name-01
 kubeconfigFile: /kubeconfigfiles/kubecfg-account01.yaml
 - name: account-name-02
 kubeconfigFile: /kubeconfigfiles/kubecfg-account02.yaml
 - ...

Automatically migrate accounts from Clouddriver to Agent

The Dynamic Accounts feature enables manual account migration using a REST API or automatic account migration via request interception or a scanning mechanism. See Dynamic Accounts Architecture and Features.

Migrate accounts from Agent to Clouddriver

Follow these steps to migrate accounts from Agent to Clouddriver:

Delete the account definition from your Agent configuration. Depending on how you installed Agent, this configuration could be in the armory-agent.yml data section of a ConfigMap or in the armory-agent.yml file in the Armory Scale Agent pod.
Add the account definition to the source that Clouddriver uses.

Permissions format

Permissions for the Armory Scale Agent use a format that is slightly different than the format that Clouddriver uses for permissions. Define your permissions like this:

kubernetes:
 accounts:
 - name: my-k8s-account
 permissions:
 - READ: ['role1', 'role2']
 - WRITE: ['role3', 'role4']

Make sure that there are no whitespaces in the role configurations under the READ or WRITE tags. The permissions are not applied if there are whitespaces in the configuration. This means that all users will have access to the account.

Restricted environments

Network access

The Agent needs access to its control plane (Spinnaker) as well to the various Kubernetes clusters it is configured to monitor. You can control which traffic should go through an HTTP proxy via the usual HTTP_PROXY, HTTPS_PROXY, and NO_PROXY environment variables.

A common case is to force the connection back to the control plane via a proxy but bypass it for Kubernetes clusters. In that case, define the environment variable HTTPS_PROXY=https://my.corporate.proxy and use the kubernetes.noProxy: true setting to not have to maintain the list of Kubernetes hosts in NO_PROXY.

Kubernetes authorization

The Agent should be configured to access each Kubernetes cluster it monitors with a service account. You can limit what Spinnaker can do via the role you assign to that service account. For example, if you’d like Spinnaker to see NetworkPolicies but not deploy them:

apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole
metadata:
 name: agent-role
rules:
- apiGroups: ["networking.k8s.io"]
 resources: ["networkpolicies"]
 verbs: [ "get", "list", "watch"]
...

Namespace restrictions

You can limit the Armory Scale Agent to monitoring specific namespaces by listing them under namespaces. If you need to prevent the Armory Scale Agent from accessing cluster-wide (non-namespaced) resources, use the onlyNamespacedResources setting.

A side effect of disabling cluster-wide resources is that CustomResourceDefinitions won’t be known (and therefore deployable by Spinnaker). CustomResourceDefinitions are cluster-wide resources, but the custom resources themselves may be namespaced. To workaround the limitation, you can define customResourceDefinitions. Both namespaces and CRDs are sent to Spinnaker as “synthetic” resources. They won’t be queried or watched, but Spinnaker knows about their existence.

kubernetes:
 accounts:
 - name: production
 ...
 # Restricts the agent to namespaces `ns1` and `ns2`
 namespaces:
 - ns1
 - ns2
 # Prevents the Armory Scale Agent from querying non-namespaced resources
 onlyNamespacedResources: true
 # Whitelist CRDs so Spinnaker
 customResourceDefinitions:
 - kind: ServiceMonitor.monitoring.coreos.com
 - kind: SpinnakerService.spinnaker.armory.io

What’s next

Armory Scale Agent Service Configuration Options

Plugins: spinnaker.execution.stages.before.createServerGroup

Mon, 01 Jan 0001 00:00:00 +0000

Example Payload

Click to expand

{
 "input": {
 "pipeline": {
 "application": "test",
 "authentication": {
 "allowedAccounts": [
 "spinnaker",
 "staging",
 "staging-ecs"
 ],
 "user": "myUserName"
 },
 "buildTime": 1620926703486,
 "canceled": false,
 "canceledBy": null,
 "cancellationReason": null,
 "description": null,
 "endTime": 1620926705283,
 "id": "01F5KC59TRGWKCP31C4N51CDSB",
 "initialConfig": {},
 "keepWaitingPipelines": false,
 "limitConcurrent": true,
 "name": "test",
 "notifications": [],
 "origin": "api",
 "partition": null,
 "paused": null,
 "pipelineConfigId": "6a4cff2e-8265-4584-8993-2da2eb6254f5",
 "source": null,
 "spelEvaluator": "v4",
 "stages": [],
 "startTime": 1620926703525,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "systemNotifications": [],
 "templateVariables": null,
 "trigger": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 }
 ],
 "correlationId": null,
 "isDryRun": false,
 "isRebake": false,
 "isStrategy": false,
 "notifications": [],
 "other": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 }
 ],
 "dryRun": false,
 "enabled": false,
 "eventId": "c1090782-f485-490e-a2d7-31763b3bd4d8",
 "executionId": "01F5KC59TRGWKCP31C4N51CDSB",
 "expectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "notifications": [],
 "parameters": {},
 "preferred": false,
 "rebake": false,
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "strategy": false,
 "type": "manual",
 "user": "myUserName"
 },
 "parameters": {},
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "location": null,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": null,
 "type": "github/file",
 "uuid": null,
 "version": null
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "type": "manual",
 "user": "myUserName"
 },
 "type": "PIPELINE"
 },
 "stage": {
 "context": {
 "account": "staging",
 "application": "test",
 "availabilityZones": {
 "us-east-2": [
 "us-east-2a",
 "us-east-2b",
 "us-east-2c"
 ]
 },
 "capacity": {
 "desired": 1,
 "max": 1,
 "min": 1
 },
 "cloudProvider": "aws",
 "cooldown": 10,
 "copySourceCustomBlockDeviceMappings": false,
 "ebsOptimized": false,
 "enabledMetrics": [],
 "freeFormDetails": "",
 "healthCheckGracePeriod": 600,
 "healthCheckType": "EC2",
 "iamRole": "BaseIAMRole",
 "instanceMonitoring": false,
 "instanceType": "t3.nano",
 "keyPair": "Demo",
 "loadBalancers": [],
 "name": "Deploy in us-east-2",
 "provider": "aws",
 "reason": "sad",
 "securityGroups": [],
 "source": {},
 "spotPrice": "",
 "stack": "",
 "strategy": "",
 "subnetType": "",
 "suspendedProcesses": [],
 "tags": {},
 "targetGroups": [],
 "targetHealthyDeployPercentage": 100,
 "terminationPolicies": [
 "Default"
 ],
 "type": "createServerGroup",
 "useAmiBlockDeviceMappings": false
 },
 "endTime": null,
 "id": "01F5KC59ZVHCFYZPQ9851X0D3X",
 "lastModified": null,
 "name": "Deploy in us-east-2",
 "outputs": {},
 "parentStageId": "01F5KC59VX6DZFTP10F521J3G2",
 "refId": "15<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703698,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": 1620926706124,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineSourceServerGroup",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703970,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620926706454,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.pipeline.providers.aws.CaptureSourceServerGroupCapacityTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "snapshotSourceServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.CreateServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.instance.WaitForUpInstancesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForUpInstances",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "8",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "9",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetCommitsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getCommits",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "createServerGroup"
 },
 "user": {
 "isAdmin": false,
 "roles": [],
 "username": "myUserName"
 }
 }
}

Example Policy

Prevent server groups from being created in production with fewer than 1 instance.

package spinnaker.execution.stages.before.createServerGroup

productionAccounts :=["prod1","prod2"]

deny["ASGs running in production must have a minimum of 2 instances to avoid having a single point of failure."]{
 input.stage.context.account==productionAccounts[_]
 object.get(input.stage.context.capacity,"min",0)<2
}

Keys

Parameters related to the stage against which the policy is executing can be found in the input.stage.context object.

input.pipeline

Key	Type	Description
`input.pipeline.application`	`string`	The name of the Spinnaker application to which this pipeline belongs.
`input.pipeline.authentication.allowedAccounts[]`	`string`	The list of accounts to which the user this stage runs as has access.
`input.pipeline.authentication.user`	`string`	The Spinnaker user initiating the change.
`input.pipeline.buildTime`	`number`
`input.pipeline.canceled`	`boolean`
`input.pipeline.canceledBy`
`input.pipeline.cancellationReason`
`input.pipeline.description`	`string`	Description of the pipeline defined in the UI.
`input.pipeline.endTime`	`number`
`input.pipeline.id`	`string`	The unique ID of the pipeline.
`input.pipeline.keepWaitingPipelines`	`boolean`	If false and concurrent pipeline execution is disabled, then the pipelines in the waiting queue gets canceled when the next execution starts.
`input.pipeline.limitConcurrent`	`boolean`	True if only 1 concurrent execution of this pipeline is allowed.
`input.pipeline.name`	`string`	The name of this pipeline.
`input.pipeline.origin`	`string`
`input.pipeline.partition`
`input.pipeline.paused`
`input.pipeline.pipelineConfigId`	`string`
`input.pipeline.source`
`input.pipeline.spelEvaluator`	`string`	Which version of spring expression language is being used to evaluate SpEL.
`input.pipeline.stages[]`	`[array]`	An array of the stages in the pipeline. Typically if you are writing a policy that examines multiple pipeline stages, it is better to write that policy against either the `opa.pipelines package`, or the `spinnaker.execution.pipelines.before` package.
`input.pipeline.startTime`	`number`	Timestamp from when the pipeline was started.
`input.pipeline.startTimeExpiry`	`date`	Unix epoch date at which the pipeline expires.
`input.pipeline.status`	`string`
`input.pipeline.templateVariables`
`input.pipeline.type`	`string`

input.pipeline.trigger

See input.pipeline.trigger for more information.

input.stage

See input.stage for more information.

input.stage.context

Key	Type	Description
`input.stage.context.account`	`string`	The account in which the server group is created.
`input.stage.context.application`	`string`	The name of the Spinnaker application for this pipeline.
`input.stage.context.availabilityZones.<region>[]`	`string`	The availability zones in which the server group is created.
`input.stage.context.capacity.desired`	`number`	The desired number of instances to run in the group.
`input.stage.context.capacity.max`	`number`	The maximum number of instances to run in the group.
`input.stage.context.capacity.min`	`number`	The minimum number of instances to run in the group.
`input.stage.context.cloudProvider`	`string`	The name of the cloud provider that executes the stage.
`input.stage.context.cooldown`	`number`
`input.stage.context.copySourceCustomBlockDeviceMappings`	`boolean`
`input.stage.context.ebsOptimized`	`boolean`	Will instances be optimized for EBS
`input.stage.context.freeFormDetails`	`string`	Detail is a string of free-form alphanumeric characters and hyphens to describe any other variables in naming a cluster.
`input.stage.context.healthCheckGracePeriod`	`number`
`input.stage.context.healthCheckType`	`string`	What type of health check to use. EC2 or ELB.
`input.stage.context.iamRole`	`string`	What IAM Role should the instances execute with.
`input.stage.context.instanceMonitoring`	`boolean`	Whether to enable detailed monitoring of instances. Group metrics must be disabled to update an ASG with Instance Monitoring set to false.
`input.stage.context.instanceType`	`string`	What type of instances should be used to run the server group.
`input.stage.context.keyPair`	`string`	The security credentials that can be used to connect to the instance.
`input.stage.context.name`	`string`	The name of the server group.
`input.stage.context.provider`	`string`	The name of the cloud provider that executes the stage.
`input.stage.context.reason`	`string`	The user-provided reason for creating the server group.
`input.stage.context.spotPrice`	`string`	The maximum price per unit hour to pay for a Spot instance.
`input.stage.context.stack`	`string`	Stack is one of the core naming components of a cluster, used to create vertical stacks of dependent services for integration testing.
`input.stage.context.strategy`	`string`	The deployment strategy tells Spinnaker what to do with the previous version of the server group.
`input.stage.context.subnetType`	`string`	The subnet selection determines the VPC in which your server group runs. Options vary by account and region; the most common ones are: None (EC2 Classic): instances will not run in a VPC. Internal: instances are restricted to internal clients (i.e. require VPN access). External: instances are publicly accessible and running in VPC.
`input.stage.context.targetHealthyDeployPercentage`	`number`	What percentage of the ASG should be healthy instances during rollouts.
`input.stage.context.terminationPolicies[]`	`string`
`input.stage.context.type`	`string`	The name of this stage, typically `createServerGroup`.
`input.stage.context.useAmiBlockDeviceMappings`	`boolean`	Spinnaker will use the block device mappings from the selected AMI when deploying a new server group.

input.user

This object provides information about the user performing the action. This can be used to restrict actions by role. See input.user for more information.

Plugins: spinnaker.execution.stages.before.deleteManifest

Mon, 01 Jan 0001 00:00:00 +0000

See Deploy Applications to Kubernetes for more information on this stage.

Example Payload

Click to expand

{
 "input": {
 "deploy": {
 "account": "spinnaker",
 "allCoordinates": [],
 "credentials": "spinnaker",
 "events": [],
 "kinds": [],
 "labelSelectors": {
 "empty": true,
 "notEmpty": false,
 "selectors": []
 },
 "location": "staging",
 "manifestName": "deployment hostname",
 "options": {
 "apiVersion": null,
 "dryRun": null,
 "gracePeriodSeconds": 5,
 "kind": null,
 "orphanDependents": null,
 "preconditions": null,
 "propagationPolicy": null
 }
 }
 }
}

Example Policy

This example policy requires Delete Manifest stages to provide a minimum 2 minute grace period when run in production.

package spinnaker.execution.stages.before.deleteManifest

productionAccounts :=["prod1","prod2"]

deny["deletions in production accounts must allow a minimum of 2 minutes for graceful shutdown."]{
 input.deploy.account==productionAccounts[_]
 input.deploy.options.gracePeriodSeconds<120
}

Keys

Key	Type	Description
`input.deploy.account`	`string`	The account being deployed to.
`input.deploy.credentials`	`string`	The credentials to use to access the account.
`input.deploy.labelSelectors.empty`	`boolean`
`input.deploy.labelSelectors.notEmpty`	`boolean`
`input.deploy.location`	`string`	The name of the namespace from which the manifest is being deleted.
`input.deploy.manifestName`	`string`	The name of the manifest being deleted.
`input.deploy.options.apiVersion`	`string`	The API version in which the manifest’s kind is defined.
`input.deploy.options.dryRun`	`boolean`	If true then the manifest is not actually deleted. if false it is.
`input.deploy.options.gracePeriodSeconds`	`number`	How many seconds the resource being deleted is given to shut down gracefully before being forcefully shut down.
`input.deploy.options.kind`	`string`	What is the kind of manifest that is being deleted.
`input.deploy.options.orphanDependents`		When set, delete all resources managed by this resource as well (all pods owned by a replica set). When unset, this may orphan resources.
`input.deploy.options.preconditions`
`input.deploy.options.propagationPolicy`		There are three different ways to delete a Kubernetes object: Foreground: The object itself cannot be deleted unless the objects that it owns have already been deleted. Background: The object itself is deleted, then the objects that it owned are automatically deleted. Orphan: The object itself is deleted. Any objects it owns are “orphaned.”

Plugins: spinnaker.execution.stages.before.deployManifest

Mon, 01 Jan 0001 00:00:00 +0000

See Deploy Applications to Kubernetes for more information on this stage.

Example Payload

Click to expand

{
 "input": {
 "pipeline": {
 "application": "hostname",
 "authentication": {
 "allowedAccounts": [
 "spinnaker",
 "staging",
 "staging-ecs"
 ],
 "user": "myUserName"
 },
 "buildTime": 1620752502018,
 "canceled": false,
 "canceledBy": null,
 "cancellationReason": null,
 "description": "Deploy manifest",
 "endTime": null,
 "id": "01F5E61382GF88N6R7JFBA9XA2",
 "initialConfig": {},
 "keepWaitingPipelines": false,
 "limitConcurrent": false,
 "name": null,
 "notifications": [],
 "origin": "unknown",
 "partition": null,
 "paused": null,
 "pipelineConfigId": null,
 "source": null,
 "spelEvaluator": null,
 "stages": [
 "01F5E613827GH96PMBS5PJVE50"
 ],
 "startTime": 1620752502041,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "systemNotifications": [],
 "templateVariables": null,
 "trigger": {
 "artifacts": [],
 "correlationId": null,
 "isDryRun": false,
 "isRebake": false,
 "isStrategy": false,
 "notifications": [],
 "other": {
 "artifacts": [],
 "dryRun": false,
 "expectedArtifacts": [],
 "notifications": [],
 "parameters": {},
 "rebake": false,
 "resolvedExpectedArtifacts": [],
 "strategy": false,
 "type": "manual",
 "user": "myUserName"
 },
 "parameters": {},
 "resolvedExpectedArtifacts": [],
 "type": "manual",
 "user": "myUserName"
 },
 "type": "ORCHESTRATION"
 },
 "stage": {
 "context": {
 "account": "spinnaker",
 "artifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname",
 "reference": "hostname",
 "type": "kubernetes/deployment",
 "version": ""
 }
 ],
 "cloudProvider": "kubernetes",
 "deploy.account.name": "spinnaker",
 "deploy.server.groups": {},
 "failedManifests": [],
 "kato.last.task.id": {
 "id": "63e8305c-2251-4a83-9509-b8f5b3143cb3"
 },
 "kato.result.expected": true,
 "kato.task.firstNotFoundRetry": -1,
 "kato.task.lastStatus": "SUCCEEDED",
 "kato.task.notFoundRetryCount": 0,
 "kato.task.terminalRetryCount": 0,
 "kato.tasks": [
 {
 "history": [
 {
 "phase": "ORCHESTRATION",
 "status": "Initializing Orchestration Task"
 },
 {
 "phase": "ORCHESTRATION",
 "status": "Processing op: KubernetesDeployManifestOperation"
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Beginning deployment of manifest..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Swapping out artifacts in deployment hostname from context..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Finding deployer for deployment..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Checking if all requested artifacts were bound..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Sorting manifests by priority..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Deploy order is: deployment hostname"
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Finding deployer for deployment..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Annotating manifest deployment hostname with artifact, relationships & moniker..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Swapping out artifacts in deployment hostname from other deployments..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Submitting manifest deployment hostname to kubernetes master..."
 },
 {
 "phase": "DEPLOY_KUBERNETES_MANIFEST",
 "status": "Deploy manifest task completed successfully."
 },
 {
 "phase": "ORCHESTRATION",
 "status": "Orchestration completed."
 }
 ],
 "id": "63e8305c-2251-4a83-9509-b8f5b3143cb3",
 "resultObjects": [
 {
 "boundArtifacts": [],
 "createdArtifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname",
 "reference": "hostname",
 "type": "kubernetes/deployment",
 "version": ""
 }
 ],
 "manifestNamesByNamespace": {
 "staging": [
 "deployment hostname"
 ]
 },
 "manifests": [
 {
 "apiVersion": "apps/v1",
 "kind": "Deployment",
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "deployment.kubernetes.io/revision": "4",
 "kubectl.kubernetes.io/last-applied-configuration": "{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"annotations\":{\"artifact.spinnaker.io/location\":\"staging\",\"artifact.spinnaker.io/name\":\"hostname\",\"artifact.spinnaker.io/type\":\"kubernetes/deployment\",\"artifact.spinnaker.io/version\":\"\",\"moniker.spinnaker.io/application\":\"hostname\",\"moniker.spinnaker.io/cluster\":\"deployment hostname\"},\"labels\":{\"app.kubernetes.io/managed-by\":\"spinnaker\",\"app.kubernetes.io/name\":\"hostname\"},\"name\":\"hostname\",\"namespace\":\"staging\"},\"spec\":{\"replicas\":4,\"selector\":{\"matchLabels\":{\"app\":\"hostname\",\"version\":\"v1\"}},\"strategy\":{\"rollingUpdate\":{\"maxSurge\":1,\"maxUnavailable\":1},\"type\":\"RollingUpdate\"},\"template\":{\"metadata\":{\"annotations\":{\"artifact.spinnaker.io/location\":\"staging\",\"artifact.spinnaker.io/name\":\"hostname\",\"artifact.spinnaker.io/type\":\"kubernetes/deployment\",\"artifact.spinnaker.io/version\":\"\",\"moniker.spinnaker.io/application\":\"hostname\",\"moniker.spinnaker.io/cluster\":\"deployment hostname\",\"prometheus.io/port\":\"9113\",\"prometheus.io/scrape\":\"true\"},\"labels\":{\"app\":\"hostname\",\"app.kubernetes.io/managed-by\":\"spinnaker\",\"app.kubernetes.io/name\":\"hostname\",\"version\":\"v1\"}},\"spec\":{\"containers\":[{\"image\":\"rstarmer/hostname:v1\",\"imagePullPolicy\":\"Always\",\"name\":\"hostname\",\"resources\":{},\"volumeMounts\":[{\"mountPath\":\"/etc/nginx/conf.d/nginx-status.conf\",\"name\":\"nginx-status-conf\",\"readOnly\":true,\"subPath\":\"nginx.status.conf\"}]},{\"args\":[\"-nginx.scrape-uri=http://localhost:8090/nginx_status\"],\"image\":\"nginx/nginx-prometheus-exporter:0.3.0\",\"imagePullPolicy\":\"Always\",\"name\":\"nginx-exporter\",\"ports\":[{\"containerPort\":9113,\"name\":\"nginx-ex-port\",\"protocol\":\"TCP\"}]}],\"restartPolicy\":\"Always\",\"volumes\":[{\"configMap\":{\"defaultMode\":420,\"name\":\"nginx-status-conf-v000\"},\"name\":\"nginx-status-conf\"}]}}}}\n",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname"
 },
 "creationTimestamp": "2021-04-30T21:19:15Z",
 "generation": 11,
 "labels": {
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname"
 },
 "managedFields": [
 {
 "apiVersion": "apps/v1",
 "fieldsType": "FieldsV1",
 "fieldsV1": {
 "f:metadata": {
 "f:annotations": {
 ".": {},
 "f:artifact.spinnaker.io/location": {},
 "f:artifact.spinnaker.io/name": {},
 "f:artifact.spinnaker.io/type": {},
 "f:artifact.spinnaker.io/version": {},
 "f:kubectl.kubernetes.io/last-applied-configuration": {},
 "f:moniker.spinnaker.io/application": {},
 "f:moniker.spinnaker.io/cluster": {}
 },
 "f:labels": {
 ".": {},
 "f:app.kubernetes.io/managed-by": {},
 "f:app.kubernetes.io/name": {}
 }
 },
 "f:spec": {
 "f:progressDeadlineSeconds": {},
 "f:replicas": {},
 "f:revisionHistoryLimit": {},
 "f:selector": {
 "f:matchLabels": {
 ".": {},
 "f:app": {},
 "f:version": {}
 }
 },
 "f:strategy": {
 "f:rollingUpdate": {
 ".": {},
 "f:maxSurge": {},
 "f:maxUnavailable": {}
 },
 "f:type": {}
 },
 "f:template": {
 "f:metadata": {
 "f:annotations": {
 ".": {},
 "f:artifact.spinnaker.io/location": {},
 "f:artifact.spinnaker.io/name": {},
 "f:artifact.spinnaker.io/type": {},
 "f:artifact.spinnaker.io/version": {},
 "f:moniker.spinnaker.io/application": {},
 "f:moniker.spinnaker.io/cluster": {},
 "f:prometheus.io/port": {},
 "f:prometheus.io/scrape": {}
 },
 "f:labels": {
 ".": {},
 "f:app": {},
 "f:app.kubernetes.io/managed-by": {},
 "f:app.kubernetes.io/name": {},
 "f:version": {}
 }
 },
 "f:spec": {
 "f:containers": {
 "k:{\"name\":\"hostname\"}": {
 ".": {},
 "f:image": {},
 "f:imagePullPolicy": {},
 "f:name": {},
 "f:resources": {},
 "f:terminationMessagePath": {},
 "f:terminationMessagePolicy": {},
 "f:volumeMounts": {
 ".": {},
 "k:{\"mountPath\":\"/etc/nginx/conf.d/nginx-status.conf\"}": {
 ".": {},
 "f:mountPath": {},
 "f:name": {},
 "f:readOnly": {},
 "f:subPath": {}
 }
 }
 },
 "k:{\"name\":\"nginx-exporter\"}": {
 ".": {},
 "f:args": {},
 "f:image": {},
 "f:imagePullPolicy": {},
 "f:name": {},
 "f:ports": {
 ".": {},
 "k:{\"containerPort\":9113,\"protocol\":\"TCP\"}": {
 ".": {},
 "f:containerPort": {},
 "f:name": {},
 "f:protocol": {}
 }
 },
 "f:resources": {},
 "f:terminationMessagePath": {},
 "f:terminationMessagePolicy": {}
 }
 },
 "f:dnsPolicy": {},
 "f:restartPolicy": {},
 "f:schedulerName": {},
 "f:securityContext": {},
 "f:terminationGracePeriodSeconds": {},
 "f:volumes": {
 ".": {},
 "k:{\"name\":\"nginx-status-conf\"}": {
 ".": {},
 "f:configMap": {
 ".": {},
 "f:defaultMode": {},
 "f:name": {}
 },
 "f:name": {}
 }
 }
 }
 }
 }
 },
 "manager": "kubectl",
 "operation": "Update",
 "time": "2021-04-30T21:19:15Z"
 },
 {
 "apiVersion": "apps/v1",
 "fieldsType": "FieldsV1",
 "fieldsV1": {
 "f:metadata": {
 "f:annotations": {
 "f:deployment.kubernetes.io/revision": {}
 }
 },
 "f:status": {
 "f:availableReplicas": {},
 "f:conditions": {
 ".": {},
 "k:{\"type\":\"Available\"}": {
 ".": {},
 "f:lastTransitionTime": {},
 "f:lastUpdateTime": {},
 "f:message": {},
 "f:reason": {},
 "f:status": {},
 "f:type": {}
 },
 "k:{\"type\":\"Progressing\"}": {
 ".": {},
 "f:lastTransitionTime": {},
 "f:lastUpdateTime": {},
 "f:message": {},
 "f:reason": {},
 "f:status": {},
 "f:type": {}
 }
 },
 "f:observedGeneration": {},
 "f:readyReplicas": {},
 "f:replicas": {},
 "f:updatedReplicas": {}
 }
 },
 "manager": "kube-controller-manager",
 "operation": "Update",
 "time": "2021-05-07T22:39:40Z"
 }
 ],
 "name": "hostname",
 "namespace": "staging",
 "resourceVersion": "25266763",
 "selfLink": "/apis/apps/v1/namespaces/staging/deployments/hostname",
 "uid": "e1d20734-60ea-44a0-a830-168f001b482f"
 },
 "spec": {
 "progressDeadlineSeconds": 600,
 "replicas": 4,
 "revisionHistoryLimit": 10,
 "selector": {
 "matchLabels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "strategy": {
 "rollingUpdate": {
 "maxSurge": 1,
 "maxUnavailable": 1
 },
 "type": "RollingUpdate"
 },
 "template": {
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname",
 "prometheus.io/port": "9113",
 "prometheus.io/scrape": "true"
 },
 "labels": {
 "app": "hostname",
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname",
 "version": "v1"
 }
 },
 "spec": {
 "containers": [
 {
 "image": "rstarmer/hostname:v1",
 "imagePullPolicy": "Always",
 "name": "hostname",
 "resources": {},
 "terminationMessagePath": "/dev/termination-log",
 "terminationMessagePolicy": "File",
 "volumeMounts": [
 {
 "mountPath": "/etc/nginx/conf.d/nginx-status.conf",
 "name": "nginx-status-conf",
 "readOnly": true,
 "subPath": "nginx.status.conf"
 }
 ]
 },
 {
 "args": [
 "-nginx.scrape-uri=http://localhost:8090/nginx_status"
 ],
 "image": "nginx/nginx-prometheus-exporter:0.3.0",
 "imagePullPolicy": "Always",
 "name": "nginx-exporter",
 "ports": [
 {
 "containerPort": 9113,
 "name": "nginx-ex-port",
 "protocol": "TCP"
 }
 ],
 "resources": {},
 "terminationMessagePath": "/dev/termination-log",
 "terminationMessagePolicy": "File"
 }
 ],
 "dnsPolicy": "ClusterFirst",
 "restartPolicy": "Always",
 "schedulerName": "default-scheduler",
 "securityContext": {},
 "terminationGracePeriodSeconds": 30,
 "volumes": [
 {
 "configMap": {
 "defaultMode": 420,
 "name": "nginx-status-conf-v000"
 },
 "name": "nginx-status-conf"
 }
 ]
 }
 }
 },
 "status": {
 "availableReplicas": 10,
 "conditions": [
 {
 "lastTransitionTime": "2021-04-30T21:19:15Z",
 "lastUpdateTime": "2021-05-07T20:39:03Z",
 "message": "ReplicaSet \"hostname-f5b957cc\" has successfully progressed.",
 "reason": "NewReplicaSetAvailable",
 "status": "True",
 "type": "Progressing"
 },
 {
 "lastTransitionTime": "2021-05-07T22:39:40Z",
 "lastUpdateTime": "2021-05-07T22:39:40Z",
 "message": "Deployment has minimum availability.",
 "reason": "MinimumReplicasAvailable",
 "status": "True",
 "type": "Available"
 }
 ],
 "observedGeneration": 10,
 "readyReplicas": 10,
 "replicas": 10,
 "updatedReplicas": 10
 }
 }
 ]
 }
 ],
 "status": {
 "completed": true,
 "failed": false,
 "retryable": false
 }
 }
 ],
 "manifestArtifactAccount": "embedded-artifact",
 "manifests": [
 {
 "apiVersion": "apps/v1",
 "kind": "Deployment",
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname"
 },
 "labels": {
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname"
 },
 "name": "hostname",
 "namespace": "staging"
 },
 "spec": {
 "replicas": 4,
 "selector": {
 "matchLabels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "strategy": {
 "rollingUpdate": {
 "maxSurge": 1,
 "maxUnavailable": 1
 },
 "type": "RollingUpdate"
 },
 "template": {
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname",
 "prometheus.io/port": "9113",
 "prometheus.io/scrape": "true"
 },
 "labels": {
 "app": "hostname",
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname",
 "version": "v1"
 }
 },
 "spec": {
 "containers": [
 {
 "image": "rstarmer/hostname:v1",
 "imagePullPolicy": "Always",
 "name": "hostname",
 "resources": {},
 "volumeMounts": [
 {
 "mountPath": "/etc/nginx/conf.d/nginx-status.conf",
 "name": "nginx-status-conf",
 "readOnly": true,
 "subPath": "nginx.status.conf"
 }
 ]
 },
 {
 "args": [
 "-nginx.scrape-uri=http://localhost:8090/nginx_status"
 ],
 "image": "nginx/nginx-prometheus-exporter:0.3.0",
 "imagePullPolicy": "Always",
 "name": "nginx-exporter",
 "ports": [
 {
 "containerPort": 9113,
 "name": "nginx-ex-port",
 "protocol": "TCP"
 }
 ]
 }
 ],
 "restartPolicy": "Always",
 "volumes": [
 {
 "configMap": {
 "defaultMode": 420,
 "name": "nginx-status-conf-v000"
 },
 "name": "nginx-status-conf"
 }
 ]
 }
 }
 }
 }
 ],
 "messages": [],
 "moniker": {
 "app": "hostname",
 "cluster": "deployment hostname"
 },
 "optionalArtifacts": [],
 "outputs.boundArtifacts": [],
 "outputs.createdArtifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname",
 "reference": "hostname",
 "type": "kubernetes/deployment",
 "version": ""
 }
 ],
 "outputs.manifestNamesByNamespace": {
 "staging": [
 "deployment hostname"
 ]
 },
 "outputs.manifests": [
 {
 "apiVersion": "apps/v1",
 "kind": "Deployment",
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "deployment.kubernetes.io/revision": "4",
 "kubectl.kubernetes.io/last-applied-configuration": "{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"annotations\":{\"artifact.spinnaker.io/location\":\"staging\",\"artifact.spinnaker.io/name\":\"hostname\",\"artifact.spinnaker.io/type\":\"kubernetes/deployment\",\"artifact.spinnaker.io/version\":\"\",\"moniker.spinnaker.io/application\":\"hostname\",\"moniker.spinnaker.io/cluster\":\"deployment hostname\"},\"labels\":{\"app.kubernetes.io/managed-by\":\"spinnaker\",\"app.kubernetes.io/name\":\"hostname\"},\"name\":\"hostname\",\"namespace\":\"staging\"},\"spec\":{\"replicas\":4,\"selector\":{\"matchLabels\":{\"app\":\"hostname\",\"version\":\"v1\"}},\"strategy\":{\"rollingUpdate\":{\"maxSurge\":1,\"maxUnavailable\":1},\"type\":\"RollingUpdate\"},\"template\":{\"metadata\":{\"annotations\":{\"artifact.spinnaker.io/location\":\"staging\",\"artifact.spinnaker.io/name\":\"hostname\",\"artifact.spinnaker.io/type\":\"kubernetes/deployment\",\"artifact.spinnaker.io/version\":\"\",\"moniker.spinnaker.io/application\":\"hostname\",\"moniker.spinnaker.io/cluster\":\"deployment hostname\",\"prometheus.io/port\":\"9113\",\"prometheus.io/scrape\":\"true\"},\"labels\":{\"app\":\"hostname\",\"app.kubernetes.io/managed-by\":\"spinnaker\",\"app.kubernetes.io/name\":\"hostname\",\"version\":\"v1\"}},\"spec\":{\"containers\":[{\"image\":\"rstarmer/hostname:v1\",\"imagePullPolicy\":\"Always\",\"name\":\"hostname\",\"resources\":{},\"volumeMounts\":[{\"mountPath\":\"/etc/nginx/conf.d/nginx-status.conf\",\"name\":\"nginx-status-conf\",\"readOnly\":true,\"subPath\":\"nginx.status.conf\"}]},{\"args\":[\"-nginx.scrape-uri=http://localhost:8090/nginx_status\"],\"image\":\"nginx/nginx-prometheus-exporter:0.3.0\",\"imagePullPolicy\":\"Always\",\"name\":\"nginx-exporter\",\"ports\":[{\"containerPort\":9113,\"name\":\"nginx-ex-port\",\"protocol\":\"TCP\"}]}],\"restartPolicy\":\"Always\",\"volumes\":[{\"configMap\":{\"defaultMode\":420,\"name\":\"nginx-status-conf-v000\"},\"name\":\"nginx-status-conf\"}]}}}}\n",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname"
 },
 "creationTimestamp": "2021-04-30T21:19:15Z",
 "generation": 11,
 "labels": {
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname"
 },
 "managedFields": [
 {
 "apiVersion": "apps/v1",
 "fieldsType": "FieldsV1",
 "fieldsV1": {
 "f:metadata": {
 "f:annotations": {
 ".": {},
 "f:artifact.spinnaker.io/location": {},
 "f:artifact.spinnaker.io/name": {},
 "f:artifact.spinnaker.io/type": {},
 "f:artifact.spinnaker.io/version": {},
 "f:kubectl.kubernetes.io/last-applied-configuration": {},
 "f:moniker.spinnaker.io/application": {},
 "f:moniker.spinnaker.io/cluster": {}
 },
 "f:labels": {
 ".": {},
 "f:app.kubernetes.io/managed-by": {},
 "f:app.kubernetes.io/name": {}
 }
 },
 "f:spec": {
 "f:progressDeadlineSeconds": {},
 "f:replicas": {},
 "f:revisionHistoryLimit": {},
 "f:selector": {
 "f:matchLabels": {
 ".": {},
 "f:app": {},
 "f:version": {}
 }
 },
 "f:strategy": {
 "f:rollingUpdate": {
 ".": {},
 "f:maxSurge": {},
 "f:maxUnavailable": {}
 },
 "f:type": {}
 },
 "f:template": {
 "f:metadata": {
 "f:annotations": {
 ".": {},
 "f:artifact.spinnaker.io/location": {},
 "f:artifact.spinnaker.io/name": {},
 "f:artifact.spinnaker.io/type": {},
 "f:artifact.spinnaker.io/version": {},
 "f:moniker.spinnaker.io/application": {},
 "f:moniker.spinnaker.io/cluster": {},
 "f:prometheus.io/port": {},
 "f:prometheus.io/scrape": {}
 },
 "f:labels": {
 ".": {},
 "f:app": {},
 "f:app.kubernetes.io/managed-by": {},
 "f:app.kubernetes.io/name": {},
 "f:version": {}
 }
 },
 "f:spec": {
 "f:containers": {
 "k:{\"name\":\"hostname\"}": {
 ".": {},
 "f:image": {},
 "f:imagePullPolicy": {},
 "f:name": {},
 "f:resources": {},
 "f:terminationMessagePath": {},
 "f:terminationMessagePolicy": {},
 "f:volumeMounts": {
 ".": {},
 "k:{\"mountPath\":\"/etc/nginx/conf.d/nginx-status.conf\"}": {
 ".": {},
 "f:mountPath": {},
 "f:name": {},
 "f:readOnly": {},
 "f:subPath": {}
 }
 }
 },
 "k:{\"name\":\"nginx-exporter\"}": {
 ".": {},
 "f:args": {},
 "f:image": {},
 "f:imagePullPolicy": {},
 "f:name": {},
 "f:ports": {
 ".": {},
 "k:{\"containerPort\":9113,\"protocol\":\"TCP\"}": {
 ".": {},
 "f:containerPort": {},
 "f:name": {},
 "f:protocol": {}
 }
 },
 "f:resources": {},
 "f:terminationMessagePath": {},
 "f:terminationMessagePolicy": {}
 }
 },
 "f:dnsPolicy": {},
 "f:restartPolicy": {},
 "f:schedulerName": {},
 "f:securityContext": {},
 "f:terminationGracePeriodSeconds": {},
 "f:volumes": {
 ".": {},
 "k:{\"name\":\"nginx-status-conf\"}": {
 ".": {},
 "f:configMap": {
 ".": {},
 "f:defaultMode": {},
 "f:name": {}
 },
 "f:name": {}
 }
 }
 }
 }
 }
 },
 "manager": "kubectl",
 "operation": "Update",
 "time": "2021-04-30T21:19:15Z"
 },
 {
 "apiVersion": "apps/v1",
 "fieldsType": "FieldsV1",
 "fieldsV1": {
 "f:metadata": {
 "f:annotations": {
 "f:deployment.kubernetes.io/revision": {}
 }
 },
 "f:status": {
 "f:availableReplicas": {},
 "f:conditions": {
 ".": {},
 "k:{\"type\":\"Available\"}": {
 ".": {},
 "f:lastTransitionTime": {},
 "f:lastUpdateTime": {},
 "f:message": {},
 "f:reason": {},
 "f:status": {},
 "f:type": {}
 },
 "k:{\"type\":\"Progressing\"}": {
 ".": {},
 "f:lastTransitionTime": {},
 "f:lastUpdateTime": {},
 "f:message": {},
 "f:reason": {},
 "f:status": {},
 "f:type": {}
 }
 },
 "f:observedGeneration": {},
 "f:readyReplicas": {},
 "f:replicas": {},
 "f:updatedReplicas": {}
 }
 },
 "manager": "kube-controller-manager",
 "operation": "Update",
 "time": "2021-05-07T22:39:40Z"
 }
 ],
 "name": "hostname",
 "namespace": "staging",
 "resourceVersion": "25266763",
 "selfLink": "/apis/apps/v1/namespaces/staging/deployments/hostname",
 "uid": "e1d20734-60ea-44a0-a830-168f001b482f"
 },
 "spec": {
 "progressDeadlineSeconds": 600,
 "replicas": 4,
 "revisionHistoryLimit": 10,
 "selector": {
 "matchLabels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "strategy": {
 "rollingUpdate": {
 "maxSurge": 1,
 "maxUnavailable": 1
 },
 "type": "RollingUpdate"
 },
 "template": {
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname",
 "prometheus.io/port": "9113",
 "prometheus.io/scrape": "true"
 },
 "labels": {
 "app": "hostname",
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname",
 "version": "v1"
 }
 },
 "spec": {
 "containers": [
 {
 "image": "rstarmer/hostname:v1",
 "imagePullPolicy": "Always",
 "name": "hostname",
 "resources": {},
 "terminationMessagePath": "/dev/termination-log",
 "terminationMessagePolicy": "File",
 "volumeMounts": [
 {
 "mountPath": "/etc/nginx/conf.d/nginx-status.conf",
 "name": "nginx-status-conf",
 "readOnly": true,
 "subPath": "nginx.status.conf"
 }
 ]
 },
 {
 "args": [
 "-nginx.scrape-uri=http://localhost:8090/nginx_status"
 ],
 "image": "nginx/nginx-prometheus-exporter:0.3.0",
 "imagePullPolicy": "Always",
 "name": "nginx-exporter",
 "ports": [
 {
 "containerPort": 9113,
 "name": "nginx-ex-port",
 "protocol": "TCP"
 }
 ],
 "resources": {},
 "terminationMessagePath": "/dev/termination-log",
 "terminationMessagePolicy": "File"
 }
 ],
 "dnsPolicy": "ClusterFirst",
 "restartPolicy": "Always",
 "schedulerName": "default-scheduler",
 "securityContext": {},
 "terminationGracePeriodSeconds": 30,
 "volumes": [
 {
 "configMap": {
 "defaultMode": 420,
 "name": "nginx-status-conf-v000"
 },
 "name": "nginx-status-conf"
 }
 ]
 }
 }
 },
 "status": {
 "availableReplicas": 10,
 "conditions": [
 {
 "lastTransitionTime": "2021-04-30T21:19:15Z",
 "lastUpdateTime": "2021-05-07T20:39:03Z",
 "message": "ReplicaSet \"hostname-f5b957cc\" has successfully progressed.",
 "reason": "NewReplicaSetAvailable",
 "status": "True",
 "type": "Progressing"
 },
 {
 "lastTransitionTime": "2021-05-07T22:39:40Z",
 "lastUpdateTime": "2021-05-07T22:39:40Z",
 "message": "Deployment has minimum availability.",
 "reason": "MinimumReplicasAvailable",
 "status": "True",
 "type": "Available"
 }
 ],
 "observedGeneration": 10,
 "readyReplicas": 10,
 "replicas": 10,
 "updatedReplicas": 10
 }
 }
 ],
 "relationships": {
 "loadBalancers": [],
 "securityGroups": []
 },
 "requiredArtifacts": [],
 "source": "text",
 "stableManifests": [
 {
 "location": "staging",
 "manifestName": "deployment hostname"
 }
 ],
 "user": "myUserName"
 },
 "endTime": null,
 "id": "01F5E613827GH96PMBS5PJVE50",
 "lastModified": null,
 "name": "deployManifest",
 "outputs": {
 "artifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname",
 "reference": "hostname",
 "type": "kubernetes/deployment",
 "version": ""
 }
 ],
 "manifests": [
 {
 "apiVersion": "apps/v1",
 "kind": "Deployment",
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname"
 },
 "labels": {
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname"
 },
 "name": "hostname",
 "namespace": "staging"
 },
 "spec": {
 "replicas": 4,
 "selector": {
 "matchLabels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "strategy": {
 "rollingUpdate": {
 "maxSurge": 1,
 "maxUnavailable": 1
 },
 "type": "RollingUpdate"
 },
 "template": {
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname",
 "prometheus.io/port": "9113",
 "prometheus.io/scrape": "true"
 },
 "labels": {
 "app": "hostname",
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname",
 "version": "v1"
 }
 },
 "spec": {
 "containers": [
 {
 "image": "rstarmer/hostname:v1",
 "imagePullPolicy": "Always",
 "name": "hostname",
 "resources": {},
 "volumeMounts": [
 {
 "mountPath": "/etc/nginx/conf.d/nginx-status.conf",
 "name": "nginx-status-conf",
 "readOnly": true,
 "subPath": "nginx.status.conf"
 }
 ]
 },
 {
 "args": [
 "-nginx.scrape-uri=http://localhost:8090/nginx_status"
 ],
 "image": "nginx/nginx-prometheus-exporter:0.3.0",
 "imagePullPolicy": "Always",
 "name": "nginx-exporter",
 "ports": [
 {
 "containerPort": 9113,
 "name": "nginx-ex-port",
 "protocol": "TCP"
 }
 ]
 }
 ],
 "restartPolicy": "Always",
 "volumes": [
 {
 "configMap": {
 "defaultMode": 420,
 "name": "nginx-status-conf-v000"
 },
 "name": "nginx-status-conf"
 }
 ]
 }
 }
 }
 }
 ],
 "optionalArtifacts": [],
 "outputs.boundArtifacts": [],
 "outputs.createdArtifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname",
 "reference": "hostname",
 "type": "kubernetes/deployment",
 "version": ""
 }
 ],
 "outputs.manifestNamesByNamespace": {
 "staging": [
 "deployment hostname"
 ]
 },
 "outputs.manifests": [
 {
 "apiVersion": "apps/v1",
 "kind": "Deployment",
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "deployment.kubernetes.io/revision": "4",
 "kubectl.kubernetes.io/last-applied-configuration": "{\"apiVersion\":\"apps/v1\",\"kind\":\"Deployment\",\"metadata\":{\"annotations\":{\"artifact.spinnaker.io/location\":\"staging\",\"artifact.spinnaker.io/name\":\"hostname\",\"artifact.spinnaker.io/type\":\"kubernetes/deployment\",\"artifact.spinnaker.io/version\":\"\",\"moniker.spinnaker.io/application\":\"hostname\",\"moniker.spinnaker.io/cluster\":\"deployment hostname\"},\"labels\":{\"app.kubernetes.io/managed-by\":\"spinnaker\",\"app.kubernetes.io/name\":\"hostname\"},\"name\":\"hostname\",\"namespace\":\"staging\"},\"spec\":{\"replicas\":4,\"selector\":{\"matchLabels\":{\"app\":\"hostname\",\"version\":\"v1\"}},\"strategy\":{\"rollingUpdate\":{\"maxSurge\":1,\"maxUnavailable\":1},\"type\":\"RollingUpdate\"},\"template\":{\"metadata\":{\"annotations\":{\"artifact.spinnaker.io/location\":\"staging\",\"artifact.spinnaker.io/name\":\"hostname\",\"artifact.spinnaker.io/type\":\"kubernetes/deployment\",\"artifact.spinnaker.io/version\":\"\",\"moniker.spinnaker.io/application\":\"hostname\",\"moniker.spinnaker.io/cluster\":\"deployment hostname\",\"prometheus.io/port\":\"9113\",\"prometheus.io/scrape\":\"true\"},\"labels\":{\"app\":\"hostname\",\"app.kubernetes.io/managed-by\":\"spinnaker\",\"app.kubernetes.io/name\":\"hostname\",\"version\":\"v1\"}},\"spec\":{\"containers\":[{\"image\":\"rstarmer/hostname:v1\",\"imagePullPolicy\":\"Always\",\"name\":\"hostname\",\"resources\":{},\"volumeMounts\":[{\"mountPath\":\"/etc/nginx/conf.d/nginx-status.conf\",\"name\":\"nginx-status-conf\",\"readOnly\":true,\"subPath\":\"nginx.status.conf\"}]},{\"args\":[\"-nginx.scrape-uri=http://localhost:8090/nginx_status\"],\"image\":\"nginx/nginx-prometheus-exporter:0.3.0\",\"imagePullPolicy\":\"Always\",\"name\":\"nginx-exporter\",\"ports\":[{\"containerPort\":9113,\"name\":\"nginx-ex-port\",\"protocol\":\"TCP\"}]}],\"restartPolicy\":\"Always\",\"volumes\":[{\"configMap\":{\"defaultMode\":420,\"name\":\"nginx-status-conf-v000\"},\"name\":\"nginx-status-conf\"}]}}}}\n",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname"
 },
 "creationTimestamp": "2021-04-30T21:19:15Z",
 "generation": 11,
 "labels": {
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname"
 },
 "managedFields": [
 {
 "apiVersion": "apps/v1",
 "fieldsType": "FieldsV1",
 "fieldsV1": {
 "f:metadata": {
 "f:annotations": {
 ".": {},
 "f:artifact.spinnaker.io/location": {},
 "f:artifact.spinnaker.io/name": {},
 "f:artifact.spinnaker.io/type": {},
 "f:artifact.spinnaker.io/version": {},
 "f:kubectl.kubernetes.io/last-applied-configuration": {},
 "f:moniker.spinnaker.io/application": {},
 "f:moniker.spinnaker.io/cluster": {}
 },
 "f:labels": {
 ".": {},
 "f:app.kubernetes.io/managed-by": {},
 "f:app.kubernetes.io/name": {}
 }
 },
 "f:spec": {
 "f:progressDeadlineSeconds": {},
 "f:replicas": {},
 "f:revisionHistoryLimit": {},
 "f:selector": {
 "f:matchLabels": {
 ".": {},
 "f:app": {},
 "f:version": {}
 }
 },
 "f:strategy": {
 "f:rollingUpdate": {
 ".": {},
 "f:maxSurge": {},
 "f:maxUnavailable": {}
 },
 "f:type": {}
 },
 "f:template": {
 "f:metadata": {
 "f:annotations": {
 ".": {},
 "f:artifact.spinnaker.io/location": {},
 "f:artifact.spinnaker.io/name": {},
 "f:artifact.spinnaker.io/type": {},
 "f:artifact.spinnaker.io/version": {},
 "f:moniker.spinnaker.io/application": {},
 "f:moniker.spinnaker.io/cluster": {},
 "f:prometheus.io/port": {},
 "f:prometheus.io/scrape": {}
 },
 "f:labels": {
 ".": {},
 "f:app": {},
 "f:app.kubernetes.io/managed-by": {},
 "f:app.kubernetes.io/name": {},
 "f:version": {}
 }
 },
 "f:spec": {
 "f:containers": {
 "k:{\"name\":\"hostname\"}": {
 ".": {},
 "f:image": {},
 "f:imagePullPolicy": {},
 "f:name": {},
 "f:resources": {},
 "f:terminationMessagePath": {},
 "f:terminationMessagePolicy": {},
 "f:volumeMounts": {
 ".": {},
 "k:{\"mountPath\":\"/etc/nginx/conf.d/nginx-status.conf\"}": {
 ".": {},
 "f:mountPath": {},
 "f:name": {},
 "f:readOnly": {},
 "f:subPath": {}
 }
 }
 },
 "k:{\"name\":\"nginx-exporter\"}": {
 ".": {},
 "f:args": {},
 "f:image": {},
 "f:imagePullPolicy": {},
 "f:name": {},
 "f:ports": {
 ".": {},
 "k:{\"containerPort\":9113,\"protocol\":\"TCP\"}": {
 ".": {},
 "f:containerPort": {},
 "f:name": {},
 "f:protocol": {}
 }
 },
 "f:resources": {},
 "f:terminationMessagePath": {},
 "f:terminationMessagePolicy": {}
 }
 },
 "f:dnsPolicy": {},
 "f:restartPolicy": {},
 "f:schedulerName": {},
 "f:securityContext": {},
 "f:terminationGracePeriodSeconds": {},
 "f:volumes": {
 ".": {},
 "k:{\"name\":\"nginx-status-conf\"}": {
 ".": {},
 "f:configMap": {
 ".": {},
 "f:defaultMode": {},
 "f:name": {}
 },
 "f:name": {}
 }
 }
 }
 }
 }
 },
 "manager": "kubectl",
 "operation": "Update",
 "time": "2021-04-30T21:19:15Z"
 },
 {
 "apiVersion": "apps/v1",
 "fieldsType": "FieldsV1",
 "fieldsV1": {
 "f:metadata": {
 "f:annotations": {
 "f:deployment.kubernetes.io/revision": {}
 }
 },
 "f:status": {
 "f:availableReplicas": {},
 "f:conditions": {
 ".": {},
 "k:{\"type\":\"Available\"}": {
 ".": {},
 "f:lastTransitionTime": {},
 "f:lastUpdateTime": {},
 "f:message": {},
 "f:reason": {},
 "f:status": {},
 "f:type": {}
 },
 "k:{\"type\":\"Progressing\"}": {
 ".": {},
 "f:lastTransitionTime": {},
 "f:lastUpdateTime": {},
 "f:message": {},
 "f:reason": {},
 "f:status": {},
 "f:type": {}
 }
 },
 "f:observedGeneration": {},
 "f:readyReplicas": {},
 "f:replicas": {},
 "f:updatedReplicas": {}
 }
 },
 "manager": "kube-controller-manager",
 "operation": "Update",
 "time": "2021-05-07T22:39:40Z"
 }
 ],
 "name": "hostname",
 "namespace": "staging",
 "resourceVersion": "25266763",
 "selfLink": "/apis/apps/v1/namespaces/staging/deployments/hostname",
 "uid": "e1d20734-60ea-44a0-a830-168f001b482f"
 },
 "spec": {
 "progressDeadlineSeconds": 600,
 "replicas": 4,
 "revisionHistoryLimit": 10,
 "selector": {
 "matchLabels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "strategy": {
 "rollingUpdate": {
 "maxSurge": 1,
 "maxUnavailable": 1
 },
 "type": "RollingUpdate"
 },
 "template": {
 "metadata": {
 "annotations": {
 "artifact.spinnaker.io/location": "staging",
 "artifact.spinnaker.io/name": "hostname",
 "artifact.spinnaker.io/type": "kubernetes/deployment",
 "artifact.spinnaker.io/version": "",
 "moniker.spinnaker.io/application": "hostname",
 "moniker.spinnaker.io/cluster": "deployment hostname",
 "prometheus.io/port": "9113",
 "prometheus.io/scrape": "true"
 },
 "labels": {
 "app": "hostname",
 "app.kubernetes.io/managed-by": "spinnaker",
 "app.kubernetes.io/name": "hostname",
 "version": "v1"
 }
 },
 "spec": {
 "containers": [
 {
 "image": "rstarmer/hostname:v1",
 "imagePullPolicy": "Always",
 "name": "hostname",
 "resources": {},
 "terminationMessagePath": "/dev/termination-log",
 "terminationMessagePolicy": "File",
 "volumeMounts": [
 {
 "mountPath": "/etc/nginx/conf.d/nginx-status.conf",
 "name": "nginx-status-conf",
 "readOnly": true,
 "subPath": "nginx.status.conf"
 }
 ]
 },
 {
 "args": [
 "-nginx.scrape-uri=http://localhost:8090/nginx_status"
 ],
 "image": "nginx/nginx-prometheus-exporter:0.3.0",
 "imagePullPolicy": "Always",
 "name": "nginx-exporter",
 "ports": [
 {
 "containerPort": 9113,
 "name": "nginx-ex-port",
 "protocol": "TCP"
 }
 ],
 "resources": {},
 "terminationMessagePath": "/dev/termination-log",
 "terminationMessagePolicy": "File"
 }
 ],
 "dnsPolicy": "ClusterFirst",
 "restartPolicy": "Always",
 "schedulerName": "default-scheduler",
 "securityContext": {},
 "terminationGracePeriodSeconds": 30,
 "volumes": [
 {
 "configMap": {
 "defaultMode": 420,
 "name": "nginx-status-conf-v000"
 },
 "name": "nginx-status-conf"
 }
 ]
 }
 }
 },
 "status": {
 "availableReplicas": 10,
 "conditions": [
 {
 "lastTransitionTime": "2021-04-30T21:19:15Z",
 "lastUpdateTime": "2021-05-07T20:39:03Z",
 "message": "ReplicaSet \"hostname-f5b957cc\" has successfully progressed.",
 "reason": "NewReplicaSetAvailable",
 "status": "True",
 "type": "Progressing"
 },
 {
 "lastTransitionTime": "2021-05-07T22:39:40Z",
 "lastUpdateTime": "2021-05-07T22:39:40Z",
 "message": "Deployment has minimum availability.",
 "reason": "MinimumReplicasAvailable",
 "status": "True",
 "type": "Available"
 }
 ],
 "observedGeneration": 10,
 "readyReplicas": 10,
 "replicas": 10,
 "updatedReplicas": 10
 }
 }
 ],
 "requiredArtifacts": []
 },
 "parentStageId": null,
 "refId": "0",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620752502094,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620752502246,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.ResolveDeploySourceManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "resolveDeploySourceManifest",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620752502114,
 "status": "SUCCEEDED"
 },
 {
 "endTime": 1620752502738,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.DeployManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "deployManifest",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620752502265,
 "status": "SUCCEEDED"
 },
 {
 "endTime": 1620752508133,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620752502764,
 "status": "SUCCEEDED"
 },
 {
 "endTime": 1620752508319,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.PromoteManifestKatoOutputsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "promoteOutputs",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620752508168,
 "status": "SUCCEEDED"
 },
 {
 "endTime": 1620752508606,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.WaitForManifestStableTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForManifestToStabilize",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620752508388,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.artifacts.CleanupArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "cleanupArtifacts",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620752508624,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorCleanup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "8",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.PromoteManifestKatoOutputsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "promoteOutputs",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "9",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "deployManifest"
 },
 "user": {
 "isAdmin": false,
 "roles": [],
 "username": "myUserName"
 }
 }
}

Example Policy

This policy requires that a set of annotations have been applied to any manifests that are being deployed. Specifically the annotations ‘app’ and ‘owner’ must have been applied.

 package spinnaker.execution.stages.before.deployManifest
 required_annotations:=["app","owner"]
 deny["Manifest is missing a required annotation"] {
 metadata :=input.stage.context.manifests[_].metadata
 annotations := object.get(metadata,"annotations",{})
 # Use object.get to check if data exists
 object.get(annotations,required_annotations[_],null)==null
 }{
 metadata :=input.stage.context.manifests[_].spec.template.metadata
 annotations := object.get(metadata,"annotations",{})
 # Use object.get to check if data exists
 object.get(annotations,required_annotations[_],null)==null
 }

This policy requires prevents exposing a set of ports that are unencrypted buy have encrypted alternatives. Specifically this policy prevents exposing HTTP, FTP, TELNET, POP3, NNTP, IMAP, LDAP, and SMTP from a pod, deployment, or replicaset.

package spinnaker.execution.stages.before.deployManifest

blockedPorts := [20,21,23,80,110,119,143,389,587,8080,8088,8888]

deny["A port typically used by an unencrypted protocol was detected."] {
 #Check for service
 ports := input.stage.context.manifests[_].spec.ports[_]
 any([object.get(ports,"port",null) == blockedPorts[_],
 object.get(ports,"targetPort",null) == blockedPorts[_]])
}{
 #Check for pod
 input.stage.context.manifests[_].spec.containers[_].ports[_].containerPort=blockedPorts[_]
} {
 #Check for pod template
 input.stage.context.manifests[_].spec.template.spec.containers[_].ports[_].containerPort=blockedPorts[_]
 }

This policy checks whether or not the image being approved is on a list of imaged that are approved for deployment. The list of what images are approved must seperately be uploaded to the OPA data document

package spinnaker.execution.stages.before.deployManifest

deny["Manifest creates a pod from an image that is not approved by the security scanning process."] {
#Check pod templates
 isImageUnApproved(input.stage.context.manifests[_].spec.template.spec.containers[_].image)
} {#check pods
 isImageUnApproved(input.stage.context.manifests[_].spec.containers[_].image)
}
{#check pod template initContainers
 isImageUnApproved(input.stage.context.manifests[_].spec.template.spec.initContainers[_].image)
}
{#check pod initContainers
 isImageUnApproved(input.stage.context.manifests[_].spec.initContainers[_].image)
}

isImageUnApproved(image){ not isImageApproved(image) }
isImageApproved(image){ image==data.approvedImages[_]}

This policy prevents applications from deploying to namespaces that they are not whitelisted for.

package spinnaker.execution.stages.before.deployManifest

allowedNamespaces:=[{"app":"app1","ns": ["ns1","ns2"]},
 {"app":"app2", "ns":["ns3"]}]

deny["stage deploys to a namespace to which this application lacks access"]{
 ns :=object.get(input.stage.context.manifests[_].metadata,"namespace","default")
 application := input.pipeline.application
 not canDeploy(ns, application)
}

canDeploy(namespace, application){
 some i
 allowedNamespaces[i].app==application
 allowedNamespaces[i].ns[_]==namespace
}

Keys

Parameters related to the stage against which the policy is executing can be found in the input.stage.context object.

input.pipeline

Key	Type	Description
`input.pipeline.application`	`string`	The name of the application to which this pipeline belongs.
`input.pipeline.authentication.allowedAccounts[]`	`string`	The list of accounts to which the user this stage runs as has access.
`input.pipeline.authentication.user`	`string`	The Spinnaker user initiating the change.
`input.pipeline.buildTime`	`number`
`input.pipeline.description`	`string`	Description of the pipeline defined in the UI.
`input.pipeline.id`	`string`	The unique ID of the pipeline.
`input.pipeline.keepWaitingPipelines`	`boolean`	If concurrent pipeline execution is disabled, then the pipelines that are in the waiting queue will get canceled when the next execution starts unless this is true.
`input.pipeline.limitConcurrent`	`boolean`	True if only 1 concurrent execution of this pipeline is allowed.
`input.pipeline.name`	`string`	The name of this pipeline.
`input.pipeline.origin`	`string`
`input.pipeline.partition`
`input.pipeline.paused`
`input.pipeline.pipelineConfigId`
`input.pipeline.source`
`input.pipeline.spelEvaluator`	`string`	Which version of spring expression language is being used to evaluate SpEL.
`input.pipeline.stages[]`	`string`	An array of the stages in the pipeline. Typically if you are writing a policy that examines multiple pipeline stages, it is better to write that policy against either the `opa.pipelines` package, or the `spinnaker.execution.pipelines.before package`.
`input.pipeline.startTime`	`number`	Timestamp from when the pipeline was started.
`input.pipeline.startTimeExpiry`	`date`	Unix epoch date at which the pipeline expires.
`input.pipeline.status`	`string`	The status of the pipeline, typically ‘RUNNING’.
`input.pipeline.templateVariables`
`input.pipeline.type`	`string`

input.pipeline.trigger

See input.pipeline.trigger for more information.

input.stage

See input.stage for more information.

input.stage.context

Key	Type	Description
`input.stage.context.account`	`string`	What account is this stage deploying to. This is often used, for example, to check whether or not a policy applies to the given account.
`input.stage.context.artifacts[]`	`array`	See artifacts for more information.
`input.stage.context.cloudProvider`	`string`	The cloud provider for the account this is deploying to. Typically ‘kubernetes’
`input.stage.context.deploy.account.name`	`string`	The name of the account to which the stage is deploying.
`input.stage.context.kato.last.task.id.id`	`string`
`input.stage.context.kato.result.expected`	`boolean`
`input.stage.context.kato.task.firstNotFoundRetry`	`number`
`input.stage.context.kato.task.lastStatus`	`string`
`input.stage.context.kato.task.notFoundRetryCount`	`number`
`input.stage.context.kato.task.terminalRetryCount`	`number`
`input.stage.context.kato.tasks[]`	`string`	This array contains the tasks that are executed during this stage. when each task finishes execution, the policy is rechecked with the status of each execution task updated.
`input.stage.context.kato.tasks[].history[].phase`	`string`	The history of task phase changes.
`input.stage.context.kato.tasks[].history[].status`	`string`	The history of task status changes.
`input.stage.context.kato.tasks[].id`	`string`	The unique id of the task.
`input.stage.context.kato.tasks[].resultObjects[]`	`{object}`	DO NOT USE. This contains numerous manifests/artifacts created by the execution of the stage. Typically policies should be written against the inputs to the stage, not its outputs.
`input.stage.context.kato.tasks[].status.completed`	`boolean`	True when the task has finished executing.
`input.stage.context.kato.tasks[].status.failed`	`boolean`	Did the task attempt to execute and fail.
`input.stage.context.kato.tasks[].status.retryable`	`boolean`	Can the task retry if execution fails.
`input.stage.context.manifestArtifactAccount`	`string`	What artifact account are artifacts stored in.
`input.stage.context.manifests[]`	`object`	The raw kubernetes manifest being deployed. This is the element you should write policies against that involve the manifest.
`input.stage.context.moniker.app`	`string`	The name of the application to which this pipeline belongs.
`input.stage.context.moniker.cluster`	`string`	The name of the cluster to which this stage is deploying.
`input.stage.context.outputs`	`object`	DO NOT USE. This contains numerous manifests/artifacts created by the execution of the stage. Typically policies should be written against the inputs to the stage, not its outputs.
`input.stage.context.source`	`string`	Specifies whether the manifest is coming from an artifact or was directly specified in the pipeline as text.
`input.stage.context.stableManifests[].location`	`string`	The namespace of the stable manifest.
`input.stage.context.stableManifests[].manifestName`	`string`	The manifests name.
`input.stage.context.user`	`string`	the ID of the user that the stage runs as.

input.user

This object provides information about the user performing the action. This can be used to restrict actions by role. See input.user for more information.

Plugins: spinnaker.execution.stages.before.determineTargetServerGroup

Mon, 01 Jan 0001 00:00:00 +0000

Example Payload

Click to expand

{
 "input": {
 "pipeline": {
 "application": "test",
 "authentication": {
 "allowedAccounts": [
 "spinnaker",
 "staging",
 "staging-ecs"
 ],
 "user": "myUserName"
 },
 "buildTime": 1620926703486,
 "canceled": false,
 "canceledBy": null,
 "cancellationReason": null,
 "description": null,
 "endTime": 1620926705283,
 "id": "01F5KC59TRGWKCP31C4N51CDSB",
 "initialConfig": {},
 "keepWaitingPipelines": false,
 "limitConcurrent": true,
 "name": "test",
 "notifications": [],
 "origin": "api",
 "partition": null,
 "paused": null,
 "pipelineConfigId": "6a4cff2e-8265-4584-8993-2da2eb6254f5",
 "source": null,
 "spelEvaluator": "v4",
 "stages": [
 {
 "context": {
 "exception": {
 "details": {
 "error": "Internal Server Error",
 "errors": [
 "Bake failed: Error: file '/tmp/rosco-2833166343726058950/f547ea98-52eb-4b6c-8c17-173d21535456' does not appear to be a gzipped archive; got 'text/plain; charset=utf-8'\n"
 ],
 "kind": "HTTP",
 "responseBody": "{\"timestamp\":\"2021-05-13T17:25:05.658+00:00\",\"status\":500,\"error\":\"Internal Server Error\",\"message\":\"Bake failed: Error: file '/tmp/rosco-2833166343726058950/f547ea98-52eb-4b6c-8c17-173d21535456' does not appear to be a gzipped archive; got 'text/plain; charset=utf-8'\\n\"}",
 "status": 500,
 "url": "http://spin-rosco.spinnaker:8087/api/v2/manifest/bake/HELM2"
 },
 "exceptionType": "RetrofitError",
 "operation": "createBake",
 "shouldRetry": false,
 "timestamp": 1620926705665
 },
 "expectedArtifacts": [
 {
 "defaultArtifact": {
 "customKind": true,
 "id": "f9275bbf-fef7-4339-88f4-b2a18ec7b0ab"
 },
 "displayName": "pink-dog-80",
 "id": "eb9e5a6c-e9d1-489b-9f3b-4d414ba33b73",
 "matchArtifact": {
 "artifactAccount": "embedded-artifact",
 "customKind": false,
 "id": "301e50f0-2bc6-4d3e-894b-31dbf0b67bf0",
 "name": "test",
 "type": "embedded/base64"
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ],
 "inputArtifacts": [
 {
 "account": "",
 "id": "05ad020e-73a6-49f2-9988-2073831219e9"
 }
 ],
 "namespace": "testns",
 "outputName": "test",
 "overrides": {},
 "templateRenderer": "HELM2"
 },
 "endTime": null,
 "id": "01F5KC59VXSVC287E96M310EF5",
 "lastModified": null,
 "name": "Bake (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "10",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703574,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.manifests.CreateBakeManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createBake",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703700,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "bakeManifest"
 },
 {
 "context": {
 "analysisType": "realTimeAutomatic",
 "beforeStagePlanningFailed": true,
 "canaryConfig": {
 "metricsAccountName": "prometheus",
 "scopes": [
 {
 "extendedScopeParams": {},
 "scopeName": "default"
 }
 ],
 "scoreThresholds": {},
 "storageAccountName": "s3"
 },
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Canary stage configuration must include either `endTime` or `lifetimeDuration`."
 ],
 "stackTrace": "java.lang.IllegalArgumentException: Canary stage configuration must include either `endTime` or `lifetimeDuration`.\n\tat com.netflix.spinnaker.orca.kayenta.pipeline.KayentaCanaryStage.beforeStages(KayentaCanaryStage.kt:56)\n\tat com.netflix.spinnaker.orca.q.StageDefinitionBuildersKt.buildBeforeStages(StageDefinitionBuilders.kt:103)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.plan(StartStageHandler.kt:174)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.access$plan(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:99)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withAuth(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:81)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withExecution(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withStage(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:79)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalArgumentException",
 "operation": "Canary Analysis",
 "shouldRetry": false,
 "timestamp": 1620926704026
 }
 },
 "endTime": 1620926704342,
 "id": "01F5KC59VXZA70H3SN0GQWE1DT",
 "lastModified": null,
 "name": "Canary Analysis",
 "outputs": {},
 "parentStageId": null,
 "refId": "11",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703576,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kayenta.tasks.AggregateCanaryResultsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "aggregateCanaryResults",
 "stageEnd": true,
 "stageStart": true,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "kayentaCanary"
 },
 {
 "context": {
 "application": "test",
 "attempt": 2,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "consecutiveNotFound": 0,
 "copySourceCustomBlockDeviceMappings": false,
 "credentials": "staging",
 "freeFormDetails": "",
 "lastException": "Unable to locate current_asg_dynamic in staging/us-east-2/test\ncom.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroup$NotFoundException: Unable to locate current_asg_dynamic in staging/us-east-2/test\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n\tat java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)\n\tat org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:80)\n\tat org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:74)\n\tat org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:237)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:249)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver.resolveByTarget(TargetServerGroupResolver.groovy:75)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:101)\n\tat groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)\n\tat org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:351)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:64)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:156)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:176)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver$_resolveByParams_closure1.doCall(TargetServerGroupResolver.groovy:56)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:101)\n\tat groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)\n\tat org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:263)\n\tat groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1041)\n\tat groovy.lang.Closure.call(Closure.java:405)\n\tat groovy.lang.Closure.call(Closure.java:421)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3574)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3559)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3659)\n\tat org.codehaus.groovy.runtime.dgm$87.invoke(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:244)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:53)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver.resolveByParams(TargetServerGroupResolver.groovy:54)\n\tat com.netflix.spinnaker.orca.kato.pipeline.support.SourceResolver.getSource(SourceResolver.groovy:79)\n\tat com.netflix.spinnaker.orca.kato.pipeline.support.SourceResolver$getSource.call(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask.execute(DetermineSourceServerGroupTask.groovy:59)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n",
 "region": "us-east-2",
 "stack": "",
 "target": "current_asg_dynamic",
 "targetCluster": "test",
 "useAmiBlockDeviceMappings": false,
 "useSourceCapacity": true
 },
 "endTime": null,
 "id": "01F5KC59VXW75H7Q7Z2C87CXET",
 "lastModified": null,
 "name": "Clone Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "12",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703580,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineSourceServerGroup",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703830,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.pipeline.providers.aws.CaptureSourceServerGroupCapacityTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "snapshotSourceServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.CloneServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "cloneServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.instance.WaitForUpInstancesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForUpInstances",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "8",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "9",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetCommitsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getCommits",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "cloneServerGroup"
 },
 {
 "context": {
 "failOnFailedExpressions": true
 },
 "endTime": null,
 "id": "01F5KC59VX419V14RWY4JCWEHK",
 "lastModified": null,
 "name": "Concourse",
 "outputs": {},
 "parentStageId": null,
 "refId": "13",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703586,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.WaitForConcourseJobStartTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForConcourseJobStartTask",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703684,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.WaitForConcourseJobCompletionTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForConcourseJobCompletionTask",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "concourse"
 },
 {
 "context": {
 "kato.last.task.id": {
 "id": "f377bbb1-d404-4ff7-8444-b25e5b3ccf10"
 },
 "kato.result.expected": true,
 "loadBalancers": [],
 "notification.type": "upsertloadbalancer",
 "targets": []
 },
 "endTime": null,
 "id": "01F5KC59VX3VNVYJ5PTGDJQ4PK",
 "lastModified": null,
 "name": "Create Load Balancers",
 "outputs": {},
 "parentStageId": null,
 "refId": "14",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703592,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926704382,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.loadbalancer.UpsertLoadBalancersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "upsertLoadBalancers",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703674,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorUpsert",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620926705108,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.loadbalancer.UpsertLoadBalancerResultObjectExtrapolationTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "extrapolateUpsertResult",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.loadbalancer.UpsertLoadBalancerForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "upsertLoadBalancers"
 },
 {
 "context": {
 "account": "staging",
 "application": "test",
 "availabilityZones": {
 "us-east-2": [
 "us-east-2a",
 "us-east-2b",
 "us-east-2c"
 ]
 },
 "capacity": {
 "desired": 1,
 "max": 1,
 "min": 1
 },
 "cloudProvider": "aws",
 "cooldown": 10,
 "copySourceCustomBlockDeviceMappings": false,
 "ebsOptimized": false,
 "enabledMetrics": [],
 "freeFormDetails": "",
 "healthCheckGracePeriod": 600,
 "healthCheckType": "EC2",
 "iamRole": "BaseIAMRole",
 "instanceMonitoring": false,
 "instanceType": "t3.nano",
 "keyPair": "Demo",
 "loadBalancers": [],
 "name": "Deploy in us-east-2",
 "provider": "aws",
 "reason": "sad",
 "securityGroups": [],
 "source": {},
 "spotPrice": "",
 "stack": "",
 "strategy": "",
 "subnetType": "",
 "suspendedProcesses": [],
 "tags": {},
 "targetGroups": [],
 "targetHealthyDeployPercentage": 100,
 "terminationPolicies": [
 "Default"
 ],
 "type": "createServerGroup",
 "useAmiBlockDeviceMappings": false
 },
 "endTime": null,
 "id": "01F5KC59ZVHCFYZPQ9851X0D3X",
 "lastModified": null,
 "name": "Deploy in us-east-2",
 "outputs": {},
 "parentStageId": "01F5KC59VX6DZFTP10F521J3G2",
 "refId": "15<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703698,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": 1620926706124,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineSourceServerGroup",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703970,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.pipeline.providers.aws.CaptureSourceServerGroupCapacityTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "snapshotSourceServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.CreateServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.instance.WaitForUpInstancesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForUpInstances",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "8",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "9",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetCommitsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getCommits",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "createServerGroup"
 },
 {
 "context": {
 "clusters": [
 {
 "account": "staging",
 "application": "test",
 "availabilityZones": {
 "us-east-2": [
 "us-east-2a",
 "us-east-2b",
 "us-east-2c"
 ]
 },
 "capacity": {
 "desired": 1,
 "max": 1,
 "min": 1
 },
 "cloudProvider": "aws",
 "cooldown": 10,
 "copySourceCustomBlockDeviceMappings": false,
 "ebsOptimized": false,
 "enabledMetrics": [],
 "freeFormDetails": "",
 "healthCheckGracePeriod": 600,
 "healthCheckType": "EC2",
 "iamRole": "BaseIAMRole",
 "instanceMonitoring": false,
 "instanceType": "t3.nano",
 "keyPair": "Demo",
 "loadBalancers": [],
 "provider": "aws",
 "reason": "sad",
 "securityGroups": [],
 "spotPrice": "",
 "stack": "",
 "strategy": "",
 "subnetType": "",
 "suspendedProcesses": [],
 "tags": {},
 "targetGroups": [],
 "targetHealthyDeployPercentage": 100,
 "terminationPolicies": [
 "Default"
 ],
 "useAmiBlockDeviceMappings": false
 }
 ]
 },
 "endTime": null,
 "id": "01F5KC59VX6DZFTP10F521J3G2",
 "lastModified": null,
 "name": "Deploy",
 "outputs": {},
 "parentStageId": null,
 "refId": "15",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703597,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kato.pipeline.ParallelDeployStage.CompleteParallelDeployTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "completeParallelDeploy",
 "stageEnd": true,
 "stageStart": true,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "deploy"
 },
 "01F5KC5AFSDSNE2QQEBV91VKF1",
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "region": "us-east-2",
 "target": "current_asg_dynamic",
 "targetLocation": {
 "type": "REGION",
 "value": "us-east-2"
 }
 },
 "endTime": null,
 "id": "01F5KC5AGTMK1EHY3RN5X25F9H",
 "lastModified": null,
 "name": "destroyServerGroup",
 "outputs": {},
 "parentStageId": "01F5KC59VXHAQ7P03S2RD1MHKP",
 "refId": "16<2",
 "requisiteStageRefIds": [
 "16<1"
 ],
 "scheduledTime": null,
 "startTime": null,
 "startTimeExpiry": null,
 "status": "NOT_STARTED",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [],
 "type": "destroyServerGroup"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "target": "current_asg_dynamic"
 },
 "endTime": null,
 "id": "01F5KC59VXHAQ7P03S2RD1MHKP",
 "lastModified": null,
 "name": "Destroy Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "16",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703600,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "destroyServerGroup"
 },
 {
 "context": {
 "credentials": "staging",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "No regions selected. At least one region must be chosen."
 ],
 "stackTrace": "java.lang.IllegalArgumentException: No regions selected. At least one region must be chosen.\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.DeployCloudFormationTask.lambda$execute$2(DeployCloudFormationTask.java:146)\n\tat java.base/java.util.Optional.orElseThrow(Optional.java:408)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.DeployCloudFormationTask.execute(DeployCloudFormationTask.java:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalArgumentException",
 "operation": "deployCloudFormation",
 "shouldRetry": false,
 "timestamp": 1620926704546
 },
 "parameters": {},
 "regions": [],
 "source": "artifact",
 "stackArtifactAccount": "myUserName",
 "stackArtifactId": "05ad020e-73a6-49f2-9988-2073831219e9",
 "stackName": "satest",
 "tags": {}
 },
 "endTime": null,
 "id": "01F5KC59VXV45WRT9VBRT4HSQC",
 "lastModified": null,
 "name": "Deploy (CloudFormation Stack)",
 "outputs": {},
 "parentStageId": null,
 "refId": "17",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703613,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705629,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.DeployCloudFormationTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "deployCloudFormation",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703699,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorCloudFormation",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.CloudFormationForceCacheRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceRefreshCache",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.WaitForCloudFormationCompletionTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForCloudFormationCompletion",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "deployCloudFormation"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "test",
 "credentials": "staging",
 "interestingHealthProviderNames": [
 "Amazon"
 ],
 "preferLargerOverNewer": "false",
 "regions": [],
 "remainingEnabledServerGroups": 1
 },
 "endTime": null,
 "id": "01F5KC59VX9BYMY7CCXAG75NXT",
 "lastModified": null,
 "name": "Disable Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "18",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703616,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926704950,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703761,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.DisableClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "disableCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620926705735,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDisableCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.WaitForClusterDisableTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForClusterDisable",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "disableCluster"
 },
 {
 "context": {
 "beforeStagePlanningFailed": true,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "test",
 "credentials": "staging",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Cannot invoke method singularType() on null object"
 ],
 "stackTrace": "java.lang.NullPointerException: Cannot invoke method singularType() on null object\n\tat org.codehaus.groovy.runtime.NullObject.invokeMethod(NullObject.java:91)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:43)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.NullCallSite.call(NullCallSite.java:34)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:119)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.composeDynamicTargets(TargetServerGroupLinearStageSupport.groovy:176)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.runtime.callsite.PlainObjectMetaMethodSite.doInvoke(PlainObjectMetaMethodSite.java:43)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:190)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:58)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:156)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:184)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.composeTargets(TargetServerGroupLinearStageSupport.groovy:144)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport$composeTargets.callCurrent(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport$composeTargets.callCurrent(Unknown Source)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.beforeStages(TargetServerGroupLinearStageSupport.groovy:110)\n\tat com.netflix.spinnaker.orca.q.StageDefinitionBuildersKt.buildBeforeStages(StageDefinitionBuilders.kt:103)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.plan(StartStageHandler.kt:174)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.access$plan(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:99)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withAuth(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:81)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withExecution(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withStage(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:79)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "NullPointerException",
 "operation": "Enable Server Group",
 "shouldRetry": false,
 "timestamp": 1620926704111
 },
 "target": "current_asg_dynamic"
 },
 "endTime": 1620926704409,
 "id": "01F5KC59VXD2VE54883ZMJHEX3",
 "lastModified": null,
 "name": "Enable Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "19",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703624,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "enableServerGroup"
 },
 {
 "context": {
 "entityRef": {
 "entityId": "test",
 "entityType": "application"
 },
 "tags": [
 {
 "name": "test",
 "namespace": "testns",
 "value": "test"
 }
 ]
 },
 "endTime": null,
 "id": "01F5KC59VX8MSHMTMHBY1YR8Y0",
 "lastModified": null,
 "name": "Entity Tags",
 "outputs": {},
 "parentStageId": null,
 "refId": "20",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703665,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.entitytags.UpsertEntityTagsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "upsertEntityTags",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703784,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorUpsert",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "upsertEntityTags"
 },
 {
 "context": {
 "expressionEvaluationSummary": {
 "trigger.buildInfo.number": [
 {
 "description": "Failed to evaluate [var] EL1007E: Property or field 'number' cannot be found on null",
 "exceptionType": "org.springframework.expression.spel.SpelEvaluationException",
 "level": "ERROR",
 "timestamp": 1620926705527
 }
 ]
 },
 "failOnFailedExpressions": true,
 "variables": [
 {
 "key": "test",
 "sourceValue": "{trigger.buildInfo.number}",
 "value": "${trigger.buildInfo.number}"
 }
 ]
 },
 "endTime": null,
 "id": "01F5KC59VXH51C7G7KH5CA8JDZ",
 "lastModified": null,
 "name": "Evaluate Variables",
 "outputs": {
 "test": "${trigger.buildInfo.number}"
 },
 "parentStageId": null,
 "refId": "21",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704036,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.EvaluateVariablesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "evaluateVariables",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704354,
 "status": "RUNNING"
 }
 ],
 "type": "evaluateVariables"
 },
 {
 "context": {
 "application": "hostname",
 "artifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname-metrics",
 "reference": "hostname-metrics",
 "type": "kubernetes/service",
 "version": ""
 }
 ],
 "executionOptions": {
 "successful": true
 },
 "expectedArtifacts": [
 {
 "defaultArtifact": {
 "customKind": true,
 "id": "df96edee-9d90-486c-b269-ef110f469499"
 },
 "displayName": "light-panther-92",
 "id": "4d764059-d642-4870-ae63-476e59af708c",
 "matchArtifact": {
 "customKind": true,
 "id": "7bd826db-a9c8-4052-ad15-5029baba0067"
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ],
 "pipeline": "7db1e350-dedb-4dc1-9976-e71f97b5f132",
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname-metrics",
 "reference": "hostname-metrics",
 "type": "kubernetes/service",
 "version": ""
 },
 "defaultArtifact": {
 "customKind": true,
 "metadata": {
 "id": "df96edee-9d90-486c-b269-ef110f469499"
 }
 },
 "id": "4d764059-d642-4870-ae63-476e59af708c",
 "matchArtifact": {
 "customKind": true,
 "metadata": {
 "id": "7bd826db-a9c8-4052-ad15-5029baba0067"
 }
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ]
 },
 "endTime": null,
 "id": "01F5KC59VXDDF9TBZTVM242YHT",
 "lastModified": null,
 "name": "Find Artifacts From Execution",
 "outputs": {
 "artifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname-metrics",
 "reference": "hostname-metrics",
 "type": "kubernetes/service",
 "version": ""
 }
 ],
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname-metrics",
 "reference": "hostname-metrics",
 "type": "kubernetes/service",
 "version": ""
 },
 "defaultArtifact": {
 "customKind": true,
 "metadata": {
 "id": "df96edee-9d90-486c-b269-ef110f469499"
 }
 },
 "id": "4d764059-d642-4870-ae63-476e59af708c",
 "matchArtifact": {
 "customKind": true,
 "metadata": {
 "id": "7bd826db-a9c8-4052-ad15-5029baba0067"
 }
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ]
 },
 "parentStageId": null,
 "refId": "22",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703681,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706126,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.artifacts.FindArtifactFromExecutionTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "findArtifactFromExecution",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926703882,
 "status": "SUCCEEDED"
 }
 ],
 "type": "findArtifactFromExecution"
 },
 {
 "context": {
 "account": "spinnaker",
 "app": "test",
 "cloudProvider": "kubernetes",
 "location": "spinnaker",
 "manifestName": "deployment spin-gate",
 "mode": "static"
 },
 "endTime": null,
 "id": "01F5KC59VXS0PN55TX4ARCFFCS",
 "lastModified": null,
 "name": "Find Artifacts From Resource (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "23",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703707,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705606,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.ResolveTargetManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "resolveTargetManifest",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703827,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.artifacts.FindArtifactsFromResourceTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "findArtifactsFromResource",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620926706170,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "findArtifactsFromResource"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "test",
 "credentials": "staging",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Could not find cluster 'test' for 'staging' in 'us-east-2'."
 ],
 "stackTrace": "java.lang.IllegalStateException: Could not find cluster 'test' for 'staging' in 'us-east-2'.\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n\tat java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)\n\tat org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:80)\n\tat org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:74)\n\tat org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:237)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:249)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.cluster.FindImageFromClusterTask$_execute_closure2.doCall(FindImageFromClusterTask.groovy:178)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:101)\n\tat groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)\n\tat org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:263)\n\tat groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1041)\n\tat groovy.lang.Closure.call(Closure.java:405)\n\tat groovy.lang.Closure.call(Closure.java:421)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collectEntries(DefaultGroovyMethods.java:4137)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collectEntries(DefaultGroovyMethods.java:4044)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collectEntries(DefaultGroovyMethods.java:4069)\n\tat org.codehaus.groovy.runtime.dgm$96.invoke(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:244)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:53)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.cluster.FindImageFromClusterTask.execute(FindImageFromClusterTask.groovy:141)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalStateException",
 "operation": "findImage",
 "shouldRetry": false,
 "timestamp": 1620926705232
 },
 "onlyEnabled": true,
 "regions": [
 "us-east-2"
 ],
 "selectionStrategy": "LARGEST"
 },
 "endTime": null,
 "id": "01F5KC59VXR6HM4ZDGQS533X3Z",
 "lastModified": null,
 "name": "Find Image from Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "24",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703771,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705748,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.FindImageFromClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "findImage",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704082,
 "status": "TERMINAL"
 }
 ],
 "type": "findImage"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "exception": {
 "details": {
 "error": "Bad Request",
 "errors": [
 "Minimum of 3 characters required to filter namedImages"
 ],
 "kind": "HTTP",
 "responseBody": "{\"error\":\"Bad Request\",\"message\":\"Minimum of 3 characters required to filter namedImages\",\"status\":400,\"timestamp\":1620926705030}",
 "status": 400,
 "url": "http://spin-clouddriver.spinnaker:7002/aws/images/find?tag:test=test"
 },
 "exceptionType": "RetrofitError",
 "operation": "findImage",
 "shouldRetry": false,
 "timestamp": 1620926705048
 },
 "regions": [
 "us-east-2"
 ],
 "tags": {
 "test": "test"
 }
 },
 "endTime": null,
 "id": "01F5KC59VXVYM16F67ZF4DKPDP",
 "lastModified": null,
 "name": "Find Image from Tags",
 "outputs": {},
 "parentStageId": null,
 "refId": "25",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703765,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705759,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.image.FindImageFromTagsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "findImage",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704147,
 "status": "TERMINAL"
 }
 ],
 "type": "findImageFromTags"
 },
 {
 "context": {
 "exception": {
 "details": {
 "error": "Path parameter \"account\" value must not be null.",
 "errors": [],
 "kind": "UNEXPECTED"
 },
 "exceptionType": "RetrofitError",
 "operation": "startGoogleCloudBuildTask",
 "shouldRetry": false,
 "timestamp": 1620926705364
 }
 },
 "endTime": null,
 "id": "01F5KC59VXFCE23E6ZZVWS5E34",
 "lastModified": null,
 "name": "Google Cloud Build",
 "outputs": {},
 "parentStageId": null,
 "refId": "26",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703770,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705938,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartGoogleCloudBuildTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startGoogleCloudBuildTask",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704336,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorGoogleCloudBuildTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorGoogleCloudBuildTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetGoogleCloudBuildArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getGoogleCloudBuildArtifactsTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "googleCloudBuild"
 },
 {
 "context": {
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "No API Key provided"
 ],
 "stackTrace": "java.lang.RuntimeException: No API Key provided\n\tat com.netflix.spinnaker.orca.gremlin.pipeline.GremlinStage.getApiKey(GremlinStage.java:58)\n\tat com.netflix.spinnaker.orca.gremlin.tasks.LaunchGremlinAttackTask.execute(LaunchGremlinAttackTask.java:31)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "RuntimeException",
 "operation": "launchGremlinAttack",
 "shouldRetry": false,
 "timestamp": 1620926704638
 }
 },
 "endTime": null,
 "id": "01F5KC59VXD6BY9PBRNTTQJVPV",
 "lastModified": null,
 "name": "Gremlin",
 "outputs": {},
 "parentStageId": null,
 "refId": "27",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703775,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705680,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.gremlin.tasks.LaunchGremlinAttackTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "launchGremlinAttack",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704078,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.gremlin.tasks.MonitorGremlinAttackTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorGremlinAttack",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "gremlin"
 },
 {
 "context": {
 "continuePipeline": false,
 "exception": {
 "details": {
 "error": "Path parameter \"name\" value must not be null.",
 "errors": [],
 "kind": "UNEXPECTED"
 },
 "exceptionType": "RetrofitError",
 "operation": "startJenkinsJob",
 "shouldRetry": false,
 "timestamp": 1620926705729
 },
 "failPipeline": true
 },
 "endTime": null,
 "id": "01F5KC59VX8GY09S5X7RW10BWR",
 "lastModified": null,
 "name": "Jenkins",
 "outputs": {},
 "parentStageId": null,
 "refId": "28",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703791,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startJenkinsJob",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704300,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorQueuedJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForJenkinsJobStart",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorJenkinsJob",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildPropertiesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildProperties",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "jenkins"
 },
 {
 "context": {
 "action": "suspend",
 "cloudProvider": "aws",
 "cluster": "test",
 "credentials": "staging",
 "processes": [],
 "regions": [
 "us-east-2"
 ],
 "target": "current_asg_dynamic"
 },
 "endTime": null,
 "id": "01F5KC5AFRWAY7V0E7H2YQ6N87",
 "lastModified": null,
 "name": "determineTargetServerGroup",
 "outputs": {},
 "parentStageId": "01F5KC59VXWZ12ZWT3J2F4FQ4V",
 "refId": "29<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704606,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.support.DetermineTargetServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineTargetServerGroup",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926705670,
 "status": "RUNNING"
 }
 ],
 "type": "determineTargetServerGroup"
 },
 {
 "context": {
 "action": "suspend",
 "cloudProvider": "aws",
 "cluster": "test",
 "credentials": "staging",
 "processes": [],
 "region": "us-east-2",
 "target": "current_asg_dynamic",
 "targetLocation": {
 "type": "REGION",
 "value": "us-east-2"
 }
 },
 "endTime": null,
 "id": "01F5KC5AH42HXDTZS8YDQ0JAD7",
 "lastModified": null,
 "name": "modifyAwsScalingProcess",
 "outputs": {},
 "parentStageId": "01F5KC59VXWZ12ZWT3J2F4FQ4V",
 "refId": "29<2",
 "requisiteStageRefIds": [
 "29<1"
 ],
 "scheduledTime": null,
 "startTime": null,
 "startTimeExpiry": null,
 "status": "NOT_STARTED",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [],
 "type": "modifyAwsScalingProcess"
 },
 {
 "context": {
 "action": "suspend",
 "cloudProvider": "aws",
 "cluster": "test",
 "credentials": "staging",
 "processes": [],
 "target": "current_asg_dynamic"
 },
 "endTime": null,
 "id": "01F5KC59VXWZ12ZWT3J2F4FQ4V",
 "lastModified": null,
 "name": "Modify Scaling Process",
 "outputs": {},
 "parentStageId": null,
 "refId": "29",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703815,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "modifyAwsScalingProcess"
 },
 {
 "context": {
 "account": "spinnaker",
 "app": "test",
 "cloudProvider": "kubernetes",
 "location": "staging",
 "manifestName": "deployment hostname",
 "mode": "static",
 "options": {
 "mergeStrategy": "strategic",
 "record": true
 },
 "patchBody": [
 {
 "apiVersion": "apps/v1",
 "kind": "Deployment",
 "metadata": {
 "name": "hostname",
 "namespace": "staging"
 },
 "spec": {
 "replicas": "1",
 "selector": {
 "matchLabels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "strategy": {
 "rollingUpdate": {
 "maxSurge": 1,
 "maxUnavailable": 1
 },
 "type": "RollingUpdate"
 },
 "template": {
 "metadata": {
 "annotations": {
 "prometheus.io/port": "9113",
 "prometheus.io/scrape": "true"
 },
 "labels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "spec": {
 "containers": [
 {
 "image": "rstarmer/hostname:v1",
 "imagePullPolicy": "Always",
 "name": "hostname",
 "resources": {},
 "volumeMounts": [
 {
 "mountPath": "/etc/nginx/conf.d/nginx-status.conf",
 "name": "nginx-status-conf",
 "readOnly": true,
 "subPath": "nginx.status.conf"
 }
 ]
 },
 {
 "args": [
 "-nginx.scrape-uri=http://localhost:8090/nginx_status"
 ],
 "image": "nginx/nginx-prometheus-exporter:0.3.0",
 "imagePullPolicy": "Always",
 "name": "nginx-exporter",
 "ports": [
 {
 "containerPort": 9113,
 "name": "nginx-ex-port",
 "protocol": "TCP"
 }
 ]
 }
 ],
 "restartPolicy": "Always",
 "volumes": [
 {
 "configMap": {
 "defaultMode": 420,
 "name": "nginx-status-conf"
 },
 "name": "nginx-status-conf"
 }
 ]
 }
 }
 }
 }
 ],
 "source": "text"
 },
 "endTime": null,
 "id": "01F5KC59VXC778CNV0X6TKP9A6",
 "lastModified": null,
 "name": "Patch (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "30",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703872,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706122,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.ResolveTargetManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "resolveTargetManifest",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704220,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.ResolvePatchSourceManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "resolvePatchSourceManifest",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.PatchManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "patchManifest",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorPatch",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.PromoteManifestKatoOutputsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "promoteOutputs",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.WaitForManifestStableTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForManifestToStabilize",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "patchManifest"
 },
 {
 "context": {
 "application": "test",
 "failPipeline": true,
 "pipeline": "da91948b-b4a6-4483-88ef-e25bc69f83a9",
 "waitForCompletion": true
 },
 "endTime": null,
 "id": "01F5KC59VXCAGPGW4W0KPA3W18",
 "lastModified": null,
 "name": "Pipeline",
 "outputs": {},
 "parentStageId": null,
 "refId": "31",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703872,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.front50.tasks.StartPipelineTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startPipeline",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704268,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.front50.tasks.MonitorPipelineTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorPipeline",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "pipeline"
 },
 {
 "context": {
 "action": "scale_up",
 "beforeStagePlanningFailed": true,
 "capacity": {},
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Cannot invoke method singularType() on null object"
 ],
 "stackTrace": "java.lang.NullPointerException: Cannot invoke method singularType() on null object\n\tat org.codehaus.groovy.runtime.NullObject.invokeMethod(NullObject.java:91)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:43)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.NullCallSite.call(NullCallSite.java:34)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:119)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.composeDynamicTargets(TargetServerGroupLinearStageSupport.groovy:176)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.runtime.callsite.PlainObjectMetaMethodSite.doInvoke(PlainObjectMetaMethodSite.java:43)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:190)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:58)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:63)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:184)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.composeTargets(TargetServerGroupLinearStageSupport.groovy:144)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport$composeTargets.callCurrent(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport$composeTargets.callCurrent(Unknown Source)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.beforeStages(TargetServerGroupLinearStageSupport.groovy:110)\n\tat com.netflix.spinnaker.orca.q.StageDefinitionBuildersKt.buildBeforeStages(StageDefinitionBuilders.kt:103)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.plan(StartStageHandler.kt:174)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.access$plan(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:99)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withAuth(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:81)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withExecution(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withStage(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:79)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "NullPointerException",
 "operation": "Resize Server Group",
 "shouldRetry": false,
 "timestamp": 1620926704112
 },
 "resizeType": "pct",
 "target": "current_asg_dynamic",
 "targetHealthyDeployPercentage": 100
 },
 "endTime": 1620926704426,
 "id": "01F5KC59VXJWHXYA30AFABEW9W",
 "lastModified": null,
 "name": "Resize Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "32",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703885,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "resizeServerGroup"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "regions": [
 "us-east-2"
 ],
 "targetHealthyRollbackPercentage": 100
 },
 "endTime": null,
 "id": "01F5KC59VXNYZJ0640BVZXQ46N",
 "lastModified": null,
 "name": "Rollback Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "33",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703883,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.DetermineRollbackCandidatesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineRollbackCandidates",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704276,
 "status": "RUNNING"
 }
 ],
 "type": "rollbackCluster"
 },
 {
 "context": {
 "account": "spinnaker",
 "alias": "runJob",
 "application": "test",
 "cloudProvider": "kubernetes",
 "credentials": "spinnaker",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Run Job only supports manifests with a single Job."
 ],
 "stackTrace": "java.lang.IllegalArgumentException: Run Job only supports manifests with a single Job.\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.kubernetes.KubernetesJobRunner.getManifestFields(KubernetesJobRunner.java:70)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.kubernetes.KubernetesJobRunner.getOperations(KubernetesJobRunner.java:53)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.job.JobRunner$getOperations.call(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.job.RunJobTask.execute(RunJobTask.groovy:72)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalArgumentException",
 "operation": "runJob",
 "shouldRetry": false,
 "timestamp": 1620926705804
 },
 "manifestArtifactId": "05ad020e-73a6-49f2-9988-2073831219e9",
 "source": "artifact"
 },
 "endTime": null,
 "id": "01F5KC59VX0JK21YEGDWX8310Z",
 "lastModified": null,
 "name": "Run Job (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "34",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703889,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.job.RunJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "runJob",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704288,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.job.MonitorJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.PromoteManifestKatoOutputsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "promoteOutputs",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.job.WaitOnJobCompletion",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitOnJobCompletion",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "runJobManifest"
 },
 {
 "context": {
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: '${ parameters.namespace ?: staging }'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: '${ parameters.namespace ?: staging }'\nspec:\n replicas: '${ #toInt( parameters.replicas ?: 3) }'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]"
 ],
 "stackTrace": "java.lang.IllegalStateException: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: '${ parameters.namespace ?: staging }'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: '${ parameters.namespace ?: staging }'\nspec:\n replicas: '${ #toInt( parameters.replicas ?: 3) }'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask.execute(GetPipelinesFromArtifactTask.java:100)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\nCaused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: '${ parameters.namespace ?: staging }'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: '${ parameters.namespace ?: staging }'\nspec:\n replicas: '${ #toInt( parameters.replicas ?: 3) }'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]\n\tat com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1851)\n\tat com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:707)\n\tat com.fasterxml.jackson.core.base.ParserMinimalBase.reportUnexpectedNumberChar(ParserMinimalBase.java:536)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleInvalidNumberStart(ReaderBasedJsonParser.java:1679)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser._parseNegNumber(ReaderBasedJsonParser.java:1433)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:758)\n\tat com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4664)\n\tat com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4513)\n\tat com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3468)\n\tat com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3451)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask.execute(GetPipelinesFromArtifactTask.java:97)\n\t... 35 more\n"
 },
 "exceptionType": "IllegalStateException",
 "operation": "getPipelinesFromArtifact",
 "shouldRetry": false,
 "timestamp": 1620926705714
 },
 "pipelinesArtifactId": "05ad020e-73a6-49f2-9988-2073831219e9"
 },
 "endTime": null,
 "id": "01F5KC59VXEB15WXN5VSW8H8H8",
 "lastModified": null,
 "name": "Save Pipelines",
 "outputs": {},
 "parentStageId": null,
 "refId": "35",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703891,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getPipelinesFromArtifact",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704288,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.PreparePipelineToSaveTask",
 "loopEnd": false,
 "loopStart": true,
 "name": "preparePipelineToSaveTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.front50.tasks.SavePipelineTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "savePipeline",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.front50.tasks.MonitorFront50Task",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForPipelineSave",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.CheckPipelineResultsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "checkPipelineResults",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.CheckForRemainingPipelinesTask",
 "loopEnd": true,
 "loopStart": false,
 "name": "checkForRemainingPipelines",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.SavePipelinesCompleteTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "savePipelinesCompleteTask",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "savePipelinesFromArtifact"
 },
 {
 "context": {
 "allowScaleDownActive": false,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "TEST",
 "credentials": "staging",
 "interestingHealthProviderNames": [
 "Amazon"
 ],
 "preferLargerOverNewer": "false",
 "regions": [
 "us-east-2"
 ],
 "remainingFullSizeServerGroups": 1
 },
 "endTime": null,
 "id": "01F5KC59VX4WM95WVQG3P8FPGK",
 "lastModified": null,
 "name": "Scale Down Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "36",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703895,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704294,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.ScaleDownClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "scaleDownCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorScaleDownCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.WaitForScaleDownClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForScaleDownCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "scaleDownCluster"
 },
 {
 "context": {
 "failPipeline": true,
 "user": "myUserName",
 "waitForCompletion": true
 },
 "endTime": null,
 "id": "01F5KC59VXM9SH65YQVYSPYQ07",
 "lastModified": null,
 "name": "Script",
 "outputs": {},
 "parentStageId": null,
 "refId": "37",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703903,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartScriptTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startScript",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704279,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorQueuedJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForScriptStart",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorScript",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildPropertiesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildProperties",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "script"
 },
 {
 "context": {
 "allowDeleteActive": false,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "TEST",
 "credentials": "staging",
 "interestingHealthProviderNames": [
 "Amazon"
 ],
 "regions": [
 "us-east-2"
 ],
 "retainLargerOverNewer": "false",
 "shrinkToSize": 1
 },
 "endTime": null,
 "id": "01F5KC59VX9V47GNGF65Z1TSG3",
 "lastModified": null,
 "name": "Shrink Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "38",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704032,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704384,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.ShrinkClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "shrinkCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorShrinkCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.WaitForClusterShrinkTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForClusterShrink",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "shrinkCluster"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "consideredStages": [],
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Unable to determine source image(s)"
 ],
 "stackTrace": "java.lang.IllegalStateException: Unable to determine source image(s)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.image.ImageTagger.findImages(ImageTagger.java:80)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.AmazonImageTagger.getOperationContext(AmazonImageTagger.java:62)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.image.UpsertImageTagsTask.execute(UpsertImageTagsTask.java:65)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalStateException",
 "operation": "upsertImageTags",
 "shouldRetry": false,
 "timestamp": 1620926705284
 },
 "tags": {
 "TEST": "TEST"
 }
 },
 "endTime": null,
 "id": "01F5KC59VX7DERMTWGYZA30B5X",
 "lastModified": null,
 "name": "Tag Image",
 "outputs": {},
 "parentStageId": null,
 "refId": "39",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703980,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705773,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.image.UpsertImageTagsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "upsertImageTags",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704310,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorUpsert",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.image.ImageForceCacheRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.image.WaitForUpsertedImageTagsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForTaggedImage",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "upsertImageTags"
 },
 {
 "context": {
 "beforeStagePlanningFailed": true,
 "continuePipeline": false,
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [],
 "stackTrace": "java.lang.NullPointerException\n\tat com.netflix.spinnaker.orca.igor.pipeline.TravisStage.taskGraph(TravisStage.java:36)\n\tat com.netflix.spinnaker.orca.api.pipeline.graph.StageDefinitionBuilder.buildTaskGraph(StageDefinitionBuilder.java:48)\n\tat com.netflix.spinnaker.orca.q.StageDefinitionBuildersKt.buildTasks(StageDefinitionBuilders.kt:41)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.plan(StartStageHandler.kt:173)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.access$plan(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:99)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withAuth(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:81)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withExecution(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withStage(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:79)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "NullPointerException",
 "operation": "Travis",
 "shouldRetry": false,
 "timestamp": 1620926704081
 },
 "failPipeline": true
 },
 "endTime": 1620926704398,
 "id": "01F5KC59VXPMHB9QXG535QFZJG",
 "lastModified": null,
 "name": "Travis",
 "outputs": {},
 "parentStageId": null,
 "refId": "40",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704031,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "travis"
 },
 {
 "context": {
 "account": "spinnaker",
 "cloudProvider": "kubernetes",
 "location": "staging",
 "manifestName": "deployment hostname",
 "mode": "static",
 "numRevisionsBack": 1
 },
 "endTime": null,
 "id": "01F5KC59VX9TE0A2AJ6XMJ8F4X",
 "lastModified": null,
 "name": "Undo Rollout (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "41",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703984,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.UndoRolloutManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "undoRolloutManifest",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704314,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorUndoRollout",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.WaitForManifestStableTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForManifestToStabilize",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "undoRolloutManifest"
 },
 {
 "context": {
 "waitTime": 30
 },
 "endTime": null,
 "id": "01F5KC59VXSZJG27YDEWDA3X4N",
 "lastModified": null,
 "name": "Wait",
 "outputs": {},
 "parentStageId": null,
 "refId": "42",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704152,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706086,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.WaitTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "wait",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704453,
 "status": "CANCELED"
 }
 ],
 "type": "wait"
 },
 {
 "context": {
 "statusUrlResolution": "getMethod"
 },
 "endTime": null,
 "id": "01F5KC59VXHMA91KG8XYQ7RRZK",
 "lastModified": null,
 "name": "Webhook",
 "outputs": {},
 "parentStageId": null,
 "refId": "43",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704157,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.webhook.tasks.CreateWebhookTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createWebhook",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704632,
 "status": "RUNNING"
 }
 ],
 "type": "webhook"
 },
 {
 "context": {
 "continuePipeline": false,
 "failPipeline": true
 },
 "endTime": null,
 "id": "01F5KC59VXKBS6NWPNNTG1T1EH",
 "lastModified": null,
 "name": "Wercker",
 "outputs": {},
 "parentStageId": null,
 "refId": "44",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704161,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startWerckerJob",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704452,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorWerckerJobStartedTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForWerckerJobStart",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorWerckerJob",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildPropertiesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildProperties",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "wercker"
 },
 {
 "context": {
 "amiSuffix": "20210513172504",
 "baseLabel": "release",
 "baseOs": "ubuntu",
 "cloudProviderType": "aws",
 "extendedAttributes": {},
 "name": "Bake in us-east-2",
 "package": "nginx vim",
 "rebake": true,
 "region": "us-east-2",
 "storeType": "ebs",
 "type": "bake",
 "user": "myUserName",
 "vmType": "hvm"
 },
 "endTime": null,
 "id": "01F5KC5AJECT88MA2PHYG6TT3G",
 "lastModified": null,
 "name": "Bake in us-east-2",
 "outputs": {},
 "parentStageId": "01F5KC59VXEMS65RNVKF5HJJ9S",
 "refId": "8<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704513,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.CreateBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createBake",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926705585,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.MonitorBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorBake",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.CompletedBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "completedBake",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "bake"
 },
 {
 "context": {
 "amiSuffix": "20210513172504",
 "baseLabel": "release",
 "baseOs": "ubuntu",
 "cloudProviderType": "aws",
 "extendedAttributes": {},
 "package": "nginx vim",
 "rebake": true,
 "region": "us-east-2",
 "regions": [
 "us-east-2"
 ],
 "storeType": "ebs",
 "user": "myUserName",
 "vmType": "hvm"
 },
 "endTime": null,
 "id": "01F5KC59VXEMS65RNVKF5HJJ9S",
 "lastModified": null,
 "name": "Bake",
 "outputs": {},
 "parentStageId": null,
 "refId": "8",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704174,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.pipeline.BakeStage.CompleteParallelBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "completeParallel",
 "stageEnd": true,
 "stageStart": true,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "bake"
 },
 {
 "context": {},
 "endTime": null,
 "id": "01F5KC59VX4RE5RZVJG239ZD42",
 "lastModified": null,
 "name": "AWS CodeBuild",
 "outputs": {},
 "parentStageId": null,
 "refId": "9",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704185,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706077,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartAwsCodeBuildTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startAwsCodeBuildTask",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704452,
 "status": "CANCELED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorAwsCodeBuildTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorAwsCodeBuildTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetAwsCodeBuildArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getAwsCodeBuildArtifactsTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "awsCodeBuild"
 }
 ],
 "startTime": 1620926703525,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "systemNotifications": [],
 "templateVariables": null,
 "trigger": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 }
 ],
 "correlationId": null,
 "isDryRun": false,
 "isRebake": false,
 "isStrategy": false,
 "notifications": [],
 "other": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 }
 ],
 "dryRun": false,
 "enabled": false,
 "eventId": "c1090782-f485-490e-a2d7-31763b3bd4d8",
 "executionId": "01F5KC59TRGWKCP31C4N51CDSB",
 "expectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "notifications": [],
 "parameters": {},
 "preferred": false,
 "rebake": false,
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "strategy": false,
 "type": "manual",
 "user": "myUserName"
 },
 "parameters": {},
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "location": null,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": null,
 "type": "github/file",
 "uuid": null,
 "version": null
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "type": "manual",
 "user": "myUserName"
 },
 "type": "PIPELINE"
 },
 "stage": {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "regions": [
 "us-east-2"
 ],
 "target": "current_asg_dynamic"
 },
 "endTime": null,
 "id": "01F5KC5AFSDSNE2QQEBV91VKF1",
 "lastModified": null,
 "name": "determineTargetServerGroup",
 "outputs": {},
 "parentStageId": "01F5KC59VXHAQ7P03S2RD1MHKP",
 "refId": "16<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704525,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.support.DetermineTargetServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineTargetServerGroup",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926705590,
 "status": "RUNNING"
 }
 ],
 "type": "determineTargetServerGroup"
 },
 "user": {
 "isAdmin": false,
 "roles": [],
 "username": "myUserName"
 }
 }
}

Keys

Parameters related to the stage against which the policy is executing can be found in the input.stage.context object.

input.pipeline

Key	Type	Description
`input.pipeline.application`	`string`	The name of the Spinnaker application to which this pipeline belongs.
`input.pipeline.authentication.allowedAccounts[]`	`string`	The list of accounts to which the user this stage runs as has access.
`input.pipeline.authentication.user`	`string`	The Spinnaker user initiating the change.
`input.pipeline.buildTime`	`number`
`input.pipeline.canceled`	`boolean`
`input.pipeline.canceledBy`
`input.pipeline.cancellationReason`
`input.pipeline.description`	`string`	Description of the pipeline defined in the UI.
`input.pipeline.endTime`	`number`
`input.pipeline.id`	`string`	The unique ID of the pipeline.
`input.pipeline.keepWaitingPipelines`	`boolean`	If false and concurrent pipeline execution is disabled, then the pipelines in the waiting queue gets canceled when the next execution starts.
`input.pipeline.limitConcurrent`	`boolean`	True if only 1 concurrent execution of this pipeline is allowed.
`input.pipeline.name`	`string`	The name of this pipeline.
`input.pipeline.origin`	`string`
`input.pipeline.partition`
`input.pipeline.paused`
`input.pipeline.pipelineConfigId`	`string`
`input.pipeline.source`
`input.pipeline.stages[]`	`[array]`	An array of the stages in the pipeline. Typically if you are writing a policy that examines multiple pipeline stages, it is better to write that policy against either the `opa.pipelines package`, or the `spinnaker.execution.pipelines.before` package.
`input.pipeline.spelEvaluator`	`string`	Which version of spring expression language is being used to evaluate SpEL.
`input.pipeline.startTime`	`number`	Timestamp from when the pipeline was started.
`input.pipeline.startTimeExpiry`	`date`	Unix epoch date at which the pipeline expires.
`input.pipeline.status`	`string`
`input.pipeline.templateVariables`

input.pipeline.trigger

See input.pipeline.trigger for more information.

input.stage.context

Key	Type	Description
`input.stage.context.action`	`string`	What action is taken against the target server group.
`input.stage.context.cloudProvider`	`string`	The name of the cloud provider that executes the stage.
`input.stage.context.cloudProviderType`	`string`	The type of the cloud provider that executes the stage.
`input.stage.context.cluster`	`string`	The name of the AWS cluster to deploy to.
`input.stage.context.credentials`	`string`	The credentials/account used to connect to the cloud provider.
`input.stage.context.regions[]`	`string`	The regions to use.
`input.stage.context.target`	`string`	Which server group should be selected when this stage starts.

input.stage

See input.stage for more information.

input.user

This object provides information about the user performing the action. This can be used to restrict actions by role. See input.user for more information.

Plugins: spinnaker.execution.stages.before.disableCluster

Mon, 01 Jan 0001 00:00:00 +0000

Example Payload

Click to expand

{
 "input": {
 "pipeline": {
 "application": "test",
 "authentication": {
 "allowedAccounts": [
 "spinnaker",
 "staging",
 "staging-ecs"
 ],
 "user": "myUserName"
 },
 "buildTime": 1620926703486,
 "canceled": false,
 "canceledBy": null,
 "cancellationReason": null,
 "description": null,
 "endTime": 1620926705283,
 "id": "01F5KC59TRGWKCP31C4N51CDSB",
 "initialConfig": {},
 "keepWaitingPipelines": false,
 "limitConcurrent": true,
 "name": "test",
 "notifications": [],
 "origin": "api",
 "partition": null,
 "paused": null,
 "pipelineConfigId": "6a4cff2e-8265-4584-8993-2da2eb6254f5",
 "source": null,
 "spelEvaluator": "v4",
 "stages": [
 {
 "context": {
 "exception": {
 "details": {
 "error": "Internal Server Error",
 "errors": [
 "Bake failed: Error: file '/tmp/rosco-2833166343726058950/f547ea98-52eb-4b6c-8c17-173d21535456' does not appear to be a gzipped archive; got 'text/plain; charset=utf-8'\n"
 ],
 "kind": "HTTP",
 "responseBody": "{\"timestamp\":\"2021-05-13T17:25:05.658+00:00\",\"status\":500,\"error\":\"Internal Server Error\",\"message\":\"Bake failed: Error: file '/tmp/rosco-2833166343726058950/f547ea98-52eb-4b6c-8c17-173d21535456' does not appear to be a gzipped archive; got 'text/plain; charset=utf-8'\\n\"}",
 "status": 500,
 "url": "http://spin-rosco.spinnaker:8087/api/v2/manifest/bake/HELM2"
 },
 "exceptionType": "RetrofitError",
 "operation": "createBake",
 "shouldRetry": false,
 "timestamp": 1620926705665
 },
 "expectedArtifacts": [
 {
 "defaultArtifact": {
 "customKind": true,
 "id": "f9275bbf-fef7-4339-88f4-b2a18ec7b0ab"
 },
 "displayName": "pink-dog-80",
 "id": "eb9e5a6c-e9d1-489b-9f3b-4d414ba33b73",
 "matchArtifact": {
 "artifactAccount": "embedded-artifact",
 "customKind": false,
 "id": "301e50f0-2bc6-4d3e-894b-31dbf0b67bf0",
 "name": "test",
 "type": "embedded/base64"
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ],
 "inputArtifacts": [
 {
 "account": "",
 "id": "05ad020e-73a6-49f2-9988-2073831219e9"
 }
 ],
 "namespace": "testns",
 "outputName": "test",
 "overrides": {},
 "templateRenderer": "HELM2"
 },
 "endTime": null,
 "id": "01F5KC59VXSVC287E96M310EF5",
 "lastModified": null,
 "name": "Bake (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "10",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703574,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706252,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.manifests.CreateBakeManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createBake",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703700,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "bakeManifest"
 },
 {
 "context": {
 "analysisType": "realTimeAutomatic",
 "beforeStagePlanningFailed": true,
 "canaryConfig": {
 "metricsAccountName": "prometheus",
 "scopes": [
 {
 "extendedScopeParams": {},
 "scopeName": "default"
 }
 ],
 "scoreThresholds": {},
 "storageAccountName": "s3"
 },
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Canary stage configuration must include either `endTime` or `lifetimeDuration`."
 ],
 "stackTrace": "java.lang.IllegalArgumentException: Canary stage configuration must include either `endTime` or `lifetimeDuration`.\n\tat com.netflix.spinnaker.orca.kayenta.pipeline.KayentaCanaryStage.beforeStages(KayentaCanaryStage.kt:56)\n\tat com.netflix.spinnaker.orca.q.StageDefinitionBuildersKt.buildBeforeStages(StageDefinitionBuilders.kt:103)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.plan(StartStageHandler.kt:174)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.access$plan(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:99)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withAuth(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:81)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withExecution(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withStage(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:79)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalArgumentException",
 "operation": "Canary Analysis",
 "shouldRetry": false,
 "timestamp": 1620926704026
 }
 },
 "endTime": 1620926704342,
 "id": "01F5KC59VXZA70H3SN0GQWE1DT",
 "lastModified": null,
 "name": "Canary Analysis",
 "outputs": {},
 "parentStageId": null,
 "refId": "11",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703576,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kayenta.tasks.AggregateCanaryResultsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "aggregateCanaryResults",
 "stageEnd": true,
 "stageStart": true,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "kayentaCanary"
 },
 {
 "context": {
 "application": "test",
 "attempt": 2,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "consecutiveNotFound": 0,
 "copySourceCustomBlockDeviceMappings": false,
 "credentials": "staging",
 "freeFormDetails": "",
 "lastException": "Unable to locate current_asg_dynamic in staging/us-east-2/test\ncom.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroup$NotFoundException: Unable to locate current_asg_dynamic in staging/us-east-2/test\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n\tat java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)\n\tat org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:80)\n\tat org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:74)\n\tat org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:237)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:249)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver.resolveByTarget(TargetServerGroupResolver.groovy:75)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:101)\n\tat groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)\n\tat org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:351)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.callCurrent(PogoMetaClassSite.java:64)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:156)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:176)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver$_resolveByParams_closure1.doCall(TargetServerGroupResolver.groovy:56)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:101)\n\tat groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)\n\tat org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:263)\n\tat groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1041)\n\tat groovy.lang.Closure.call(Closure.java:405)\n\tat groovy.lang.Closure.call(Closure.java:421)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3574)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3559)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collect(DefaultGroovyMethods.java:3659)\n\tat org.codehaus.groovy.runtime.dgm$87.invoke(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:244)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:53)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupResolver.resolveByParams(TargetServerGroupResolver.groovy:54)\n\tat com.netflix.spinnaker.orca.kato.pipeline.support.SourceResolver.getSource(SourceResolver.groovy:79)\n\tat com.netflix.spinnaker.orca.kato.pipeline.support.SourceResolver$getSource.call(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask.execute(DetermineSourceServerGroupTask.groovy:59)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n",
 "region": "us-east-2",
 "stack": "",
 "target": "current_asg_dynamic",
 "targetCluster": "test",
 "useAmiBlockDeviceMappings": false,
 "useSourceCapacity": true
 },
 "endTime": null,
 "id": "01F5KC59VXW75H7Q7Z2C87CXET",
 "lastModified": null,
 "name": "Clone Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "12",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703580,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineSourceServerGroup",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703830,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.pipeline.providers.aws.CaptureSourceServerGroupCapacityTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "snapshotSourceServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.CloneServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "cloneServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.instance.WaitForUpInstancesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForUpInstances",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "8",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "9",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetCommitsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getCommits",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "cloneServerGroup"
 },
 {
 "context": {
 "failOnFailedExpressions": true
 },
 "endTime": null,
 "id": "01F5KC59VX419V14RWY4JCWEHK",
 "lastModified": null,
 "name": "Concourse",
 "outputs": {},
 "parentStageId": null,
 "refId": "13",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703586,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.WaitForConcourseJobStartTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForConcourseJobStartTask",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703684,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.WaitForConcourseJobCompletionTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForConcourseJobCompletionTask",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "concourse"
 },
 {
 "context": {
 "kato.last.task.id": {
 "id": "f377bbb1-d404-4ff7-8444-b25e5b3ccf10"
 },
 "kato.result.expected": true,
 "loadBalancers": [],
 "notification.type": "upsertloadbalancer",
 "targets": []
 },
 "endTime": null,
 "id": "01F5KC59VX3VNVYJ5PTGDJQ4PK",
 "lastModified": null,
 "name": "Create Load Balancers",
 "outputs": {},
 "parentStageId": null,
 "refId": "14",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703592,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926704382,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.loadbalancer.UpsertLoadBalancersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "upsertLoadBalancers",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703674,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorUpsert",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620926705108,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.loadbalancer.UpsertLoadBalancerResultObjectExtrapolationTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "extrapolateUpsertResult",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.loadbalancer.UpsertLoadBalancerForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "upsertLoadBalancers"
 },
 {
 "context": {
 "account": "staging",
 "application": "test",
 "availabilityZones": {
 "us-east-2": [
 "us-east-2a",
 "us-east-2b",
 "us-east-2c"
 ]
 },
 "capacity": {
 "desired": 1,
 "max": 1,
 "min": 1
 },
 "cloudProvider": "aws",
 "cooldown": 10,
 "copySourceCustomBlockDeviceMappings": false,
 "ebsOptimized": false,
 "enabledMetrics": [],
 "freeFormDetails": "",
 "healthCheckGracePeriod": 600,
 "healthCheckType": "EC2",
 "iamRole": "BaseIAMRole",
 "instanceMonitoring": false,
 "instanceType": "t3.nano",
 "keyPair": "Demo",
 "loadBalancers": [],
 "name": "Deploy in us-east-2",
 "provider": "aws",
 "reason": "sad",
 "securityGroups": [],
 "source": {},
 "spotPrice": "",
 "stack": "",
 "strategy": "",
 "subnetType": "",
 "suspendedProcesses": [],
 "tags": {},
 "targetGroups": [],
 "targetHealthyDeployPercentage": 100,
 "terminationPolicies": [
 "Default"
 ],
 "type": "createServerGroup",
 "useAmiBlockDeviceMappings": false
 },
 "endTime": null,
 "id": "01F5KC59ZVHCFYZPQ9851X0D3X",
 "lastModified": null,
 "name": "Deploy in us-east-2",
 "outputs": {},
 "parentStageId": "01F5KC59VX6DZFTP10F521J3G2",
 "refId": "15<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703698,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": 1620926706124,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kato.pipeline.strategy.DetermineSourceServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineSourceServerGroup",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703970,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.pipeline.providers.aws.CaptureSourceServerGroupCapacityTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "snapshotSourceServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.CreateServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createServerGroup",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.instance.WaitForUpInstancesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForUpInstances",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "8",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "9",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetCommitsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getCommits",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "createServerGroup"
 },
 {
 "context": {
 "clusters": [
 {
 "account": "staging",
 "application": "test",
 "availabilityZones": {
 "us-east-2": [
 "us-east-2a",
 "us-east-2b",
 "us-east-2c"
 ]
 },
 "capacity": {
 "desired": 1,
 "max": 1,
 "min": 1
 },
 "cloudProvider": "aws",
 "cooldown": 10,
 "copySourceCustomBlockDeviceMappings": false,
 "ebsOptimized": false,
 "enabledMetrics": [],
 "freeFormDetails": "",
 "healthCheckGracePeriod": 600,
 "healthCheckType": "EC2",
 "iamRole": "BaseIAMRole",
 "instanceMonitoring": false,
 "instanceType": "t3.nano",
 "keyPair": "Demo",
 "loadBalancers": [],
 "provider": "aws",
 "reason": "sad",
 "securityGroups": [],
 "spotPrice": "",
 "stack": "",
 "strategy": "",
 "subnetType": "",
 "suspendedProcesses": [],
 "tags": {},
 "targetGroups": [],
 "targetHealthyDeployPercentage": 100,
 "terminationPolicies": [
 "Default"
 ],
 "useAmiBlockDeviceMappings": false
 }
 ]
 },
 "endTime": null,
 "id": "01F5KC59VX6DZFTP10F521J3G2",
 "lastModified": null,
 "name": "Deploy",
 "outputs": {},
 "parentStageId": null,
 "refId": "15",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703597,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.kato.pipeline.ParallelDeployStage.CompleteParallelDeployTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "completeParallelDeploy",
 "stageEnd": true,
 "stageStart": true,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "deploy"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "regions": [
 "us-east-2"
 ],
 "target": "current_asg_dynamic"
 },
 "endTime": null,
 "id": "01F5KC5AFSDSNE2QQEBV91VKF1",
 "lastModified": null,
 "name": "determineTargetServerGroup",
 "outputs": {},
 "parentStageId": "01F5KC59VXHAQ7P03S2RD1MHKP",
 "refId": "16<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704525,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.support.DetermineTargetServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineTargetServerGroup",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926705590,
 "status": "RUNNING"
 }
 ],
 "type": "determineTargetServerGroup"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "region": "us-east-2",
 "target": "current_asg_dynamic",
 "targetLocation": {
 "type": "REGION",
 "value": "us-east-2"
 }
 },
 "endTime": null,
 "id": "01F5KC5AGTMK1EHY3RN5X25F9H",
 "lastModified": null,
 "name": "destroyServerGroup",
 "outputs": {},
 "parentStageId": "01F5KC59VXHAQ7P03S2RD1MHKP",
 "refId": "16<2",
 "requisiteStageRefIds": [
 "16<1"
 ],
 "scheduledTime": null,
 "startTime": null,
 "startTimeExpiry": null,
 "status": "NOT_STARTED",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [],
 "type": "destroyServerGroup"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "target": "current_asg_dynamic"
 },
 "endTime": null,
 "id": "01F5KC59VXHAQ7P03S2RD1MHKP",
 "lastModified": null,
 "name": "Destroy Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "16",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703600,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "destroyServerGroup"
 },
 {
 "context": {
 "credentials": "staging",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "No regions selected. At least one region must be chosen."
 ],
 "stackTrace": "java.lang.IllegalArgumentException: No regions selected. At least one region must be chosen.\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.DeployCloudFormationTask.lambda$execute$2(DeployCloudFormationTask.java:146)\n\tat java.base/java.util.Optional.orElseThrow(Optional.java:408)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.DeployCloudFormationTask.execute(DeployCloudFormationTask.java:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalArgumentException",
 "operation": "deployCloudFormation",
 "shouldRetry": false,
 "timestamp": 1620926704546
 },
 "parameters": {},
 "regions": [],
 "source": "artifact",
 "stackArtifactAccount": "myUserName",
 "stackArtifactId": "05ad020e-73a6-49f2-9988-2073831219e9",
 "stackName": "satest",
 "tags": {}
 },
 "endTime": 1620926706234,
 "id": "01F5KC59VXV45WRT9VBRT4HSQC",
 "lastModified": null,
 "name": "Deploy (CloudFormation Stack)",
 "outputs": {},
 "parentStageId": null,
 "refId": "17",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703613,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705629,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.DeployCloudFormationTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "deployCloudFormation",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703699,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorCloudFormation",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.CloudFormationForceCacheRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceRefreshCache",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.cloudformation.WaitForCloudFormationCompletionTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForCloudFormationCompletion",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "deployCloudFormation"
 },
 "01F5KC59VX9BYMY7CCXAG75NXT",
 {
 "context": {
 "beforeStagePlanningFailed": true,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "test",
 "credentials": "staging",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Cannot invoke method singularType() on null object"
 ],
 "stackTrace": "java.lang.NullPointerException: Cannot invoke method singularType() on null object\n\tat org.codehaus.groovy.runtime.NullObject.invokeMethod(NullObject.java:91)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:43)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.NullCallSite.call(NullCallSite.java:34)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:119)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.composeDynamicTargets(TargetServerGroupLinearStageSupport.groovy:176)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.runtime.callsite.PlainObjectMetaMethodSite.doInvoke(PlainObjectMetaMethodSite.java:43)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:190)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:58)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:156)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:184)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.composeTargets(TargetServerGroupLinearStageSupport.groovy:144)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport$composeTargets.callCurrent(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport$composeTargets.callCurrent(Unknown Source)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.beforeStages(TargetServerGroupLinearStageSupport.groovy:110)\n\tat com.netflix.spinnaker.orca.q.StageDefinitionBuildersKt.buildBeforeStages(StageDefinitionBuilders.kt:103)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.plan(StartStageHandler.kt:174)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.access$plan(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:99)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withAuth(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:81)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withExecution(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withStage(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:79)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "NullPointerException",
 "operation": "Enable Server Group",
 "shouldRetry": false,
 "timestamp": 1620926704111
 },
 "target": "current_asg_dynamic"
 },
 "endTime": 1620926704409,
 "id": "01F5KC59VXD2VE54883ZMJHEX3",
 "lastModified": null,
 "name": "Enable Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "19",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703624,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "enableServerGroup"
 },
 {
 "context": {
 "entityRef": {
 "entityId": "test",
 "entityType": "application"
 },
 "tags": [
 {
 "name": "test",
 "namespace": "testns",
 "value": "test"
 }
 ]
 },
 "endTime": null,
 "id": "01F5KC59VX8MSHMTMHBY1YR8Y0",
 "lastModified": null,
 "name": "Entity Tags",
 "outputs": {},
 "parentStageId": null,
 "refId": "20",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703665,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.entitytags.UpsertEntityTagsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "upsertEntityTags",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703784,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorUpsert",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "upsertEntityTags"
 },
 {
 "context": {
 "expressionEvaluationSummary": {
 "trigger.buildInfo.number": [
 {
 "description": "Failed to evaluate [var] EL1007E: Property or field 'number' cannot be found on null",
 "exceptionType": "org.springframework.expression.spel.SpelEvaluationException",
 "level": "ERROR",
 "timestamp": 1620926706348
 }
 ]
 },
 "failOnFailedExpressions": true,
 "variables": [
 {
 "key": "test",
 "sourceValue": "{trigger.buildInfo.number}",
 "value": "${trigger.buildInfo.number}"
 }
 ]
 },
 "endTime": null,
 "id": "01F5KC59VXH51C7G7KH5CA8JDZ",
 "lastModified": null,
 "name": "Evaluate Variables",
 "outputs": {
 "test": "${trigger.buildInfo.number}"
 },
 "parentStageId": null,
 "refId": "21",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704036,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706275,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.EvaluateVariablesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "evaluateVariables",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704354,
 "status": "SUCCEEDED"
 }
 ],
 "type": "evaluateVariables"
 },
 {
 "context": {
 "application": "hostname",
 "artifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname-metrics",
 "reference": "hostname-metrics",
 "type": "kubernetes/service",
 "version": ""
 }
 ],
 "executionOptions": {
 "successful": true
 },
 "expectedArtifacts": [
 {
 "defaultArtifact": {
 "customKind": true,
 "id": "df96edee-9d90-486c-b269-ef110f469499"
 },
 "displayName": "light-panther-92",
 "id": "4d764059-d642-4870-ae63-476e59af708c",
 "matchArtifact": {
 "customKind": true,
 "id": "7bd826db-a9c8-4052-ad15-5029baba0067"
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ],
 "pipeline": "7db1e350-dedb-4dc1-9976-e71f97b5f132",
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname-metrics",
 "reference": "hostname-metrics",
 "type": "kubernetes/service",
 "version": ""
 },
 "defaultArtifact": {
 "customKind": true,
 "metadata": {
 "id": "df96edee-9d90-486c-b269-ef110f469499"
 }
 },
 "id": "4d764059-d642-4870-ae63-476e59af708c",
 "matchArtifact": {
 "customKind": true,
 "metadata": {
 "id": "7bd826db-a9c8-4052-ad15-5029baba0067"
 }
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ]
 },
 "endTime": null,
 "id": "01F5KC59VXDDF9TBZTVM242YHT",
 "lastModified": null,
 "name": "Find Artifacts From Execution",
 "outputs": {
 "artifacts": [
 {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname-metrics",
 "reference": "hostname-metrics",
 "type": "kubernetes/service",
 "version": ""
 }
 ],
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "customKind": false,
 "location": "staging",
 "metadata": {
 "account": "spinnaker"
 },
 "name": "hostname-metrics",
 "reference": "hostname-metrics",
 "type": "kubernetes/service",
 "version": ""
 },
 "defaultArtifact": {
 "customKind": true,
 "metadata": {
 "id": "df96edee-9d90-486c-b269-ef110f469499"
 }
 },
 "id": "4d764059-d642-4870-ae63-476e59af708c",
 "matchArtifact": {
 "customKind": true,
 "metadata": {
 "id": "7bd826db-a9c8-4052-ad15-5029baba0067"
 }
 },
 "useDefaultArtifact": false,
 "usePriorArtifact": false
 }
 ]
 },
 "parentStageId": null,
 "refId": "22",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703681,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706126,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.artifacts.FindArtifactFromExecutionTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "findArtifactFromExecution",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926703882,
 "status": "SUCCEEDED"
 }
 ],
 "type": "findArtifactFromExecution"
 },
 {
 "context": {
 "account": "spinnaker",
 "app": "test",
 "cloudProvider": "kubernetes",
 "location": "spinnaker",
 "manifestName": "deployment spin-gate",
 "mode": "static"
 },
 "endTime": null,
 "id": "01F5KC59VXS0PN55TX4ARCFFCS",
 "lastModified": null,
 "name": "Find Artifacts From Resource (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "23",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703707,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705606,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.ResolveTargetManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "resolveTargetManifest",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703827,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.artifacts.FindArtifactsFromResourceTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "findArtifactsFromResource",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620926706170,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "findArtifactsFromResource"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "test",
 "credentials": "staging",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Could not find cluster 'test' for 'staging' in 'us-east-2'."
 ],
 "stackTrace": "java.lang.IllegalStateException: Could not find cluster 'test' for 'staging' in 'us-east-2'.\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)\n\tat java.base/java.lang.reflect.Constructor.newInstance(Constructor.java:490)\n\tat org.codehaus.groovy.reflection.CachedConstructor.invoke(CachedConstructor.java:80)\n\tat org.codehaus.groovy.reflection.CachedConstructor.doConstructorInvoke(CachedConstructor.java:74)\n\tat org.codehaus.groovy.runtime.callsite.ConstructorSite$ConstructorSiteNoUnwrap.callConstructor(ConstructorSite.java:84)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallConstructor(CallSiteArray.java:59)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:237)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callConstructor(AbstractCallSite.java:249)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.cluster.FindImageFromClusterTask$_execute_closure2.doCall(FindImageFromClusterTask.groovy:178)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.reflection.CachedMethod.invoke(CachedMethod.java:101)\n\tat groovy.lang.MetaMethod.doMethodInvoke(MetaMethod.java:323)\n\tat org.codehaus.groovy.runtime.metaclass.ClosureMetaClass.invokeMethod(ClosureMetaClass.java:263)\n\tat groovy.lang.MetaClassImpl.invokeMethod(MetaClassImpl.java:1041)\n\tat groovy.lang.Closure.call(Closure.java:405)\n\tat groovy.lang.Closure.call(Closure.java:421)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collectEntries(DefaultGroovyMethods.java:4137)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collectEntries(DefaultGroovyMethods.java:4044)\n\tat org.codehaus.groovy.runtime.DefaultGroovyMethods.collectEntries(DefaultGroovyMethods.java:4069)\n\tat org.codehaus.groovy.runtime.dgm$96.invoke(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite$PojoMetaMethodSiteNoUnwrapNoCoerce.invoke(PojoMetaMethodSite.java:244)\n\tat org.codehaus.groovy.runtime.callsite.PojoMetaMethodSite.call(PojoMetaMethodSite.java:53)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.cluster.FindImageFromClusterTask.execute(FindImageFromClusterTask.groovy:141)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalStateException",
 "operation": "findImage",
 "shouldRetry": false,
 "timestamp": 1620926705232
 },
 "onlyEnabled": true,
 "regions": [
 "us-east-2"
 ],
 "selectionStrategy": "LARGEST"
 },
 "endTime": 1620926706311,
 "id": "01F5KC59VXR6HM4ZDGQS533X3Z",
 "lastModified": null,
 "name": "Find Image from Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "24",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703771,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705748,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.FindImageFromClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "findImage",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704082,
 "status": "TERMINAL"
 }
 ],
 "type": "findImage"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "exception": {
 "details": {
 "error": "Bad Request",
 "errors": [
 "Minimum of 3 characters required to filter namedImages"
 ],
 "kind": "HTTP",
 "responseBody": "{\"error\":\"Bad Request\",\"message\":\"Minimum of 3 characters required to filter namedImages\",\"status\":400,\"timestamp\":1620926705030}",
 "status": 400,
 "url": "http://spin-clouddriver.spinnaker:7002/aws/images/find?tag:test=test"
 },
 "exceptionType": "RetrofitError",
 "operation": "findImage",
 "shouldRetry": false,
 "timestamp": 1620926705048
 },
 "regions": [
 "us-east-2"
 ],
 "tags": {
 "test": "test"
 }
 },
 "endTime": 1620926706292,
 "id": "01F5KC59VXVYM16F67ZF4DKPDP",
 "lastModified": null,
 "name": "Find Image from Tags",
 "outputs": {},
 "parentStageId": null,
 "refId": "25",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703765,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705759,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.image.FindImageFromTagsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "findImage",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704147,
 "status": "TERMINAL"
 }
 ],
 "type": "findImageFromTags"
 },
 {
 "context": {
 "exception": {
 "details": {
 "error": "Path parameter \"account\" value must not be null.",
 "errors": [],
 "kind": "UNEXPECTED"
 },
 "exceptionType": "RetrofitError",
 "operation": "startGoogleCloudBuildTask",
 "shouldRetry": false,
 "timestamp": 1620926705364
 }
 },
 "endTime": null,
 "id": "01F5KC59VXFCE23E6ZZVWS5E34",
 "lastModified": null,
 "name": "Google Cloud Build",
 "outputs": {},
 "parentStageId": null,
 "refId": "26",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703770,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705938,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartGoogleCloudBuildTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startGoogleCloudBuildTask",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704336,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorGoogleCloudBuildTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorGoogleCloudBuildTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetGoogleCloudBuildArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getGoogleCloudBuildArtifactsTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "googleCloudBuild"
 },
 {
 "context": {
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "No API Key provided"
 ],
 "stackTrace": "java.lang.RuntimeException: No API Key provided\n\tat com.netflix.spinnaker.orca.gremlin.pipeline.GremlinStage.getApiKey(GremlinStage.java:58)\n\tat com.netflix.spinnaker.orca.gremlin.tasks.LaunchGremlinAttackTask.execute(LaunchGremlinAttackTask.java:31)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "RuntimeException",
 "operation": "launchGremlinAttack",
 "shouldRetry": false,
 "timestamp": 1620926704638
 }
 },
 "endTime": 1620926706252,
 "id": "01F5KC59VXD6BY9PBRNTTQJVPV",
 "lastModified": null,
 "name": "Gremlin",
 "outputs": {},
 "parentStageId": null,
 "refId": "27",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703775,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705680,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.gremlin.tasks.LaunchGremlinAttackTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "launchGremlinAttack",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704078,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.gremlin.tasks.MonitorGremlinAttackTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorGremlinAttack",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "gremlin"
 },
 {
 "context": {
 "continuePipeline": false,
 "exception": {
 "details": {
 "error": "Path parameter \"name\" value must not be null.",
 "errors": [],
 "kind": "UNEXPECTED"
 },
 "exceptionType": "RetrofitError",
 "operation": "startJenkinsJob",
 "shouldRetry": false,
 "timestamp": 1620926705729
 },
 "failPipeline": true
 },
 "endTime": null,
 "id": "01F5KC59VX8GY09S5X7RW10BWR",
 "lastModified": null,
 "name": "Jenkins",
 "outputs": {},
 "parentStageId": null,
 "refId": "28",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703791,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706275,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startJenkinsJob",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704300,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorQueuedJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForJenkinsJobStart",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorJenkinsJob",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildPropertiesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildProperties",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "jenkins"
 },
 {
 "context": {
 "action": "suspend",
 "cloudProvider": "aws",
 "cluster": "test",
 "credentials": "staging",
 "processes": [],
 "regions": [
 "us-east-2"
 ],
 "target": "current_asg_dynamic"
 },
 "endTime": null,
 "id": "01F5KC5AFRWAY7V0E7H2YQ6N87",
 "lastModified": null,
 "name": "determineTargetServerGroup",
 "outputs": {},
 "parentStageId": "01F5KC59VXWZ12ZWT3J2F4FQ4V",
 "refId": "29<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704606,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.support.DetermineTargetServerGroupTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineTargetServerGroup",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926705670,
 "status": "RUNNING"
 }
 ],
 "type": "determineTargetServerGroup"
 },
 {
 "context": {
 "action": "suspend",
 "cloudProvider": "aws",
 "cluster": "test",
 "credentials": "staging",
 "processes": [],
 "region": "us-east-2",
 "target": "current_asg_dynamic",
 "targetLocation": {
 "type": "REGION",
 "value": "us-east-2"
 }
 },
 "endTime": null,
 "id": "01F5KC5AH42HXDTZS8YDQ0JAD7",
 "lastModified": null,
 "name": "modifyAwsScalingProcess",
 "outputs": {},
 "parentStageId": "01F5KC59VXWZ12ZWT3J2F4FQ4V",
 "refId": "29<2",
 "requisiteStageRefIds": [
 "29<1"
 ],
 "scheduledTime": null,
 "startTime": null,
 "startTimeExpiry": null,
 "status": "NOT_STARTED",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [],
 "type": "modifyAwsScalingProcess"
 },
 {
 "context": {
 "action": "suspend",
 "cloudProvider": "aws",
 "cluster": "test",
 "credentials": "staging",
 "processes": [],
 "target": "current_asg_dynamic"
 },
 "endTime": null,
 "id": "01F5KC59VXWZ12ZWT3J2F4FQ4V",
 "lastModified": null,
 "name": "Modify Scaling Process",
 "outputs": {},
 "parentStageId": null,
 "refId": "29",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703815,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "modifyAwsScalingProcess"
 },
 {
 "context": {
 "account": "spinnaker",
 "app": "test",
 "cloudProvider": "kubernetes",
 "location": "staging",
 "manifestName": "deployment hostname",
 "mode": "static",
 "options": {
 "mergeStrategy": "strategic",
 "record": true
 },
 "patchBody": [
 {
 "apiVersion": "apps/v1",
 "kind": "Deployment",
 "metadata": {
 "name": "hostname",
 "namespace": "staging"
 },
 "spec": {
 "replicas": "1",
 "selector": {
 "matchLabels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "strategy": {
 "rollingUpdate": {
 "maxSurge": 1,
 "maxUnavailable": 1
 },
 "type": "RollingUpdate"
 },
 "template": {
 "metadata": {
 "annotations": {
 "prometheus.io/port": "9113",
 "prometheus.io/scrape": "true"
 },
 "labels": {
 "app": "hostname",
 "version": "v1"
 }
 },
 "spec": {
 "containers": [
 {
 "image": "rstarmer/hostname:v1",
 "imagePullPolicy": "Always",
 "name": "hostname",
 "resources": {},
 "volumeMounts": [
 {
 "mountPath": "/etc/nginx/conf.d/nginx-status.conf",
 "name": "nginx-status-conf",
 "readOnly": true,
 "subPath": "nginx.status.conf"
 }
 ]
 },
 {
 "args": [
 "-nginx.scrape-uri=http://localhost:8090/nginx_status"
 ],
 "image": "nginx/nginx-prometheus-exporter:0.3.0",
 "imagePullPolicy": "Always",
 "name": "nginx-exporter",
 "ports": [
 {
 "containerPort": 9113,
 "name": "nginx-ex-port",
 "protocol": "TCP"
 }
 ]
 }
 ],
 "restartPolicy": "Always",
 "volumes": [
 {
 "configMap": {
 "defaultMode": 420,
 "name": "nginx-status-conf"
 },
 "name": "nginx-status-conf"
 }
 ]
 }
 }
 }
 }
 ],
 "source": "text"
 },
 "endTime": null,
 "id": "01F5KC59VXC778CNV0X6TKP9A6",
 "lastModified": null,
 "name": "Patch (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "30",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703872,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706122,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.ResolveTargetManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "resolveTargetManifest",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704220,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.ResolvePatchSourceManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "resolvePatchSourceManifest",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.PatchManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "patchManifest",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorPatch",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.PromoteManifestKatoOutputsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "promoteOutputs",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.WaitForManifestStableTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForManifestToStabilize",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "patchManifest"
 },
 {
 "context": {
 "application": "test",
 "failPipeline": true,
 "pipeline": "da91948b-b4a6-4483-88ef-e25bc69f83a9",
 "waitForCompletion": true
 },
 "endTime": null,
 "id": "01F5KC59VXCAGPGW4W0KPA3W18",
 "lastModified": null,
 "name": "Pipeline",
 "outputs": {},
 "parentStageId": null,
 "refId": "31",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703872,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.front50.tasks.StartPipelineTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startPipeline",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704268,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.front50.tasks.MonitorPipelineTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorPipeline",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "pipeline"
 },
 {
 "context": {
 "action": "scale_up",
 "beforeStagePlanningFailed": true,
 "capacity": {},
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Cannot invoke method singularType() on null object"
 ],
 "stackTrace": "java.lang.NullPointerException: Cannot invoke method singularType() on null object\n\tat org.codehaus.groovy.runtime.NullObject.invokeMethod(NullObject.java:91)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaClassSite.call(PogoMetaClassSite.java:43)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.NullCallSite.call(NullCallSite.java:34)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:119)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.composeDynamicTargets(TargetServerGroupLinearStageSupport.groovy:176)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\n\tat java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.codehaus.groovy.runtime.callsite.PlainObjectMetaMethodSite.doInvoke(PlainObjectMetaMethodSite.java:43)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite$PogoCachedMethodSiteNoUnwrapNoCoerce.invoke(PogoMetaMethodSite.java:190)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:58)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat org.codehaus.groovy.runtime.callsite.PogoMetaMethodSite.callCurrent(PogoMetaMethodSite.java:63)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.callCurrent(AbstractCallSite.java:184)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.composeTargets(TargetServerGroupLinearStageSupport.groovy:144)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport$composeTargets.callCurrent(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCallCurrent(CallSiteArray.java:51)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport$composeTargets.callCurrent(Unknown Source)\n\tat com.netflix.spinnaker.orca.clouddriver.pipeline.servergroup.support.TargetServerGroupLinearStageSupport.beforeStages(TargetServerGroupLinearStageSupport.groovy:110)\n\tat com.netflix.spinnaker.orca.q.StageDefinitionBuildersKt.buildBeforeStages(StageDefinitionBuilders.kt:103)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.plan(StartStageHandler.kt:174)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.access$plan(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:99)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withAuth(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:81)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withExecution(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withStage(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:79)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "NullPointerException",
 "operation": "Resize Server Group",
 "shouldRetry": false,
 "timestamp": 1620926704112
 },
 "resizeType": "pct",
 "target": "current_asg_dynamic",
 "targetHealthyDeployPercentage": 100
 },
 "endTime": 1620926704426,
 "id": "01F5KC59VXJWHXYA30AFABEW9W",
 "lastModified": null,
 "name": "Resize Server Group",
 "outputs": {},
 "parentStageId": null,
 "refId": "32",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703885,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "resizeServerGroup"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "credentials": "staging",
 "regions": [
 "us-east-2"
 ],
 "targetHealthyRollbackPercentage": 100
 },
 "endTime": null,
 "id": "01F5KC59VXNYZJ0640BVZXQ46N",
 "lastModified": null,
 "name": "Rollback Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "33",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703883,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.DetermineRollbackCandidatesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineRollbackCandidates",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704276,
 "status": "RUNNING"
 }
 ],
 "type": "rollbackCluster"
 },
 {
 "context": {
 "account": "spinnaker",
 "alias": "runJob",
 "application": "test",
 "cloudProvider": "kubernetes",
 "credentials": "spinnaker",
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Run Job only supports manifests with a single Job."
 ],
 "stackTrace": "java.lang.IllegalArgumentException: Run Job only supports manifests with a single Job.\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.kubernetes.KubernetesJobRunner.getManifestFields(KubernetesJobRunner.java:70)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.kubernetes.KubernetesJobRunner.getOperations(KubernetesJobRunner.java:53)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.job.JobRunner$getOperations.call(Unknown Source)\n\tat org.codehaus.groovy.runtime.callsite.CallSiteArray.defaultCall(CallSiteArray.java:47)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:115)\n\tat org.codehaus.groovy.runtime.callsite.AbstractCallSite.call(AbstractCallSite.java:127)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.job.RunJobTask.execute(RunJobTask.groovy:72)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalArgumentException",
 "operation": "runJob",
 "shouldRetry": false,
 "timestamp": 1620926705804
 },
 "manifestArtifactId": "05ad020e-73a6-49f2-9988-2073831219e9",
 "source": "artifact"
 },
 "endTime": null,
 "id": "01F5KC59VX0JK21YEGDWX8310Z",
 "lastModified": null,
 "name": "Run Job (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "34",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703889,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706323,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.job.RunJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "runJob",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704288,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.job.MonitorJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDeploy",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.PromoteManifestKatoOutputsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "promoteOutputs",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.job.WaitOnJobCompletion",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitOnJobCompletion",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "runJobManifest"
 },
 {
 "context": {
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: '${parameters.namespace ?: staging}'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: '${parameters.namespace ?: staging}'\nspec:\n replicas: '3'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]"
 ],
 "stackTrace": "java.lang.IllegalStateException: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: '${parameters.namespace ?: staging}'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: '${parameters.namespace ?: staging}'\nspec:\n replicas: '3'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask.execute(GetPipelinesFromArtifactTask.java:100)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\nCaused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: '${parameters.namespace ?: staging}'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: '${parameters.namespace ?: staging}'\nspec:\n replicas: '3'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]\n\tat com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1851)\n\tat com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:707)\n\tat com.fasterxml.jackson.core.base.ParserMinimalBase.reportUnexpectedNumberChar(ParserMinimalBase.java:536)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleInvalidNumberStart(ReaderBasedJsonParser.java:1679)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser._parseNegNumber(ReaderBasedJsonParser.java:1433)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:758)\n\tat com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4664)\n\tat com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4513)\n\tat com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3468)\n\tat com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3451)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask.execute(GetPipelinesFromArtifactTask.java:97)\n\t... 35 more\n"
 },
 "exceptionType": "IllegalStateException",
 "operation": "getPipelinesFromArtifact",
 "shouldRetry": false,
 "timestamp": 1620926705714
 },
 "expressionEvaluationSummary": {
 "com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: 'parameters.namespace ?: staging'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: 'parameters.namespace ?: staging'\nspec:\n replicas: '#toInt( parameters.replicas ?: 3)'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]": [
 {
 "description": "Failed to evaluate com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: '${ parameters.namespace ?: staging }'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: '${ parameters.namespace ?: staging }'\nspec:\n replicas: '${ #toInt( parameters.replicas ?: 3) }'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3] : com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: 'parameters.namespace ?: staging'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: 'parameters.namespace ?: staging'\nspec:\n replicas: '#toInt( parameters.replicas ?: 3)'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3] not found",
 "level": "INFO",
 "timestamp": 1620926706287
 }
 ],
 "java.lang.IllegalStateException: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: 'parameters.namespace ?: staging'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: 'parameters.namespace ?: staging'\nspec:\n replicas: '#toInt( parameters.replicas ?: 3)'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask.execute(GetPipelinesFromArtifactTask.java:100)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\nCaused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: 'parameters.namespace ?: staging'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: 'parameters.namespace ?: staging'\nspec:\n replicas: '#toInt( parameters.replicas ?: 3)'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]\n\tat com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1851)\n\tat com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:707)\n\tat com.fasterxml.jackson.core.base.ParserMinimalBase.reportUnexpectedNumberChar(ParserMinimalBase.java:536)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleInvalidNumberStart(ReaderBasedJsonParser.java:1679)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser._parseNegNumber(ReaderBasedJsonParser.java:1433)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:758)\n\tat com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4664)\n\tat com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4513)\n\tat com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3468)\n\tat com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3451)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask.execute(GetPipelinesFromArtifactTask.java:97)\n\t... 35 more\n": [
 {
 "description": "Failed to evaluate [stackTrace] : java.lang.IllegalStateException: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: 'parameters.namespace ?: staging'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: 'parameters.namespace ?: staging'\nspec:\n replicas: '#toInt( parameters.replicas ?: 3)'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask.execute(GetPipelinesFromArtifactTask.java:100)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\nCaused by: com.fasterxml.jackson.core.JsonParseException: Unexpected character ('-' (code 45)) in numeric value: expected digit (0-9) to follow minus sign, for valid numeric value\n at [Source: (String)\"---\napiVersion: v1\nkind: Namespace\nmetadata:\n name: 'parameters.namespace ?: staging'\nspec:\n finalizers:\n - kubernetes\n---\napiVersion: apps/v1\nkind: Deployment\nmetadata:\n name: hostname\n namespace: 'parameters.namespace ?: staging'\nspec:\n replicas: '#toInt( parameters.replicas ?: 3)'\n selector:\n matchLabels:\n app: hostname\n version: v1\n strategy:\n rollingUpdate:\n maxSurge: 1\n maxUnavailable: 1\n type: RollingUpdate\n template:\n metadata:\n \"[truncated 1231 chars]; line: 1, column: 3]\n\tat com.fasterxml.jackson.core.JsonParser._constructError(JsonParser.java:1851)\n\tat com.fasterxml.jackson.core.base.ParserMinimalBase._reportError(ParserMinimalBase.java:707)\n\tat com.fasterxml.jackson.core.base.ParserMinimalBase.reportUnexpectedNumberChar(ParserMinimalBase.java:536)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser._handleInvalidNumberStart(ReaderBasedJsonParser.java:1679)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser._parseNegNumber(ReaderBasedJsonParser.java:1433)\n\tat com.fasterxml.jackson.core.json.ReaderBasedJsonParser.nextToken(ReaderBasedJsonParser.java:758)\n\tat com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4664)\n\tat com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4513)\n\tat com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3468)\n\tat com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3451)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask.execute(GetPipelinesFromArtifactTask.java:97)\n\t... 35 more\n not found",
 "level": "INFO",
 "timestamp": 1620926706260
 }
 ]
 },
 "pipelinesArtifactId": "05ad020e-73a6-49f2-9988-2073831219e9"
 },
 "endTime": null,
 "id": "01F5KC59VXEB15WXN5VSW8H8H8",
 "lastModified": null,
 "name": "Save Pipelines",
 "outputs": {},
 "parentStageId": null,
 "refId": "35",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703891,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706257,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.GetPipelinesFromArtifactTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getPipelinesFromArtifact",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704288,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.PreparePipelineToSaveTask",
 "loopEnd": false,
 "loopStart": true,
 "name": "preparePipelineToSaveTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.front50.tasks.SavePipelineTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "savePipeline",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.front50.tasks.MonitorFront50Task",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForPipelineSave",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.CheckPipelineResultsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "checkPipelineResults",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.CheckForRemainingPipelinesTask",
 "loopEnd": true,
 "loopStart": false,
 "name": "checkForRemainingPipelines",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "7",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.pipeline.SavePipelinesCompleteTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "savePipelinesCompleteTask",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "savePipelinesFromArtifact"
 },
 {
 "context": {
 "allowScaleDownActive": false,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "TEST",
 "credentials": "staging",
 "interestingHealthProviderNames": [
 "Amazon"
 ],
 "preferLargerOverNewer": "false",
 "regions": [
 "us-east-2"
 ],
 "remainingFullSizeServerGroups": 1
 },
 "endTime": null,
 "id": "01F5KC59VX4WM95WVQG3P8FPGK",
 "lastModified": null,
 "name": "Scale Down Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "36",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703895,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706325,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704294,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.ScaleDownClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "scaleDownCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorScaleDownCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.WaitForScaleDownClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForScaleDownCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "scaleDownCluster"
 },
 {
 "context": {
 "failPipeline": true,
 "user": "myUserName",
 "waitForCompletion": true
 },
 "endTime": null,
 "id": "01F5KC59VXM9SH65YQVYSPYQ07",
 "lastModified": null,
 "name": "Script",
 "outputs": {},
 "parentStageId": null,
 "refId": "37",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703903,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartScriptTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startScript",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704279,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorQueuedJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForScriptStart",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorScript",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildPropertiesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildProperties",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "script"
 },
 {
 "context": {
 "allowDeleteActive": false,
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "TEST",
 "credentials": "staging",
 "interestingHealthProviderNames": [
 "Amazon"
 ],
 "regions": [
 "us-east-2"
 ],
 "retainLargerOverNewer": "false",
 "shrinkToSize": 1
 },
 "endTime": null,
 "id": "01F5KC59VX9V47GNGF65Z1TSG3",
 "lastModified": null,
 "name": "Shrink Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "38",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704032,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704384,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.ShrinkClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "shrinkCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorShrinkCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.WaitForClusterShrinkTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForClusterShrink",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "shrinkCluster"
 },
 {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "consideredStages": [],
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [
 "Unable to determine source image(s)"
 ],
 "stackTrace": "java.lang.IllegalStateException: Unable to determine source image(s)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.image.ImageTagger.findImages(ImageTagger.java:80)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.providers.aws.AmazonImageTagger.getOperationContext(AmazonImageTagger.java:62)\n\tat com.netflix.spinnaker.orca.clouddriver.tasks.image.UpsertImageTagsTask.execute(UpsertImageTagsTask.java:65)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:144)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withLoggingContext(RunTaskHandler.kt:419)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.access$withLoggingContext(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:105)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withAuth(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:104)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$handle$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:247)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler$withTask$1.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:68)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withTask$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withExecution(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withStage(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withTask(OrcaMessageHandler.kt:60)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.withTask(RunTaskHandler.kt:236)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:101)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.handle(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.RunTaskHandler.invoke(RunTaskHandler.kt:75)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "IllegalStateException",
 "operation": "upsertImageTags",
 "shouldRetry": false,
 "timestamp": 1620926705284
 },
 "tags": {
 "TEST": "TEST"
 }
 },
 "endTime": 1620926706305,
 "id": "01F5KC59VX7DERMTWGYZA30B5X",
 "lastModified": null,
 "name": "Tag Image",
 "outputs": {},
 "parentStageId": null,
 "refId": "39",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703980,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926705773,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.image.UpsertImageTagsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "upsertImageTags",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704310,
 "status": "TERMINAL"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorUpsert",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.image.ImageForceCacheRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.image.WaitForUpsertedImageTagsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForTaggedImage",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "upsertImageTags"
 },
 {
 "context": {
 "beforeStagePlanningFailed": true,
 "continuePipeline": false,
 "exception": {
 "details": {
 "error": "Unexpected Task Failure",
 "errors": [],
 "stackTrace": "java.lang.NullPointerException\n\tat com.netflix.spinnaker.orca.igor.pipeline.TravisStage.taskGraph(TravisStage.java:36)\n\tat com.netflix.spinnaker.orca.api.pipeline.graph.StageDefinitionBuilder.buildTaskGraph(StageDefinitionBuilder.java:48)\n\tat com.netflix.spinnaker.orca.q.StageDefinitionBuildersKt.buildTasks(StageDefinitionBuilders.kt:41)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.plan(StartStageHandler.kt:173)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.access$plan(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:99)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$sam$java_util_concurrent_Callable$0.call(AuthenticationAware.kt)\n\tat com.netflix.spinnaker.security.AuthenticatedRequest.lambda$wrapCallableForPrincipal$0(AuthenticatedRequest.java:272)\n\tat com.netflix.spinnaker.orca.q.handler.AuthenticationAware$DefaultImpls.withAuth(AuthenticationAware.kt:51)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withAuth(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:81)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler$handle$1.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:85)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$withStage$1.invoke(OrcaMessageHandler.kt:46)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withExecution(OrcaMessageHandler.kt:95)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withExecution(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.withStage(OrcaMessageHandler.kt:74)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.withStage(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:79)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.handle(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.q.MessageHandler$DefaultImpls.invoke(MessageHandler.kt:36)\n\tat com.netflix.spinnaker.orca.q.handler.OrcaMessageHandler$DefaultImpls.invoke(OrcaMessageHandler.kt)\n\tat com.netflix.spinnaker.orca.q.handler.StartStageHandler.invoke(StartStageHandler.kt:61)\n\tat com.netflix.spinnaker.orca.q.audit.ExecutionTrackingMessageHandlerPostProcessor$ExecutionTrackingMessageHandlerProxy.invoke(ExecutionTrackingMessageHandlerPostProcessor.kt:72)\n\tat com.netflix.spinnaker.q.QueueProcessor$callback$1$1.run(QueueProcessor.kt:90)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:834)\n"
 },
 "exceptionType": "NullPointerException",
 "operation": "Travis",
 "shouldRetry": false,
 "timestamp": 1620926704081
 },
 "failPipeline": true
 },
 "endTime": 1620926704398,
 "id": "01F5KC59VXPMHB9QXG535QFZJG",
 "lastModified": null,
 "name": "Travis",
 "outputs": {},
 "parentStageId": null,
 "refId": "40",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704031,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "syntheticStageOwner": null,
 "tasks": [],
 "type": "travis"
 },
 {
 "context": {
 "account": "spinnaker",
 "cloudProvider": "kubernetes",
 "kato.last.task.id": {
 "id": "9e7cc23a-1448-47cc-99d8-511122b9b613"
 },
 "kato.result.expected": false,
 "location": "staging",
 "manifest.account.name": "spinnaker",
 "manifest.location": "staging",
 "manifest.name": "deployment hostname",
 "manifestName": "deployment hostname",
 "mode": "static",
 "numRevisionsBack": 1,
 "outputs.manifestNamesByNamespace": {
 "staging": [
 "deployment hostname"
 ]
 }
 },
 "endTime": null,
 "id": "01F5KC59VX9TE0A2AJ6XMJ8F4X",
 "lastModified": null,
 "name": "Undo Rollout (Manifest)",
 "outputs": {},
 "parentStageId": null,
 "refId": "41",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703984,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.UndoRolloutManifestTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "undoRolloutManifest",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704314,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorUndoRollout",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.manifest.WaitForManifestStableTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForManifestToStabilize",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "undoRolloutManifest"
 },
 {
 "context": {
 "waitTime": 30
 },
 "endTime": null,
 "id": "01F5KC59VXSZJG27YDEWDA3X4N",
 "lastModified": null,
 "name": "Wait",
 "outputs": {},
 "parentStageId": null,
 "refId": "42",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704152,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706086,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.WaitTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "wait",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704453,
 "status": "CANCELED"
 }
 ],
 "type": "wait"
 },
 {
 "context": {
 "statusUrlResolution": "getMethod"
 },
 "endTime": null,
 "id": "01F5KC59VXHMA91KG8XYQ7RRZK",
 "lastModified": null,
 "name": "Webhook",
 "outputs": {},
 "parentStageId": null,
 "refId": "43",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704157,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.webhook.tasks.CreateWebhookTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createWebhook",
 "stageEnd": true,
 "stageStart": true,
 "startTime": 1620926704632,
 "status": "RUNNING"
 }
 ],
 "type": "webhook"
 },
 {
 "context": {
 "continuePipeline": false,
 "failPipeline": true
 },
 "endTime": null,
 "id": "01F5KC59VXKBS6NWPNNTG1T1EH",
 "lastModified": null,
 "name": "Wercker",
 "outputs": {},
 "parentStageId": null,
 "refId": "44",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704161,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706286,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startWerckerJob",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704452,
 "status": "CANCELED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorWerckerJobStartedTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForWerckerJobStart",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorJenkinsJobTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorWerckerJob",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildPropertiesTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildProperties",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetBuildArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getBuildArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "wercker"
 },
 {
 "context": {
 "amiSuffix": "20210513172504",
 "baseLabel": "release",
 "baseOs": "ubuntu",
 "cloudProviderType": "aws",
 "extendedAttributes": {},
 "name": "Bake in us-east-2",
 "package": "nginx vim",
 "rebake": true,
 "region": "us-east-2",
 "storeType": "ebs",
 "type": "bake",
 "user": "myUserName",
 "vmType": "hvm"
 },
 "endTime": null,
 "id": "01F5KC5AJECT88MA2PHYG6TT3G",
 "lastModified": null,
 "name": "Bake in us-east-2",
 "outputs": {},
 "parentStageId": "01F5KC59VXEMS65RNVKF5HJJ9S",
 "refId": "8<1",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704513,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": "STAGE_BEFORE",
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.CreateBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "createBake",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926705585,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.MonitorBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorBake",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.tasks.CompletedBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "completedBake",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "bake"
 },
 {
 "context": {
 "amiSuffix": "20210513172504",
 "baseLabel": "release",
 "baseOs": "ubuntu",
 "cloudProviderType": "aws",
 "extendedAttributes": {},
 "package": "nginx vim",
 "rebake": true,
 "region": "us-east-2",
 "regions": [
 "us-east-2"
 ],
 "storeType": "ebs",
 "user": "myUserName",
 "vmType": "hvm"
 },
 "endTime": null,
 "id": "01F5KC59VXEMS65RNVKF5HJJ9S",
 "lastModified": null,
 "name": "Bake",
 "outputs": {},
 "parentStageId": null,
 "refId": "8",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704174,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": null,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.bakery.pipeline.BakeStage.CompleteParallelBakeTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "completeParallel",
 "stageEnd": true,
 "stageStart": true,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "bake"
 },
 {
 "context": {},
 "endTime": null,
 "id": "01F5KC59VX4RE5RZVJG239ZD42",
 "lastModified": null,
 "name": "AWS CodeBuild",
 "outputs": {},
 "parentStageId": null,
 "refId": "9",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926704185,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926706077,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.StartAwsCodeBuildTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "startAwsCodeBuildTask",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926704452,
 "status": "CANCELED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.MonitorAwsCodeBuildTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorAwsCodeBuildTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.igor.tasks.GetAwsCodeBuildArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "getAwsCodeBuildArtifactsTask",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.pipeline.tasks.artifacts.BindProducedArtifactsTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "bindProducedArtifacts",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "awsCodeBuild"
 }
 ],
 "startTime": 1620926703525,
 "startTimeExpiry": null,
 "status": "TERMINAL",
 "systemNotifications": [],
 "templateVariables": null,
 "trigger": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 }
 ],
 "correlationId": null,
 "isDryRun": false,
 "isRebake": false,
 "isStrategy": false,
 "notifications": [],
 "other": {
 "artifacts": [
 {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 }
 ],
 "dryRun": false,
 "enabled": false,
 "eventId": "c1090782-f485-490e-a2d7-31763b3bd4d8",
 "executionId": "01F5KC59TRGWKCP31C4N51CDSB",
 "expectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "notifications": [],
 "parameters": {},
 "preferred": false,
 "rebake": false,
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "type": "github/file"
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "strategy": false,
 "type": "manual",
 "user": "myUserName"
 },
 "parameters": {},
 "resolvedExpectedArtifacts": [
 {
 "boundArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "defaultArtifact": {
 "artifactAccount": "myUserName",
 "customKind": false,
 "location": null,
 "metadata": {
 "id": "d14e7e5b-247c-455d-8260-9e9b0a3ae936"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": "Https://api.github.com/repos/myUserName/hostname/contents/manifests/deploy-spinnaker.yaml",
 "type": "github/file",
 "uuid": null,
 "version": "master"
 },
 "id": "05ad020e-73a6-49f2-9988-2073831219e9",
 "matchArtifact": {
 "artifactAccount": "myUserName",
 "customKind": true,
 "location": null,
 "metadata": {
 "id": "f7a9b229-0a23-42ab-82de-9990d77084df"
 },
 "name": "manifests/deploy-spinnaker.yaml",
 "provenance": null,
 "reference": null,
 "type": "github/file",
 "uuid": null,
 "version": null
 },
 "useDefaultArtifact": true,
 "usePriorArtifact": false
 }
 ],
 "type": "manual",
 "user": "myUserName"
 },
 "type": "PIPELINE"
 },
 "stage": {
 "context": {
 "cloudProvider": "aws",
 "cloudProviderType": "aws",
 "cluster": "test",
 "credentials": "staging",
 "interestingHealthProviderNames": [
 "Amazon"
 ],
 "preferLargerOverNewer": "false",
 "regions": [],
 "remainingEnabledServerGroups": 1
 },
 "endTime": null,
 "id": "01F5KC59VX9BYMY7CCXAG75NXT",
 "lastModified": null,
 "name": "Disable Cluster",
 "outputs": {},
 "parentStageId": null,
 "refId": "18",
 "requisiteStageRefIds": [],
 "scheduledTime": null,
 "startTime": 1620926703616,
 "startTimeExpiry": null,
 "status": "RUNNING",
 "syntheticStageOwner": null,
 "tasks": [
 {
 "endTime": 1620926704950,
 "id": "1",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.DetermineHealthProvidersTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "determineHealthProviders",
 "stageEnd": false,
 "stageStart": true,
 "startTime": 1620926703761,
 "status": "SUCCEEDED"
 },
 {
 "endTime": null,
 "id": "2",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.DisableClusterTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "disableCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": 1620926705735,
 "status": "RUNNING"
 },
 {
 "endTime": null,
 "id": "3",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.MonitorKatoTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "monitorDisableCluster",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "4",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "5",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.cluster.WaitForClusterDisableTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "waitForClusterDisable",
 "stageEnd": false,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 },
 {
 "endTime": null,
 "id": "6",
 "implementingClass": "com.netflix.spinnaker.orca.clouddriver.tasks.servergroup.ServerGroupCacheForceRefreshTask",
 "loopEnd": false,
 "loopStart": false,
 "name": "forceCacheRefresh",
 "stageEnd": true,
 "stageStart": false,
 "startTime": null,
 "status": "NOT_STARTED"
 }
 ],
 "type": "disableCluster"
 },
 "user": {
 "isAdmin": false,
 "roles": [],
 "username": "myUserName"
 }
 }
}

Keys

Parameters related to the stage against which the policy is executing can be found in the input.stage.context object.

input.pipeline

Key	Type	Description
`input.pipeline.application`	`string`	The name of the Spinnaker application to which this pipeline belongs.
`input.pipeline.authentication.allowedAccounts[]`	`string`	The list of accounts to which the user this stage runs as has access.
`input.pipeline.authentication.user`	`string`	The Spinnaker user initiating the change.
`input.pipeline.buildTime`	`number`
`input.pipeline.canceled`	`boolean`
`input.pipeline.canceledBy`
`input.pipeline.cancellationReason`
`input.pipeline.description`	`string`	Description of the pipeline defined in the UI.
`input.pipeline.endTime`	`number`
`input.pipeline.id`	`string`	The unique ID of the pipeline.
`input.pipeline.keepWaitingPipelines`	`boolean`	If false and concurrent pipeline execution is disabled, then the pipelines in the waiting queue gets canceled when the next execution starts.
`input.pipeline.limitConcurrent`	`boolean`	True if only 1 concurrent execution of this pipeline is allowed.
`input.pipeline.name`	`string`	The name of this pipeline.
`input.pipeline.origin`	`string`
`input.pipeline.partition`
`input.pipeline.paused`
`input.pipeline.pipelineConfigId`	`string`
`input.pipeline.source`
`input.pipeline.spelEvaluator`	`string`	Which version of spring expression language is being used to evaluate SpEL.
`input.pipeline.stages[]`	`[array]`	An array of the stages in the pipeline. Typically if you are writing a policy that examines multiple pipeline stages, it is better to write that policy against either the `opa.pipelines package`, or the `spinnaker.execution.pipelines.before` package.
`input.pipeline.startTime`	`number`	Timestamp from when the pipeline was started.
`input.pipeline.startTimeExpiry`	`date`	Unix epoch date at which the pipeline expires.
`input.pipeline.status`	`string`
`input.pipeline.templateVariables`
`input.pipeline.type`	`string`

input.pipeline.trigger

See input.pipeline.trigger for more information.

input.stage

See input.stage for more information.

input.stage.context

Key	Type	Description
`input.stage.context.cloudProvider`	`string`	The name of the cloud provider that executes the stage.
`input.stage.context.cloudProviderType`	`string`	The type of the cloud provider that executes the stage.
`input.stage.context.cluster`	`string`	The name of the cluster to disable
`input.stage.context.credentials`	`string`	The account/credential set that’s used to execute this stage.
`input.stage.context.interestingHealthProviderNames[]`	`string`
`input.stage.context.preferLargerOverNewer`	`string`
`input.stage.context.remainingEnabledServerGroups`	`number`

input.user

This object provides information about the user performing the action. This can be used to restrict actions by role. See input.user for more information.

Armory Docs – Spinnaker Plugins

Plugins: Install the AWS Event Cache Plugin in Armory Continuous Deployment

Installation overview

Before you begin

Compatibility

Configure the plugin

Install the plugin

Create an AWS SNS topic and subscription

Plugins: Install the GitHub Integration Plugin in Armory Continuous Deployment

Installation overview

Before you begin

Compatibility

Create and install a GitHub App

Configure the plugin

Conflict with Armory CDSH v2.30.x

Accounts config example

Install the plugin

What’s next

Plugins: Enable Pipelines-as-Code in Armory Continuous Deployment

Before you begin

Where to configure the service

Enable Pipelines-as-Code

Configure your repo

Deploy

What’s next

Plugins: Enable the Terraform Integration Stage in Armory Continuous Deployment

Overview of enabling Terraform Integration

Compatibility

Before you begin

Configure Armory CD

Configure Redis

Configure your artifact account

Configure additional repos

Enable Terraform Integration

Apply the update

What’s next

Plugins: AWS CloudWatch Integration Plugin Overview

What the AWS CloudWatch Integration plugin does

Installation paths

Spinnaker compatibility matrix

Release notes

Plugins: Overview

AWS Event Cache features

How the plugin works

Compatibility matrix

Installation paths

Plugins: GitHub Integration Plugin for Spinnaker Overview

GitHub Integration Plugin features

How the plugin works with GitHub

Compatibility matrix

Installation paths

Plugins: Quick Start: Spinnaker and the Armory Scale Agent

Quick start overview

Objectives

Before you begin

Options for migrating Kubernetes accounts

Deploy the Spinnaker Operator

Get the spinnaker-kustomize-patches repo

Configure Spinnaker

What this recipe does

What this recipe does not do

Spinnaker version

Configure your Kubernetes account

Deploy Spinnaker

Confirm success

What’s next

Plugins: Armory Scale Agent Service Deployment Modes

Deployment modes

Spinnaker Service mode

Infrastructure mode

Agent mode

Scalability

Plugins: Install the AWS Event Cache Plugin in Spinnaker (Operator)

Installation overview

Before you begin

Compatibility

Configure the plugin

Install the plugin

Create an AWS SNS topic and subscription

Plugins: Install the GitHub Integration Plugin in Spinnaker (Operator)