Production Release Highlights : September 20 2023

Harness release updates
Harness-prod-release-highlights
13 min readSep 20, 2023

An overview of what went into our latest production release.

Platform(PL)

  • Added taskId in the secretManager validation task #53054
  • fixed msTeam identifier #52900
  • add AIDA FF #52802
  • update Build numberupdate Build number
  • update pre-qa #52695
  • Move the iterator error logs to metrics #52608
  • Change to debug log #52338
  • add condition to filter only mark for deletion account #52425
  • changed mongo lock to redis lock in local for all svcs #52454
  • Decide if rest password email would go through CG or NG #52446
  • add access control check to eula sign API #52547
  • changed mongo lock to redis lock in local for template svc #52465
  • Added Logs for UnknownHost Exception and handled error for LDAP #51449
  • Added java 17 flag #52527
  • Add Enforcement interceptor for V2/usergroups #52530
  • Modified if condition to not check the taskSupported in tokenLookup call #52453
  • Added RoleAssignment Counts in Roles API #51323
  • block csv and xlsx files in configs in CG #52422
  • change groupIds for notification settings #52411
  • Changes to update service runtime env to java 17 #52357
  • Updates to change services runtime env to java 17 #52200
  • Add missing waitid to container instance sync #52319
  • send prometheus event fro active project metrics #52186
  • In UserGroupRequestV2DTO assigning empty list for users. #52320
  • Added service class and client method for resource group for enabling public access #52212
  • fix shouldMailContainTwoFactorInfo erroring out in case of value being false #52235
  • added parameter in openAPI #51977
  • Support in DMS and Delegate for Bijou K8s Execute #50544
  • fix the update call #52262
  • Fixed ACS build #52242
  • Added missing permission checks in Environment and … #52195
  • added settings for enabling/disabling Notification channels #51453
  • Onboard CI Manager and Pipeline Service DW Metrics for OPS #51935
  • Fixing delegate communication with proxy #52150
  • Helm chart url for smp #51169
  • Added api to enable public access on a resource in open api #51808
  • Updates error log to warn #52151
  • Fixing conflicting acl generation/deletion for overlapping scope identifiers in case of usergroup updates #52109
  • Send events to segment for account logins #51717
  • Send events to segment for project related audit enteries #51716
  • Iterator to cleanup invalid audits in CG #51988
  • Fix connector list api query criteria to filter by nexus connectors version #52122
  • Skipped auditHeader creation for ng/user/user and api-keys/validate APIs #52042
  • Updated the query to work only on 600 seconds records #52117
  • support bot ux hotfix #18008
  • support bot UX changes #18007
  • update EULA content #17880
  • Allow CommunityLicense User to perform certain tasks via UI #17736
  • aida rollout hotfix #17730
  • show all tags in delegate listing page #17706
  • use dynamic helm chart repo url in delegates #17686
  • enable delegate logs for failed validation #17593
  • delegates page child component should address error handling for missing RBAC message permissions #17671
  • Public access of pipeline execution page #17083
  • add EULA behind FF PL_EULA_ENABLED #17668
  • add enable/disable notification channel #17632
  • add EULA behind FF PL_EULA_ENABLED #17638
  • make AIDA feedback component reusable #17662
  • add organizations API search to create project page #17597
  • harness secret manager UI item alignment in secret manager list #17594
  • basic eula check integration #17490
  • replaced useGetAccountNG call in multiple components with data from AppStore #17562
  • improve settings framework documentation #17592
  • added service variable HARNESS_NO_AUTH_HEADER #17609
  • added service variable HARNESS_NO_AUTH_HEADER #17586
  • update tooltip version #17557
  • Updated build numberUpdated build number
  • added a null check on changeLogData #13823

Continuous deployment (CD)

  • prod hotfix for nav 2 feature flag #53044
  • fetch templateType for stage with no templateInputs #53018
  • Adding FF required on prod for unscripted #53013
  • update reconciliation API to set is_deleted true instead of deleting entities from timescale #52955
  • Make GitOps steps work without OPTIMIZED_GIT_FETCH_FILES #52882
  • Make GitOps steps work without OPTIMIZED_GIT_FETCH_… #52810
  • Added the NPE check #52754
  • remove JENKINS_BUILD from feature restriction #52747
  • Fix NPE when service selection is missing when saving a freeze window #52734
  • Replace time_bucket functionality for timescale migration for CDOverviewDashboardServiceImpl #52529
  • Add feature flag to not consider stage/pipeline level delegate selectors for container step #52610
  • support terragrunt running in parallel having uniq… #52541
  • call the queries in bulk #52467
  • adding helm chart info into a new outcome to reflect in stagenode json #52429
  • Adds Support for Helm and Kustomize Params in Update GitOps App Step #52375
  • add adviser for retry failure strategy #52406
  • UT added #52558
  • Fixing null ptr in graph rendering while step grp with s… #52553
  • code pulse added #52500
  • move sort after match condition #52571
  • added ingress rules for approvals API for smp and devspaces #52501
  • CodePulse Added #52502
  • Reduce call to resolveStepInputs for every step #52409
  • Get artifact list from file path #52524
  • Add feature flag for enabling GCS artifact type. #52472
  • remove FFs from code #52531
  • Remove ambiance from instrumentation event handler #52503
  • Added a new mongo entity to store GitXWebhook events #52450
  • Seperating threads for Delegate services #52560
  • move instance task details query to secondary node #52440
  • add adviser obtainments for failure strategies #52355
  • Enabling Post Prod Rollback Native Helm. #52532
  • support repoName filter in Service list #52475
  • Fixed the error handling for GitX Webhook Service Impl and updated mongo index #52543
  • Add support for chart version tab in service dashboards #52184
  • changing type string as on UI there is some generi… #52461
  • Add code-owners for template srv #52519
  • Change the limit to 3k when listing secrets #52421
  • add service name filter only if not empty #52509
  • [Next-Gen] User unable to approve pipeline execution even though they’re part of the group #52426
  • Add identifierPostfix to strategyMetadata #52395
  • Added open api spec endpoint for runtime inputs API v1 pipeline yaml #52393
  • fix steady state check for run task #52439
  • adding CVNG as empty step #52470
  • Fixed step name in wait step #52480
  • fix for ordering the environment variables #52478
  • fix for migrating timeout of pcf deploy step #52476
  • update service and env with fixed value #52428
  • support get service header for remote services #52449
  • added log service improved prompt for CD #52423
  • have added a condition for handling unresolved expression #52082
  • return distinct repos for Service entities #52427
  • support cli options for terragrunt on delegate side #52346
  • Adding delegate capability for PT tasks for Custom deployment #52067
  • Final changes for supporting v0 steps/stages in v1 pipeline #52418
  • changing log type from error to debug in DeploymentEventListener#onMessage #52244
  • Added tests for GenericPlanCreatorUtils.java #52363
  • Remove reflection from consumers #52361
  • Added handling for case retry of multi svc/infra and als… #52408
  • Get calculate status only for direct children #52386
  • Add feature flag enum #52415
  • YamlField #52194
  • Throw informative error message when Input validation is attempted with invalid regex #52261
  • oc version upgrade to 4.13.4 #51112
  • Static Schema support for V1 Pipelines #52350
  • Plan creation with v0 stages/steps in v1 pipeline #52410
  • Added unit tests for gitX webhooks service #52412
  • Use priviledged secret manager client for authenticating secret in triggers #52380
  • Propogating the parent info to the children in plan-creation framework #52362
  • fixing NPE because of empty base path. #52402
  • get support for remote services #52283
  • Added Context for the GitXWebhooks #52401
  • Creating jsonFormat only once in all converters #52374
  • add utils for failure strategies advisors #52165
  • Replace time_bucket functionality for timescale migration #52326
  • Fixed environment variable issue #52384
  • Add index and remove sort for scheduled trigger iterator #52364
  • fix context variable in service #52343
  • fixing terrafor plan destroy #52334
  • List gitxWebhooks api with pagination #52352
  • Support description and tags on FS folder properties #52337
  • Adding support for false kryo serializer to Graph update #52321
  • Add a bulk ack API for events framework #52095
  • Add index on status, next iterations desc & type based on ESR rule #52322
  • register new failure strategy with kryoserializer #52301
  • Updated the GitXWebhook Entity name its keys #52345
  • Added tests for ExecutionDetailsResource.java #52264
  • remove CDS_STAGE_EXECUTION_DATA_SYNC ff from enum #52317
  • support artifactFilter in Artifactory Generic Trigger #52297
  • fix for basic tanzu workflow migration #52318
  • Disable Recover after pause #52336
  • migrator config file decoding #52330
  • Update trigger.json when branch cut happens for Pipeline srv #52308
  • Implementing CRUD operations for gitXWebhooks #52131
  • Deprecate Kustomize and use Kubectl instead #48815
  • Add support for arrays as webhook json payload #51888
  • Support for Static Schema for Triggers #52188
  • Changed the query params for get and delete apis #52239
  • added ingress for dev space #52299
  • support creation of remote services #52132
  • Ingress Changes for Devspaces and modify path for Execute Api #52238
  • npe fix #52282
  • Session timeout for WinRmShellScriptTaskNG #52218
  • Add description to the fields in trigger filter #52269
  • fixing trigger condition #52277
  • adding support to migrating artifact details #52265
  • fixing service command migration #52232
  • remove dependency on time_bucket_gapfill #52110
  • Support fetching status using issueKey and a new a… #51879
  • add ttl in export logs #52205
  • Fix code pulse annotation #52234
  • log the errormessage as a warning in case the jira … #52130
  • GA FF CD_NG_DOCKER_ARTIFACT_DIGEST #52185
  • Fix issue with secrets not rendering in container step #52247
  • Support for fetching ServiceNow templates with searchkey, offset, pagenation #52134
  • support artifactFilter ArtifactoryArtifact #52121
  • Fix ngModuleTriggerTest #52251
  • Unsetting the resolvedParams #52143
  • get value from nodeMetadata instead of metadataMap #52048
  • Exposed Execute pipeline V1 spec endpoint And Fixed create pipeline V1 spec API flow for v1 yaml #51986
  • Not allow saving pipeline when use from stages’ stage not present #51538
  • added check for unresolved expression in keyValue condition #52176
  • Remove ambiance from engine resume callback #52222
  • Support for fetching details of servicenow fields #51983
  • adding execution logs for spot #52192
  • updated the pagination object for list webhooks #52193
  • Add filter parameters in list trigger call #52050
  • added FF enum #52183
  • Adds UpdateApp logic for UpdateGitOpsAppStep #51921
  • fix for importing service variable with all argument #52140
  • support post prod rollback for running executions #51518
  • passing correct folder path for OCi, HTTP #52172
  • add new buildType #51920
  • Junits For SAM and Serverless 2.0 Steps #52160
  • Fixing pipeline rollback #52187
  • fix desired count of green service in rollback #52170
  • Add config for Template OPA #52145
  • Use planExecutionId in maxconcurrentcallback #51740
  • Support multiple values to filter on artifact names #51984
  • added accountId queryParam in getApprovals #52055
  • Expression support for nodeNames in Matrix #51672
  • Add pipeline yaml version to Execution V2 Api #52129
  • fixing service ref on trigger #52112
  • dummy commit for develop #52147
  • camel case fix for lambda request body #52119
  • Path param fix #52135
  • adding manifestInfo in StepInfo for Api usage #51974
  • added readOnly support in serviceNow metadata V2 #52080
  • Default Image Changes For SAM steps #52071
  • Remove retryInfo from metadata and move it to Plan… #51714
  • set nodeMetadata in dependency v1 plan creators #52020
  • Update the contract for get and delete #52106
  • add pipeline version in list pipeline api #52070
  • Add policy step details to console #51901
  • Fix null pointers when expression is unresolved for booleans #51932
  • Update pipeline.json and template.json #52101
  • Add rollback status to instance sync api #52103
  • fixing trigger event condition #52006
  • Add Code Coverage for Pipeline Setting service #52052
  • Updating template folder as per Github docs #52100
  • updating error log message for elastigroup deploy #52078
  • Added Recaster Alias Annotation #51381
  • Removing the FF PIE_WEBHOOK_NOTIFICATION #51959
  • fix CI link in Get Started page and stage links in execution details #18014
  • Nav 2 base hotfix prod #18009
  • Nav 2.0 prod hotfix #18003
  • added new feature flag OPA_AIDA_WIDGET #17991
  • page crash fix for formikVariables not being an array type #17957
  • adding checks in UI to support null progressData #17932
  • added new feature flag OPA_AIDA_WIDGET #17924
  • manifest details helm deployment qa #17920
  • handled safety check for terraform encryptOutput field #17882
  • fixed reconciliation issue with cloudformation step and templates #17860
  • fixed referenced child templates used in parent template are automatically getting converted into resolved values #17857
  • changed default tab to stepGroup configuration in stepGroup template #17809
  • preQA — added delegate selector for container step #17810
  • make glance cards clickable under project scope #17784
  • Add hook to log network events #17781
  • Fixes incorrect warning displayed when stage propagates from expression based infra #17770
  • cf-remove-file #17780
  • add width as fit-content to parent container to prevent overlapping of data #17777
  • Handled error for useCheckIfTemplateUsingV1Stage & useCheckIfPipelineUsingV1Stage API #17775
  • expanded executions in the list page should stay expanded even if new executions are added #17772
  • add support for stepGroup config tab in stepGroup template for variable support #17743
  • Fixed Execution stage name overlapping when no spaces are there #17771
  • onboard UsefulOrNot component in all AIDA implementations to handle telemetry #17761
  • missing conditional execution icon for stage and step templates with runtime conditional execution #17766
  • aws-cdk-rollback-step #17755
  • change cursor style on execution notes popover #17764
  • Adding scroll for git commit error handling #17763
  • add validation to consoleLogPollFrequency in RPF #17697
  • support display chart version views on service summary screen #17663
  • Close InputSetSelector modal on click of Apply for trigger flow #17732
  • fs-redirect-to-referency-by #17754
  • fixed reconciliation issue with cloudformation step and templates #17745
  • Adds support to initialise the rejection criteria correctly when jexl is selected for approvals #17740
  • Adds null check while reading from propagated state #17742
  • fixed unusual v1 build api call in jenkins artifact #17749
  • fixing encoding of jobName when required fields are expression #17731
  • Show loader for Pipeline Input Tab for API loading in trigger flow #17722
  • Reduce useGetTemplateFromPipeline & useGetMergeInputSetFromPipelineTemplateWithListInput API call when user change pipeline branch #17738
  • pipeline-filter-artifact #17741
  • passed useportal prop and fix filter fieldscontainer css #17746
  • Handled ontypechange for runtime form and updated uicore version for edit form fix #17739
  • Move Jenkins & Nexus3Registry artifact trigger out of CD_TRIGGER_V2 FF #17728
  • remove-artifact-option-winrm-command #17733
  • added individual yaml schema API’s for pipeline and trigger entities #17721
  • support edit and delete actions for gitX webhooks #17726
  • Add trigger explorer page for artifacts #17714
  • FF removal CDS_GITHUB_PACKAGES #17688
  • aws-cdk-deploy-step #17707
  • clear listeners and listener rules on load balancer change #17710
  • aws cdk destroy step #17702
  • Fix Config page split view #17701
  • removing runtime/expresiion support from artifactPath field of bamboo artifact #17700
  • Add null check in isIntersectingBottomWhenResize #17705
  • support post prod rollback for Elastigroup — Spot deployment type #17378
  • No Data Page not visible when the webhooks list API returns null response #17704
  • remote pipeline redirecting to list page when opening from list page #17687
  • show ExecutionId from runSequence id #17703
  • Fixes logic to remove service override inputs for multi service configuration #17645
  • show error toast if input set yaml is invalid #17690
  • aws-cdk-synth-step #17689
  • Integrating gitX in Service create flow #17628
  • onboard UsefulOrNot component in all AIDA implementations to handle telemetry #17676
  • clear runtime values for execution input view #17678
  • passing correct value of feed in configure artifact source drawer for azure artifact #17648
  • using delegate metaData from get approvals api #17461
  • GitX Webhooks Listing Page Details Rows and API integrations , Create Webhook Modal Loading + Success Screens + API Integrations #17653
  • Updated latest swagger for template, cd-ng and pipeline services #17669
  • added telemetry events for support ticket deflection modal #17664
  • update the arrow icons in query explorer #17659
  • fixed referenced child templates used in parent template are automatically getting converted into resolved values #17639
  • QA Hotfix — fixed step log not appearing in console when unitProgresses field is empty #17660
  • Show duration for step details even if it is less then 1s #17652
  • add tooltipid to Policy Enforcement/Execution Target #17618
  • fixed change template + search logs issue #17641
  • Adds readonly support for azure artifact runtime fields #17487
  • Updates ng tooltip version to show tooltips for SNOW OIDC #17624
  • Support-file-store-script-shell-script-step #17439
  • aws-cdk-bootstrap #17607
  • Create New Webhook Modal for GitX Webhooks #17627
  • move PipelineStudioStepsGraph cypress test to cypress e2e #17643
  • On changing template, no template will be selected for preview by default #17619
  • adds support for includeInfraSelectors in shell script #17621
  • Adds account level default setting for Project Scoped Resource Constraint Queue #17602
  • Configuration screen new split view #17508
  • remove field from yaml which has empty value in jira/service now steps #17579
  • Show container step group compatible steps when step template is used inside container step group #17630
  • fix background color of highlighted text so that it is highlighted when searched #17620
  • refactor ServerlessAwsLambda infrastructure related code #17357
  • registryId field added in ECR trigger #17588
  • rerun from last failed stage should pre-select the last failed stage when conditional execution is present #17611
  • listing page layout setup and the zero state entities for gitX webhooks #17612
  • Update new template route in internal component #17601
  • file-store-save-file-content #17610
  • Rebasing #17599
  • added cypress webpack pre-processor to run cypress in parallel for same machine hoisted infra #17575
  • Updated template studio new route in internal components #17583
  • updated height to max-height in stage popover + added bottom padding #17585

Continuous Cost Management (CCM)

  • clickhouse version upgrade #52577
  • Audit Trail for Governance shows internal fields #52249
  • Optimising the query #52538
  • Docker file fix from ccm-worker c7n_azure #52434
  • Added instance usage fields in cluster tables #52555
  • Fix cross cloud provider issue enforcement #52433
  • Remove rule from enforcements on rule deletion #52203
  • ChronicleQueue dependency versions upgraded #52358
  • recommendations sorting issue #52305
  • Marked recommendation applied when servicenow ticket is no longer active #52255
  • Do not recompute already updated Nodepool Recommendations #52190
  • Updated labels-flattening filters as per recent changes, enabled flattening for Elevance #52169
  • Limit exceed transparency Governance #52250
  • Cannot edit a CCM Enforcement #52246
  • Governance Schema Yaml Missing Azure Schema #52231
  • Fixed documentation of rule enforcement apis #51723
  • Budget Groups can’t be saved #52118
  • Removing time filter from the query #52138
  • commitment orchestration permissions enabled #17598
  • Add Missing Flags from CCM UI #17603
  • Add Missing Flags from CCM UI #17605

Service Reliability Management (SRM)

  • Improved isProjectDeleted debug API #52237
  • Iterators in Verification application are starting after the delay #52567
  • SLO health indicator iterator for timescale is not working #52515
  • adding the support for service DependencyMetadata… #52432
  • SLO upsertion in timescale is failing, and added evaluation type… #52448
  • suppressing connector not found errors #52396
  • Created debug API for force deletion of Composite SLO #52303
  • Removed code for DeploymentImpactAnalysis Activity #52371
  • Fixes in SLO history data of timescale db #52344
  • Adding verifyStepSummaries in the analysis report DTO #52276
  • Creating deeplink for the Analysis step to show in… #52274
  • webhooks from pagerduty services will be deleted af… #52040
  • Adding run sequence to deployment activity and metadata to popuulate in change event list API #52226
  • Added fixes for the subscription API #52210
  • Fixing reports list API to fetch reports just for t… #52079
  • Fixed Firehydrant Report Slack Notification for SLO … #52016
  • Created a debug API to cleanup resources #52075
  • Updated link to open Analysis report card #17883
  • removed DeploymentImpactAnalysis from change type #17756
  • Update activityId to executionDetailsId in Analysis Impact Step #17744
  • implementing new design of Notifications Table in SRM module. #17715
  • Implementing the new UX for creating monitored services. #17696
  • Add Verify Summary in Analysis Report card #17693
  • Change the description value of the Deployment chan… #17617
  • unsaved changes not showing up under Dependency tab… #17636
  • fix report event card alignments in charts #17642
  • Added Analysis Icon on Service health #17625
  • Clean up Deployment Impact Analysis #17596

Continuous integration (CI)

  • Add API to purge DLC cache #52094
  • use step params from ci manager #52469
  • Fix telemetry repository package #52488
  • Handling NPE in matrix looping. #52126
  • Removed time_bucket_gapfill dependancy in CI #52365
  • updated s3 plugin version #52370
  • Add ruby runner #52096
  • Change logging #52323
  • Added blocking call for redis queue and recreate stream #52259
  • Fix cleanup for same delegate tags #51631
  • Handle redis queue errors and add ack #52166
  • Not refreshing the connector if last activity time is less than 2 mon… #52004
  • EULA for CI/CD/CCM #17975
  • allow empty values for envVariables in run step #17614
  • validate branch name on getStartedWithCI only if storeInGit is set #17589

Feature flags management (FFM)

  • fix RemoveSegmentsToVariationTargetMap pipeline instruction #52217
  • Fix flag casing hotfix #18023
  • Fix flag casing hotfix #18022
  • Hotfix #17964
  • Update FF services #17779
  • Update ff services #17776
  • Whitelist ChildComponentMounter #17711
  • tags in details page #17675
  • Implementing Cleanup Modal and logic #17651
  • Hotfix #17661
  • Change waiting for cleanup to appear on reason not status #17635
  • Remove flag scoping #17633

Observability Integrations Platform (OIP)

  • Exporting the jira versions during branch cut #52526
  • Pick only active accounts for verifications #52533
  • remove FF SRM_DATADOG_METRICS_FORMULA_SUPPORT reference from test case. #52506
  • Handle stage mark as failed while CVNG is running gracefully #51521
  • Dummy commit #52447
  • Datadog and Prometheus added to the next gen onboarding APIs #52389
  • Extra validation on Datadog verification #52284
  • Updating the SRM build and release scripts to use semantic versioning #52388
  • Add Verification JobInstance level logs #52141
  • explicitly add health source DTOs OpenAPI v3 Spec #52133
  • Do not make monitored service GET call if required details are not present for the API #17650
  • Add toast to health sources form to notify user that some fields are required and not filled during submit #17566

--

--