Production Release Highlights : October 09 2023

Harness release updates
Harness-prod-release-highlights
11 min readOct 9, 2023

An overview of what went into our latest production release.

Platform(PL)

  • Delete accounts MARKED-FOR-DELETION through Scheduler Job #53857
  • Removed time as a label in the metric — HeartBeat_received #53693
  • Resolved bug in NG Vault renewal pause flow #53498
  • Change MaxGCPauseMillis and InitiatingHeapOccupancyPercent to default #53504
  • Added error handling for StaleAuditCleanupJob #53488
  • Added API to update isHarnessSupportAccessAllowed #53269
  • Fix page response for activityHistory list API #53461
  • Add unique index for delegate group with ng flag #53126
  • api def for secret decryption #52974
  • Removed FF PL_HIDE_LAUNCH_NEXTGEN. #53004
  • Fix inline secret decryption — hashicorp vault #53337
  • make getResetPasswordUrl as NG only #53308
  • throw exception in case channel is disabled #53226
  • Add scope filter param in activity history api #51217
  • move timestamp to the end of this index #53238
  • Add current delegate version to supported delegate version #53179
  • add redis config to ceng and vfc svc #53224
  • Removed unused import #53303
  • Remove NotifyEventConsumerCg thread #53273
  • Fix to fetch secrets in batch when the number of secrets are more than the default unlimited #53082
  • Added new metric to record heartBeat data #51939
  • check for oldest active token incase of default token not present #53193
  • Fixing json provider and mapping provider for JsonPath #53171
  • add task id when incrementing #53240
  • send prometheus event fro active project metrics #53234
  • added new notification settings for target domain/url #51715
  • Removed stale FFs from SMP #53167
  • update email to lowerCase when signup with OAuth #53132
  • Fixing dependency issue while monitoring initialization in platform service #53104
  • Added support for project and organization as a resource #52935
  • move execessive logs to debug to save cost #52870
  • decrement count when abort #53059
  • Added public access client and public access flag in Pipeline create, update and get flow #52683
  • Secrets Created With CSM with Fixed Inputs Gets Override Via API #51191
  • added support for custom headers in webhook notification #52760
  • added redis config in charts for verification svc #53030
  • Adds serviceId and event type information in outbox_event_processing_time metrics #53008
  • move authentication data to hook #18274
  • Handled 403 use-case when Account is marked public, but resource is private #18261
  • update context to read metadata from API response #18196
  • Cleanup legacy Setting for Disable Harness Secret Manager #18159
  • added Conenctor AwsKms as an input along with other SecretManagers while creating a Secret #18151
  • added AWS_KMS in CreateUpdateSecret #18144
  • Second Cut #17831
  • changed label and added a simple utility to convert minutes to higher dimensions of time #18070

Continuous deployment (CD)

  • HF the poller to process the webhook events #53808
  • adding FF to remove the ECR config from UI. #53778
  • fixing kryo exception by using only ociHelmConnector field instead of connectorConfigDTO field. #53761
  • Complete implementation for Restraint based on gh token #53742
  • Using V2 enum instead of existing one qa hotfix #53606
  • hotfix #53624
  • fix for saas qa #53585
  • Cherry picked commits from develop #53556
  • correcting deployment strategies for ecs #53476
  • Changed cache config #53484
  • fix work migrating user approval variables #53449
  • adding cli flags for output command on terragrunt #53446
  • Added Step classes for ECS basic deployment strategy #53423
  • Adding hack to support strings being wrongly mapped as numbers #53414
  • fix trigger migration. #53413
  • Moving PostExecutionRollbackInfo to PlanExecutionMetadata #53328
  • Handle NPE for Winrm Client #53377
  • added support for metadata field struct to contain all inputs schema related information #53436
  • Increase list clusters task timeout for Rancher & EKS #53362
  • Adding new API to return release details for CHAOS API #53106
  • remove invalidate-cache api for dynamic schema #53424
  • NextGen — Rollback skipped #53432
  • integrate inputs schema api for given yaml input #53409
  • Log-Key Simplification #53032
  • dummy commit #53429
  • Added RunSequence to Audit Events #53372
  • remove dynamic schema code for pipeline service #53281
  • fixing noOfTopKeys and topKey calculation for array-elements so that it will work on possible wrapper keys only #53373
  • adding owner rule and author check for Anshika Anand #53343
  • UT fix in develop #53420
  • Add triggered by info for audit events #53405
  • Update repoUrl and charName when path is part of connector URL #53352
  • removing the redundant container step class #53276
  • Fix AsyncChain executable flows #53394
  • handling input http template variables #53395
  • Add UT coverage #53319
  • handle state migration error for terraform version… #53356
  • Fixing develop build failure #53384
  • Integrated get pipeline api to show sync status #53355
  • Show the last event trigger time on webhook listing #53345
  • Expose a new function in outcome/output service for expression evaluation #53346
  • Check session connectivity before cleanup #53143
  • Add support to fetch runtime inputs schema for given pipeline #51155
  • Added Validation before delegate task Creation #53333
  • Reduciung the exceptions thrown #53357
  • Stop listing EKS clusters after timeout #53344
  • remove /static api from PmsYamlSchemaResource #53280
  • add logs for expression with quotes in StringReplacer #53349
  • making code backward compatible for helm chart info #53307
  • remove feature flag for supporting terraform v2 steps #53285
  • fix workflow migration as pipeline #53316
  • Adding yamlVersion field in the API responses for list templates and create/update template #53309
  • Use AmbianceUtils to check if strategy metadata is present or not #53270
  • support harnss non managed images #53301
  • fix custom artifact template varibale #53312
  • remove Rancher FF usages #53283
  • Fixing null check for stepToExcludeKeys from planCreators #53331
  • Harness Prod1 server name getting exposed in the failure execution logs shown to customer #53245
  • Make cache threadsafe for pipeline service events #52969
  • Pass clean deployment option to rollback step #53156
  • support for new relic monitor template #53215
  • added new endpoint to fetch inputs schame for any given pipeline yaml #53246
  • Move some queries related to aritfacts, pipeline, se… #53099
  • Changed cache config and fix NPE #53287
  • Supporting the creating and updating of templates v1 #53230
  • shell script variables export support #53163
  • added junits #53267
  • Move cleanup queries to secondary #53069
  • Move some userGroups queries to secondary node #53093
  • Give ability to be able to add accountId filter automatically if not present and hit secondary node when requested #53096
  • Fixes bugs for Update GitOps App Step #53113
  • Added a new varaible to show sync activity #53284
  • Support deletion of files with symlinks #53222
  • GA FF CDS_SERVICENOW_REFRESH_TOKEN_AUTH #52932
  • updated API to list ASGs by envId and InfraId #53225
  • Addition of variables & variable overrides support for custom stage environment #52850
  • Add SecretRuntimeUsageEventProducer #53100
  • changing read permission of kubeconfigfile for group and other for helm #53196
  • do not color logs coming from stderr #53148
  • Integrated the get file flow with gitx webhooks #53198
  • Added Validation before creating the delegate task #53213
  • add isNewBranch to Git update DTO #53261
  • added runtime to fields in ecs blue green create service step #53210
  • added ff for basic deployment strategy in ECS Deployment Swimlane #53211
  • fix expression resolution when expression is within quotes #53178
  • Added validation before creating delegate #53248
  • Fixed CI step group pod cleanup event #53236
  • Add yaml hash in Pipeline Entity #53145
  • Add handling for casting string value to enum in parameterField #53176
  • added tests for PMSInputSetServiceImpl.java #53052
  • Support deletion of terragrunt files with symlinks #52826
  • timeout format fix #53208
  • Updated pipelines get api contract for showing sync activity in open api yaml #53212
  • Adding support to fetch helm chart from Ecr using OCI #52697
  • update the entity in change set from upsert yaml #53175
  • Fixing the NPE because the endTs was not set in pipelineExecutionSumaryEntity so using planExecutino.endTs #53202
  • Updated pipelines get api contract for showing sync activity #53199
  • Publish adviser event for custom advisers only #53080
  • Autocorrect service release name #53169
  • API to get list of module boards from Harness Canny Portal #53029
  • Ignore test cases #53206
  • Removing stepInputs field from PlanNode #53151
  • Created a poller to pick up the queued webhook events #52856
  • Merging the V0 templates into the V1 pipelines #52568
  • Added validation before creating delegate #53139
  • add gitBranch fields for ser/env selection #53150
  • Changes to support enabling of auto scaling in green service in swap step #53136
  • add FF for service release name #53170
  • Fix Gitlab API for merge PR step #53120
  • update layoutNodeMap for post prod rollback #53023
  • Integrate service release object outcome with K8s/Helm steps #53098
  • Support for fetching change request standard template #52685
  • Added validation for required fields #53064
  • Fix test case #53152
  • Added new query params to events list api #53138
  • Convert SecretFunctor errors to warn #53142
  • Added GitDetails in responseDTOs for Environments. #52991
  • Remove time_bucket_gapfill for timescale migration #52787
  • Addition of infra step to custom stage #52840
  • Implement new deploy API and add clean option #53048
  • Handling lock contention due to jexlEngine get Property and improving fetchStep parameters #53123
  • Upgrade Jenkins client to 0.3.10 #53140
  • Not able to abort the pipeline or stage or mark stage as failed with retry failure strategy during retry interval #52924
  • Add FF — PIE_ASYNC_FILTER_CREATION #53092
  • Add tooling for supporting barriers within looping strategies #52485
  • Optimise nodeExecution calls for expression playground #52841
  • filtering out the expired approval instances while rejecting previous execution in Harness approval step #53102
  • Propagate stageId, stepGroupId and strategyId to child nodes #52479
  • Added GCS artifact type support for SSH #52722
  • scm changes to add new action for github pr event #53107
  • yaml and bean changes #53086
  • Create and Update flow for Global template #51658
  • Fixed issue with creating non-ASG/Elastigroup based services #53117
  • fixing timeout bugs #53055
  • Disable API calls and return 301 http status code #53053
  • support option to enable auto scaling in swap step for green service #53105
  • remove FF CDS_STORE_INSTANCE_STATS_ITERATOR_RUN_TIME #53068
  • move log to debug #53065
  • Add null check for config file content before rendering during deployment #53088
  • update service step logs- artifactory generic #53074
  • Create factory for Pipeline and template schema parsers #53066
  • Add Harness version field in Template Entity #53091
  • Support for dynamic desired count for green service deployment and remove auto scaling from blue service in ECS #52997
  • Rename class PipelineVersion to HarnessYamlVersion #53090
  • FF addition #53087
  • add node information for TAS to be consumed by CV #52843
  • asg instances runtime qa #18327
  • stream calls for gitops step/pipeline #18318
  • added-ff-for-oci-ecr-config #18311
  • Changed the order of route destinations in module route config #18301
  • fixed the logs to check for asyncChain in logs Response #18295
  • asg v2 qa #18275
  • Prioritize item.delegateSelectors over item.spec.delegateSelectors #18286
  • Fixed factory registration not invoking for the handlers defined inside a function #18271
  • pass correct connectorref and bucketName for fetching filepaths of amazon s3 artifact source #18247
  • Pass correct bucket name while fetching filePaths in run pipeline form #18250
  • Omit yamlInternal from override response while update override values #18216
  • added strings for gitcache status #18206
  • Updated nd-ng & template services dto #18183
  • add default account settings for do_not_delete_pipeline_executions #18180
  • update ECS Scaling Policy manifest type text in env overrides #18172
  • webhooks demo feedback #18171
  • remove step yaml schema dynamic schema API call #18167
  • Fix account invite redirection when FF is enabled #18119
  • support of artifactFilter in artifactory artifact #18035
  • added scroll bar in barriers listing view #18170
  • omit isAnyParentContainerStepGroup from stepDetails so that it does not appear in yaml if step group is dragged and dropped #18169
  • stepGroup template root level variables support #18147
  • added support for deleting collapsed stages #18156
  • Created alis for modules path #18141
  • fix preqa swagger validations #18154
  • Enhancing error message in pipeline list page #18157
  • remove unused static schema API call #18146
  • Updated query params on tabId change #18155
  • Pass correct parent branch and repo name for using remote step template #18140
  • enhanced to make delegate/delegateSelectors as runtime #18096
  • Fixed OPA state redirection issue & other misc fixes #18131
  • updated-k8s-release-name-default-value #18130
  • Fix onboarding flow when FF is enabled #18082
  • minor UI fixes for webhooks #18132
  • added ignore-failed status icon in pipeline list & console view to reflect that the pipeline succeeded with warnings #18137
  • set disabled styles when not using the dark theme #18136
  • remove schema from overlay input set modal as it always showed invalid #18135
  • show Add a note on execution view of pipeline #18111
  • fixed — pipeline execution window displays incorrect information on cron triggers #18122
  • Support for editing remote service #18098
  • Removes FF CDS_OrgAccountLevelServiceEnvEnvGroup and updates dependent test cases #18081
  • Updated location to be shown for the artifact source table for trigger config tab #18105
  • fix validation schema for Jenkins step preventing pipelines to run #18126
  • fix validation schema for Jenkins step preventing pipelines to run #18125
  • feedback UI for AIDA #18124
  • refactor webhooks to 70-pipeline from 75-cd #18121
  • feedback UI for AIDA #18061
  • new gitPopover for git bidirectional sync #18103
  • Do not show message while loading — release 0.363.x hf #18115
  • do not show message while loading #18109
  • Nav 2 changes Qa hotfix #18099
  • initialise the template-sdk and use individual schema api call for templates #18104
  • integrate eslint rule that does not allow usage of == and != #18087
  • Add trigger link for pipeline deployments executions list #18064
  • Allow Input Set creation from the Pipeline Input Tab in trigger flow for Inline Pipeline #17998
  • added includeAllServicesAccessibleAtScope query param to filter pipeline list using account and org level services #18086
  • gcs-ssh-winrm #18084
  • support sameAsAlreadyRunningInstances and enableAutoScalingInSwapStep as checkbox fields in ECS BG CS step #18089
  • Nav 2 fixes #18068
  • web-hooks sync entity pluggable drawer #18017
  • Updating CDNG contracts #18085
  • set editor background through CSS #18059
  • Show Stages to execute in edit flow in cron trigger #17981
  • Adding support for repo filter in service listing #18078
  • support sameAsAlreadyRunningInstances and enableAutoScalingInSwapStep as checkbox fields in ECS BG CS step #18075
  • fix remote pipelines redirection to project tab #18076
  • remove schema from overlay input set modal as it always showed invalid #18074
  • update label and popover content for execution time input #18073
  • updated conditional execution label for step and step-group #18048
  • Added support for remote service in dashboard listing #18030
  • edit expressions support for firefox #18066
  • Update GitOps App Step #17912
  • initialise the template-sdk and use individual schema api call for templates #18041
  • added changeRequest number field for change Task #17415
  • Added triggerTypes and triggerIdentifiers in PipelineExecution filter #18046
  • updated ng-tooltip version to 1.31.175 #18043
  • remove-cds-terraform-s3-ng-ff #18045
  • Added triggerTypes and triggerIdentifiers in PipelineExecution filter #17720
  • oci-helm-ecr #17888
  • passed correct connectorref for amazon s3 artifact source #18038
  • Show branch regex field when action is refs changed for repo event #13827
  • Show entire month data when groupby is monthly #13825

Continuous Cost Management (CCM)

  • fix first execution of sync billing data #53456
  • Added explicit dependency for json-smart #53258
  • Handled single quotes while building the query #53391
  • NPE fixed #53282
  • Adding suggested index from Atlas #53302
  • Fix for batch job runner for SMP #53268
  • Single Quote in cost category name #53291
  • Axis on budget group graph not sorted by date #53254
  • Rules List API is returning Azure Rules when the FF is disabled #53209
  • Added junit test cases and enabled code pulse for perspectives #52752
  • Optimising the query with limiting the range #53116
  • Chart fix after S3 Sync Job changes #53121
  • Disabled CG batch jobs behind a config #53072
  • Using Unblended cost in aws anomaly detection #53062
  • Hide Inventory and AutoStopping in AWS Connector Flow #18063

Service Reliability Management (SRM)

  • SLOs are getting delayed by 1 day #53378
  • Fixing environment dropdown response. #53434
  • updated metrics for DB connection pool #53440
  • Removing FFs #53365
  • Add relevant metrics for prometheus scraping #53173
  • Improved the efficiency for filtering on basis of e… #53227
  • Adding slo type and environment filter for risk-cou… #53242
  • Fixing GCP errors related to CVNG step #53220
  • Removed the boolean filter for composite SLO #53161
  • fixing gcp logs #53203
  • Fix SLO/SLI getting stuck when failed in execute method #53162
  • Suppressed the Exception Verification Task Mapping does not exist for SLI Id. #53189
  • Created warning for Exception while getting Monitor… #53144
  • handled scenarios for NO_DATA and SKIP_DATA for composite SLO #52986
  • Removing FF related to change source and Down time #18138
  • added route for change listing in SRM UI MFE #18149
  • updating the route destinations #18133
  • implemented labels for slo listing page filter #18110
  • moving the type to parent level in Dependencies entity and updating the UI types as per the latest backend swagger. #18112

Continuous integration (CI)

  • add FF for CI credit card onboarding #53435
  • handled duplicates in data deletion #53416
  • fall back to plain text if secret manager errors out #53229
  • Add logs for cert failure #53387
  • removing dependency of pipeline over CI for curating step Identifiers #53290
  • Fix for CI queue executions #53347
  • Update LE for logurl override #53329
  • Ruby runner sync with latest agent #53233
  • TI and log service to use url from delegate #53050
  • Ruby runner sync with latest agent #53190
  • Handle error state zipdownload #52614
  • Fix cleanup if pod not created #53141
  • enabling new fields #18128
  • Adding `language` query param for TI callgraph fetch api #18120
  • new sidenav CI redirection #18080

Feature flags management (FFM)

Observability Integrations Platform (OIP)

  • Make version nullable for Template Monitored Service. #53191
  • Added list of indexes field for DD logs #53180
  • Disable monitored service type dropdown in templates edit #18108
  • Update service instance names label #18102
  • Add service instance host names display #17914
  • Reset tab selection in verify step result when user switches between different steps #18026

--

--