Production Release Highlights : October 17 2023

Harness release updates
Harness-prod-release-highlights
10 min readOct 17, 2023

An overview of what went into our latest production release.

Platform(PL)

  • hot fix for enabling weekend check in account deletion job #54069
  • Delete accounts MARKED-FOR-DELETION through Scheduler #53936
  • Fixing secret decryption for json keys with dots #53807
  • Fixed error message in pipeline public access #53677
  • adding domain filter in email #53723
  • proxy stackdriver logs logging service #53388
  • OIDC Token APIs support in ng-manager #53614
  • add oauthEnabled to AuthenticationSettings #53250
  • In AccessControlOutboxEventHandler, logging exception object. #53719
  • Upon deletion of secret from Harness, purge them from azure key vault #52635
  • In ACS, when reconcilling user group in iterator avoiding to print unnecessary logs. #53694
  • Removed time as a label in the metric — HeartBeat_received #53660
  • changes for platform svc to apply filter on deleagte side #53605
  • Bug fix to remove inconsistency in public access enable/get #53659
  • Extract common logging classes to a common java package #53271
  • changes in oauth signup API for ds oauth signup flow #53200
  • exposed new API for to ds check if user already exist #53489
  • Added RsaKeyPair object #53650
  • Added event handler for Public ACcess disable #53218
  • Added createdAt and lastModifiedAt timestamps in the secrets decryption API response #53583
  • add uniqueId for project and org entity during creation, updation #53278
  • removing pending invites for a user being invited via scim #52844
  • linked to LDAP user-group should trigger group sync only for the linked group #53515
  • Add logs to find root cause for customer reported tag issue #53568
  • Added Description in API Docs and set the default values internally #53519
  • Add CPU HPA spec to immutable delegate yaml #52599
  • Introducing global ingress behind configuration in devspaces #53454
  • Added DTOs and configs for Google OIDC #53181
  • Changed log level to warn for Principal not found when capturing audits #53544
  • Resolved bug in NG Vault renewal pause flow #53497
  • Change MaxGCPauseMillis and InitiatingHeapOccupancyPercent to default #53505
  • override limit for getAllUserIds call #53447
  • Publish secret usage in case of WingsException during test connection #53459
  • Added error handling for StaleAuditCleanupJob #53486
  • Perform Acl processing for Role through outbox event. #51759
  • refactored globalResponseHandler and handled 401 use-cases better #18439
  • Remove global 403 handling & page-not-public route #18352
  • Checked headers before parsing response as JSON #18332
  • show BE eror msg when testing pipeline notifications #18287
  • Handled 403 use-case when Account is marked public, but resource is private #18258
  • no settings check for aida support #18292
  • Update config.yaml to set API_URL to /gateway #18231
  • move authentication data to hook #18264
  • move authentication data to hook #18274
  • wrapping for AIDA message #18232
  • Handled 403 use-case when Account is marked public, but resource is private #18261
  • DelegateTaskLogsButton appearing twice #18175
  • update context to read metadata from API response #18195
  • update context to read metadata from API response #18196

Continuous deployment (CD)

  • hotfix saas upgrade azure core #54052
  • add support for input/output variables in Tanzu command step #54018
  • manager side hf to resolve kryo and NPE. #54015
  • Hf the tickets CDS-80573 and CDS-80991 to qa #53964
  • Hotfix For CDS-81032 — Changed charset to ISO-8859–1 for getting base64 secret files content #53911
  • Fix parsing of branches from the payload #53898
  • support runtime inputs for stackNames, change outputs #53886
  • resolved message displayed when trying to get tag for Nexus when Repository URL /Port are not mentioned #53852
  • Skip validation for service override input in case … #53839
  • API for post creation on Canny #53822
  • support terraform json var files fix pre-qa #53815
  • Do not allow modification of upsert options.DEFAULT #53813
  • Add support for fetching runtime inputs schema details for pipeline yaml schema v1 #53530
  • fixing env id check #53796
  • Adding support for sending executable response to handle race condition #53783
  • updated hadnling for sweeping output exception incase of duplicate keys to same scope #53648
  • optimized exportVariables functor #53562
  • Remove CDS_RANCHER_SUPPORT_NG feature flag #53785
  • send response in form of page for template get response #53487
  • adding FF CDS_OCI_HELM_ECR_CONFIG_SUPPORT_NG #53777
  • name of class to unblock pre-qa #53780
  • Add POJOs for variables v1 #53612
  • Make barriers steps work within looping strategies #52659
  • Fix the fetching of modified files while parsing webhooks #53751
  • Add warn when unable to trigger execution after artifact collect due unstable stream #53735
  • Disable trigger execution #53566
  • Code coverage UserMarkedFailAllInterruptHandler #53759
  • Remove usage of CDS_BG_STAGE_SCALE_DOWN_STEP_NG feature flag #53696
  • fixing kryo exception by using only ociHelmConnector field instead of connectorConfigDTO field. #53762
  • Merging v0 and v1 templates inside the v1 pipeline #53499
  • modifies the setup of environmentVariables for ShellScriptStepParameters #53361
  • use region from EKS infra def in K8s steps #53645
  • Adding delegate tasks for ecs basic step #53683
  • Adding handling for operators having newline so fallback is not called #53755
  • Dont send filter creation event for draft pipelines #53708
  • Added TTL of 15 days for the webhook events #53718
  • Update error message. Docker rate limit #53633
  • add Git DTOs for Infra entity #53685
  • Exception summary for spotElastic Group #53687
  • remove pipeline service client config from replace_configs.sh of template service #53746
  • Terraform destroy step Configuration Type always set to Inline #53739
  • Complete implementation for Restraint based on gh token #53376
  • Helm deploy release name would be extracted out to stage variable #53670
  • Fixed artifact collection issue #53733
  • Fixed null in optional issue #53732
  • create api to get deploy count from start date for ng #52383
  • support for linking servicenow configuration to change request #53472
  • Added the timeout to stage #53306
  • remove from enum CDS_OrgAccountLevelServiceEnvEnvGroup #53695
  • Support jexl script in http output variables #53534
  • Add service principal in trigger listeners #53702
  • Added loggers for debugging purpose #53711
  • add FF for Infra GitX #53692
  • Resolving the Wrong error message in azure artifacts by updating the listPackages #53197
  • add back dynamic schema individual-schema api in resource #53713
  • Async filter creation Producer, Consumer and Listeners #53232
  • Added Validation before Delegate Creation #53421
  • adding logs to service outbox event handler #53682
  • Fixed infinite retries in case of interrupted exception #53639
  • Added Name, Tags and Failure message #53538
  • Remove FF client from git sync #53573
  • update azure java sdk resources to 2.26 #53385
  • Changes updateNotes permission to Pipeline_Execute. #53636
  • Adding nodeExecution metrics for pipeline-service #53642
  • Integrated bi-directional sync with template service #53638
  • Decouple interfaces from executables #53627
  • fixing template inputs for shell script #53665
  • Updated ArtifactFunctor to support artifactStream keys #53661
  • Added migration scope for overrides to only specific services,env at workflow / pipeline level #53622
  • Add NodeExecutionInfoService in Expression engine #53640
  • change workflow id and name in case of rollback if tags mismatch #53564
  • remove FF enum NG_ARTIFACT_SOURCES #53634
  • Removing usage of ModelMappers from pipeline filters. #52916
  • remove dynamic schema code for templates #53327
  • Fetch ServiceLicenseUsage in batches to avoid timeout #53512
  • Fixes Tag for OpenAPI #53632
  • add AWS_STS_REGIONAL_ENDPOINTS=regional env variable for Native helm instance sync as well #53565
  • Added support to configFile.getAsBase64 encoding files without secrets #52975
  • remove terraform apply encrypt json outputs feature flag #53549
  • Handle Wings Exception while checking for Service V1 EOL Banner Service #53621
  • added support for rolling back to ASG with differe… #53601
  • Add NodeExecutionInfoService in Expression engine #53561
  • Using V2 feature flag enum instead of existing one #53483
  • set chart version to be null if not found #53551
  • add back dynamic schema individual-schema api in resource #53613
  • Removed old jsch implementation from the delegate #52817
  • fix pipeline rollback #53593
  • reducing the number of log lines for helm search repo command #53592
  • bring back feature to support terraform steps v1 and v2 #53584
  • Remove — short for flag validation in kubectl #53482
  • Ignore flaky unit test #52675
  • fixing barriers on pipeline #53572
  • fixing loop strategy #53574
  • add optional region field to EKS infra #53537
  • Onboarding running executions per account #53535
  • fix for getting the FF value #53559
  • Add Util for fetching current iteration and total iterations #53557
  • Add param to fetch retry failed pipelines in e… #53528
  • fix expressins at rollback #53529
  • Added a new method updateGitCacheForWebhookEvent for updating cache for webhook events #53369
  • Use service based streams for pipeline-service #53075
  • Maintaining InfrastructureEntity list order #53448
  • Add support for strategyObjectMap in NodeExecutionInfoService #53348
  • Filter events based on filepath and repo for a given entity #53430
  • Added Support For Env Create flow. #53128
  • correcting deployment strategies for ecs #53474
  • Removed validation of target env #53465
  • use manifest id from cg as identifier for ng manifest #53475
  • use region parameter from EKS ListClusters API #53501
  • Add AWS region query param to EKS ListClusters API #53493
  • Expire all child nodes if parent node expired #53172
  • add api-key authorization in api to get deployment count total #53502
  • fix for s3 aws variables #53462
  • Restricting view and execute access of pipeline not working as expected. #52703
  • Changed cache config #53375
  • Added repoName in the events list response #53427
  • Improve Execution logs for Jenkins to show url #53379
  • Add FF for optional EKS region param #53481
  • update access response DTO for services #53485
  • Move logs to debug #53458
  • Rollback step logs for elastigroup #53158
  • added UT for SchemaFetcher #53451
  • Add trigger type for unmatched triggers and show payload when exception #53314
  • add default object in stepGroup template #18462
  • Aws cdk improvements qa #18421
  • qahf-add input/output variables support to Tanzu Command Step #18398
  • add back feature flag PIE_STATIC_YAML_SCHEMA and use old API’s for local dev #18380
  • Nav2 fixes #18361
  • qa-remove-rancher-ff #18371
  • Added audit trail routes for new nav and referenceBy fixes #18330
  • added-ff-for-oci-ecr-config #18334
  • fix editing/deleting of command flags for terragrunt step #18335
  • asg instances runtime qa #18327
  • asg v2 pre qa #18329
  • stream calls for gitops step/pipeline #18318
  • added-ff-for-oci-ecr-config #18311
  • show parent pipeline execution link on hover of recent executions child pipeline cell #18291
  • Org project split view #18213
  • Changed the order of route destinations in module route config #18301
  • Added Webhooks support in Account Settings Page #18288
  • remove FF PIE_STATIC_YAML_SCHEMA and use old API’s for local dev #18297
  • Nav 2 misc fixes #18283
  • fixed the logs to check for asyncChain in logs Response #18294
  • fixed the logs to check for asyncChain in logs Response #18295
  • asg v2 qa #18275
  • enhancement to add services & env to exclude in freeze windows #17984
  • Prioritize item.delegateSelectors over item.spec.delegateSelectors #18286
  • Prioritize item.delegateSelectors over item.spec.delegateSelectors #18284
  • webhooks UI bug fixes #18272
  • asg base #18210
  • allow empty environment variable values in container steps #18246
  • Fixed factory registration not invoking for the handlers defined inside a function #18271
  • Fixed factory registration not invoking for the handlers defined inside a function #18269
  • Show trigger link for all kind of trigger in Pipeline Execution Page #18245
  • Fix connector input width when using configure options #18260
  • add entity name in diff calculation at pipeline and template level #18253
  • remote environment creation UI changes #18251
  • Update FormMultiTypeConnectorField to support any CSS width #18223
  • Moved settings components to 45-projects-orgs & route segregation #18139
  • Pass correct bucket name while fetching filePaths in run pipeline form #18250
  • Pass correct bucket name while fethcing filepaths in run pipeline form #18249
  • adding support for reconfiguring the conditional executional condition + bug fixes #18189
  • Remove encrypt terraform apply json FF from code #18244
  • Fix potential null error in IntersectionObserver #18230
  • UX feedback enhancements related to trigger explorer page #18188
  • Omit yamlInternal from override response while update override values #18215
  • remove template static schema API from template-ng service #18238
  • Transform run pipeline payload from RPF based on IP #18224
  • helm chart version input #18214
  • Omit yamlInternal from override response while update override values #18216
  • updated maxwidth for envname to show count of remaining envs #18090
  • hide-manfiest-details #18212
  • added strings for gitcache status #18205
  • added strings for gitcache status #18206
  • added export variables changes #18173
  • GCS Artifact disable-project-bucket-field #18198
  • slot deployment clean option #18181
  • Updated nd-ng & template services dto #18182
  • Updated nd-ng & template services dto #18183
  • fix redirection in not found page when FF is enabled #18114
  • Prevent manually created queries in Datadog metric health source overriding its queries #18174
  • add default account settings for do_not_delete_pipeline_executions #18180
  • add default account settings for do_not_delete_pipeline_executions #18179
  • Nav2 — Ignoring coverage check for RouteDefinitions and RouteDestinations and following same file name #18143

Continuous Cost Management (CCM)

  • Anomalies for perspective made through labels #53438
  • Query updated to fetch totalResource for that specific day at which job is running #53745
  • GCP Sync based on export_time #53688
  • Budget Group Grid Data Not Rounded Off #53681
  • Moving to 2nd Gen cloud function for Azure billing CF #51456
  • Fix Ec2 Recommendation Batch Job #53643
  • nodepool recommendation fix with podinfo table #53628
  • Adding master account details in ceCloudAccount #53402
  • Elevance’s asks for new GCP fields #53581
  • Elevance’s asks for new AWS fields #53580
  • Adding permissions, resources for CCM Anomalies & Recommendations #53350
  • Dummy Commit #53547
  • Helm Chart Fix #53536
  • Added DISTRIBUTED_LOCK_IMPLEMENTATION as MONGO #53296
  • check to prevent google auth #53479
  • Azure & GCP connector ID exists error #18160
  • keep older redirections for ccm #18165

Service Reliability Management (SRM)

  • Fixed PagerDuty Incidents not getting captured in Prod Free env #53686
  • Add step Name in secondary-events-details API for … #53653
  • removed error message for more than 100 MS in a project on listing page #53647
  • Suppress metric warnings and telemetry info logs in GCP for SRM module #53518
  • suppressing warning in GCP logs for SRM service. #53426
  • suppressing warning in GCP logs for SRM service. #53415
  • Analyse deployment step phase 2 changes #18280
  • fixed SLO timeline slider not sliding to end #18209
  • addressing scenario when FF is disabled for new side nav #18218
  • moving the routes of monitored service as per the new format to support it in the settings page #18204

Continuous integration (CI)

  • fix status check to support both url pattern #53870
  • make code resource client optional #53848
  • Close list of log streams in cleanup #53699
  • scm, warn on FindFile miss #53769
  • Add context data to execute step for dlite #53752
  • Added secret references for ci manager #53701
  • scm fix logging for git calls #53560
  • make rspec helper change automatically #53726
  • Add override and cache policy flags #53322
  • improved error message for cert failure #53705
  • le addon windows22 image #53703
  • Remove extra exists calls in log service #53629
  • updated containerless git clone #53631
  • Skip stream creation during write calls in log service #53596
  • Update Chart for log-service VS #53555
  • upgrade le and addon #53490
  • Add override from FF #53513
  • remove .git for harness code #53439
  • fixed command issue in addon #53381
  • keep background node status as running by checking all parallel stages #18255
  • Adding Test Splitting options to Run Test step. #18290
  • add test for show and hide codebase #18282
  • #18225

Feature flags management (FFM)

  • Adding FF Proxy Key Management enum #53595
  • Adding FF for Proxy Management #18228
  • tags-in-create-wizard #17626

Observability Integrations Platform (OIP)

--

--