Release Notes 26.1

1. RELEASE INFO

2. CONTENT OF THE RELEASE

2.1 Highlights

• Overall Orchestration support with API_CALL load steps using custom Secrets and Integrations configured in Admin UI, in Private Preview

• New metadata search endpoints for entity/relationships, data lineage, package dependencies and workflows graphs

• Improved local development and testing with ADA with a new option to get a code preview from the API endpoint by passing YAML metadata as a parameter without importing it yet to Designer

• API key name and ID in format of Key Name <api-key:xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxx> as creator/modifier/committer/etc. is now supported

• A few UX improvements in Designer like a new redesigned load step editor with fast access from Object Browser

• A community wish: All drop-down lists to show items in lexicographical order with a feature flag in Designer – ask it on via support portal

2.2 Designer

• Package overview layout improved and actions moved behind vertical ellipses

• New redesigned load step editor with fast access from Object Browser

• New button to focus back to the currently selected object in Object Browser

• Direct link to Entity’s Attributes added to Object Browser

• Object Browser is shown by default

• Fixed: Object browser scroll position resets after doing entity details change

• All drop-down lists to show items in lexicographical order with a feature flag in Designer – ask it on via support portal

• Refresh token timeout increased from 30 minutes to 2 hours to improve user experience with re-login needs in certain scenarios

• Copy-to-clipboard for package names in the package list

• DuckLake as Code Preview option

• Deprecated load languages (DOCKER, PYTHON, SHELL_CMD) are hidden

• Display full data type definitions in Entity Import summary view

• TRUNCATE permission added as selectable option

• Fixed: Deleting map/list field from a FTL template removed last one instead of selected

• Fixed: Notification banner is unreadable when maintenance banner is visible

• Fixed: Physical options should be limited by physical type in UI (and backend)

• Fixed: TRANSFORM load step type does not return code preview

2.3 Designer: Review Request improvements and fixes

• User can comment in both language format YAML or JSON

• Add new/existing selection logic to Review Request flow

• Restricted promote/edit/delete actions based on user permissions

• Improved notification error message when not allowed to reply or to create comment

• Remove chevron reply icon in review commit comments panel

• Target instance pre-selection and environment-based subject filtering

• Persist visibility of activities panel and comments panel

• Fixed: List status filter group style issue with smaller screen

• Fixed: List page does not show loading icon when retrieving data

• Fixed: Sharing a review request link shows page not found

• Fixed: Incorrect active menu item when review requests menu item is clicked

• Fixed: Main list page is not handled in the breadcrumbs

• Fixed: Activity panel shows multiple selected item styles (including for non-actionable items)

• Fixed: Commit list does not include older commits in the modal form

2.4 Deployment management

• Deployment pipeline phase UI fixes and behavior improvements

• Improved: Deployment progress should be shown on entity level

• Improved terminology for deployment phases

• Fixed: Load name is null/missing in the “failure in installation” error message

• Fixed: Deployment view polling interval seems to be calculated from the triggering the backend call instead of the receiving the response

• Fixed: Deployment phase details keeps on polling even after phase is finished

• Fixed: Missing dependencies listing shows also packages that are part of the deployment

2.5 Automatic schema management

• New row-level permissions support in Microsoft Fabric

• New TRUNCATE permission granting/revoking supported with DBMS products supporting it

• New physical option: STORAGE.ENTITY_RECREATE_AS_EMPTY_TABLE

• New physical option: STORAGE.ICEBERG_TARGET_FILE_SIZE

• New physical option: STORAGE.ICEBERG_MERGE_ON_READ_BEHAVIOR

• Fixed: In a certain scenario deleted VIEWs are not removed in their reverse chronological creation time

• Fixed: Dependency VIEW queries should look for views with TRANSFORM load step, not OVERRIDE

• Fixed: SEMANTIC_VIEW is not obeying its dependencies in deployment

• Fixed: SEMANTIC_VIEW does not react to force re-create

• Fixed: Alteration of STORAGE.ICEBERG_POINTER_FILE_NAME should recreate the pointer file

2.6 Loads and workflows

• Overall Orchestration is back: API_CALL load steps to support custom Secrets and Integrations

• Load execution logs to include Job ID in Google BigQuery

• Fixed: Query ID logging in Databricks SQL

• Default the UI language to English in Workflow Orchestration with Apache Airflow 3

• Status satellite load SQL processing is changed to use local temporary tables in Azure SQL Database, to prevent schema level locking which blocks other users and loads. See Release Notes 26.1 | 3.1 Note the behaviour change with status satellite loads in Azure SQL Database.

2.7 APIs new features

• New metadata search endpoints for entity/relationships, data lineage, package dependencies and workflows graphs

• Improved local development and testing with ADA with a new option to get a code preview from the API endpoint by passing YAML metadata as a parameter without importing it yet to Designer

• DuckLake, Microsoft Fabric and Databricks SQL support to code preview endpoint in External API

• Commit endpoint to support new options for omitting autoPromotion and autoDeployment, and promotion endpoint to omit autoDeployment

• API key name and ID in format of Key Name <api-key:xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxx> as creator/modifier/committer/etc. is now supported

• New info environments endpoints for getting ADE release version number

2.8 APIs improvements and fixes

• Added auto promotion/deployment ids to commit and promotion POST request response

• DatabaseTag definition improvements in yaml endpoint's / readable model’s schema

• Improved the query parameter description styling in Swagger UI

• New mandatory filters in entity export endpoints are added to prevent too exhaustive exports

• Improved performance entity/relationhip related operations

• Improved: Internal error from FTL which is not descriptive

• Assure managed entities can not be modified from yaml endpoint (or from ui)

• Improved internal foreign key, unique key etc. error messages

• Changed implicit levels recognization logic during import to explicit levels parameter to better corresponding current usage patterns and avoiding mistakes/confusion

• Maximum number of aliases is set to 15 for metadata / graph-ql endpoints

• Fixed: Attribute level only tags are not correctly recognized during import

• Fixed: Metadata search endpoints returning 500 when nothing is found

• Fixed: 500 error with DAG API

• Fixed: Lowercase suffixes and prefixes not work with ADA (yaml import)

• Fixed: Bug on handling tags which have hyphen "-" in tag name

2.9 Other

• Many third party software version updates

3. NOTIFICATIONS

3.1 Note the behaviour change with status satellite loads in Azure SQL Database

The change to use local temporary tables makes two behaviour changes: 1) the use of temporary store increases and 2) the status satellite loads start to run concurrently with other loads, which has been prevented by the schema locking earlier. So use of temporary store and the concurrency enabled will make some change in characteristics. This is made as an improvement, but possibly the use of temporary store could be monitored.