Open in app

Sign In

Write

Sign In

Youssef Mrini
Youssef Mrini

285 Followers

Home

About

Sep 18

Getting started with Databricks Lakehouse Monitoring

Databricks Lakehouse Monitoring lets you monitor the statistical properties and quality of the data in all of the tables in your account. You can also use it to track the performance of machine learning models and model-serving endpoints by monitoring inference tables that contain model inputs and predictions. The diagram…

Databricks

1 min read

Getting started with Databricks Lakehouse Monitoring
Getting started with Databricks Lakehouse Monitoring
Databricks

1 min read


Aug 29

What’s new in Databricks for August 2023

Platform New git operations are GA: Merge branches, rebase and pull with conflict resolution. For more information : https://docs.databricks.com/en/repos/git-operations-with-repos.html Shared Clusters support Scala in DBR 13.3 LTS You can’t set overwriteSchema to true in combination with dynamic partition overwrites in Delta lake. This prevents possible table corruption due to a…

Databricks

4 min read

What’s new in Databricks for August 2023
What’s new in Databricks for August 2023
Databricks

4 min read


Aug 23

Unity Catalog Upgrade journey

UC Design a)Catalogs In Unity Catalog, catalogs are top-level containers that can house one or more databases. Catalogs can be thought of as namespaces or directories that group related databases and tables together. b)Workspaces In Databricks, a workspace is the primary user interface for building, managing, and monitoring machine learning…

Databricks

6 min read

Unity Catalog Upgrade journey
Unity Catalog Upgrade journey
Databricks

6 min read


Aug 17

Best practices to track Databricks SQL cost

1)Monitoring Adding tags for Warehouse cost Attribution Track the event with the warehouses tables in system tables. https://learn.microsoft.com/en-us/azure/databricks/administration-guide/system-tables/billing Example of tracking the cost by SKEW

Databricks

2 min read

Best practices to track Databricks SQL cost
Best practices to track Databricks SQL cost
Databricks

2 min read


Aug 17

Tips for security and governance in Databricks

1)Data Governance: Secure, Audit and isolate data access across 100s of Workspaces with Unity Catalog. Column and Row Level masking Grant fine grained access controls Unity Catalog documentation : https://docs.databricks.com/en/data-governance/unity-catalog/index.html System tables will answer questions like Who can access ? What did they do ? System table documentation : https://docs.databricks.com/en/administration-guide/system-tables/index.html

Databricks

1 min read

Security and governance in Databricks
Security and governance in Databricks
Databricks

1 min read


Aug 17

Best practices for Identity & Administration in Databricks

1)Identity Sync: Databricks Identity Sync is a feature that enables you to use a single sign-on (SSO) identity management strategy for your users in your Databricks organization, both for authentication to Databricks and for access to data stored in your cloud environment. Databricks SCIM APIs push Users and groups that exists at Identity provider, then you can manage them in the account console. Identity best practices : https://docs.databricks.com/en/administration-guide/users-groups/best-practices.html

Databricks

1 min read

Best practices for Identity & Administration in Databricks
Best practices for Identity & Administration in Databricks
Databricks

1 min read


Aug 11

Getting started with the Lakehouse Federation

Blog article : https://www.databricks.com/blog/introducing-lakehouse-federation-capabilities-unity-catalog Documentation : https://docs.databricks.com/en/query-federation/index.html

Databricks

1 min read

Databricks

1 min read


Aug 11

Useful Databricks links

Exciting News for Data Enthusiasts! 📊 Are you eager to dive into the world of data analytics and machine learning? Look no further! Databricks is here with an array of FREE resources designed to supercharge your learning journey and boost your data prowess. Databricks customer-exclusive Office Hours connect you directly…

Databricks

1 min read

Useful Databricks links
Useful Databricks links
Databricks

1 min read


Jul 31

What’s new in Databricks for July 2023

Platform Lakehouse federation lets you run queries against external database providers in now public preview. For more information https://docs.databricks.com/query-federation/index.html Move to trash enabled for repos. For more information https://docs.databricks.com/workspace/workspace-objects.html#delete-object Databricks SDK for Go updated to 0.13.0. For more information https://docs.databricks.com/dev-tools/sdk-go.html

Databricks

3 min read

Databricks

3 min read


Jul 27

Getting started with Databricks Assistant

For more information : https://docs.databricks.com/notebooks/notebook-assistant-faq.html

Databricks

1 min read

Databricks

1 min read

Youssef Mrini

Youssef Mrini

285 Followers
Following
  • ODSC - Open Data Science

    ODSC - Open Data Science

  • Franco Patano

    Franco Patano

  • Ryan Chynoweth

    Ryan Chynoweth

  • Netflix Technology Blog

    Netflix Technology Blog

  • Kaggle Team

    Kaggle Team

See all (84)

Help

Status

Writers

Blog

Careers

Privacy

Terms

About

Text to speech

Teams