Delta Sharing in Databricks — What, Why, and How (Provider & Recipient)
TL;DR Delta Sharing lets you share live, governed data from Unity Catalog with other teams or external partners without copying it. You create a share, add data assets to it…
Functions in Unity Catalog with Databricks SQL (Scalar & Table UDFs)
What you’ll learn Prereqs: Unity Catalog enabled, a catalog/schema you can write to, and a SQL Warehouse or notebook attached to a UC‑enabled cluster. Quick definitions Create your first scalar…
Databricks COPY INTO — Idempotent Ingestion & Exactly‑Once Design (Deep‑Dive)
Databricks COPY INTO is a lightweight, SQL‑first way to load files from cloud storage (ADLS/S3/GCS) into Delta tables. It’s retryable and idempotent—you can schedule it safely without creating duplicates because…
Fixing the “cannot import name ‘DSSKey’ from ‘paramiko'” Error in Databricks When Using pysftp
If you’ve been working with SFTP connections in Databricks using the pysftp library, you might have run into this frustrating error: This typically pops up when your Databricks job or…
Understanding Databricks Account, Workspaces, and Governance Setup: Part-2
Databricks offers a multi-workspace architecture that can span across multiple cloud providers like AWS, Azure, and GCP. Managing this setup effectively requires understanding accounts, workspaces, user management, and metastore governance.…
Understanding Executors in Databricks: A Complete Guide with Debugging Tips
Executors in Databricks covering: Understanding Executors in Databricks: A Complete Guide with Debugging Tips When running workloads in Databricks, one of the most important concepts to understand for performance tuning…
Multi-Workspace Architecture with Unity Catalog: Best Practices
Multi-Workspace Architecture with Unity Catalog: Best Practices Databricks Unity Catalog is redefining how enterprises manage data governance and security across workspaces. In a modern data platform, especially within large organizations,…
AWS Load Balancer Controller for Kubernetes: A Comprehensive Guide
Rajesh Kumarwww.rajeshkumar.xyz
Global Medical Tourism: Transforming Healthcare Access Through Leading Digital Platforms
As healthcare costs soar and waitlists grow in many developed countries, medical tourism is rapidly becoming a mainstream solution for millions of patients worldwide. What once was a niche alternative…
Securing Your Kubernetes Cluster: 10 Best Practices (Beginner to Advanced)
🔐 Securing Your Kubernetes Cluster: 10 Best Practices (Beginner to Advanced) Kubernetes is powerful — but with great power comes great responsibility. While Kubernetes automates deployment, scaling, and management of…
Databricks Clusters – Configuration, Types & Cost Optimization
🧠 The Ultimate Guide to Databricks Clusters – Architecture, Configuration, and Cost Optimization When working with Apache Spark on Databricks, clusters are the core compute engine that run your data…
Master ITIL 4 Certification: The Ultimate IT Service Management Training
In today’s dynamic IT landscape, mastering service management is crucial for organizations striving to deliver high-quality services efficiently. The Information Technology Infrastructure Library (ITIL) framework provides a structured approach to…
Master Google Cloud DevOps: A Complete Guide to Professional Cloud DevOps Engineer Certification
In today’s rapidly evolving IT landscape, proficiency in cloud platforms is paramount. The Google Cloud Professional Cloud DevOps Engineer certification stands out as a testament to one’s expertise in managing…
GitOps Associate (CGOA) Certification
The CGOA certification is meticulously designed to assess and validate an individual’s foundational knowledge and skills in GitOps. By focusing on the core principles and best practices of GitOps, this…
Unlock Your Career with Kubernetes Certified Administrator & Developer Training
In today’s fast-evolving tech world, Kubernetes has become the gold standard for container orchestration. To stay competitive, professionals must enhance their skills with certifications like the Kubernetes Certified Administrator (CKA)…
Azure SQL Database idle sessions are terminated after 30 minutes with the ‘Proxy’ connection policy
When we connect to Azure SQL Databases or Managed Instances using the “Proxy” connection policy, idle sessions are closed after 30 minutes of inactivity. However, with the “Redirect” policy, idle…
Datastage ODBC connector stage throws error, SQLSTATE = 08S01: Native Error Code = 0: Msg = [IBM(DataDirect OEM)][ODBC SQL Server Wire Protocol driver]Socket closed.
Problem Datastage jobs are failing when running a query against the Azure SQL Server database with the error: SQLSTATE = 08S01, Native Error Code = 0, Message = [IBM(DataDirect OEM)][ODBC…
The Rising Demand for DevOps Consulting: Transforming Global IT Practices
In today’s fast-evolving digital landscape, the pressure on businesses to innovate rapidly and efficiently has never been greater. As companies strive to remain competitive, the adoption of DevOps—a practice that…
Azure Session
Day 1 cloud computing Mohammad Gufran Jahangir
New Relic
What is New Relic? New Relic is a comprehensive software analytics and performance monitoring platform that provides real-time insights into the health and performance of your applications, infrastructure, and customer…