https://smfarrukh.com/insights I design and deliver production-grade AI and data platforms – agentic AI, generative AI and Databricks lakehouses – for enterprises in mining, energy, banking, superannuation and government. en-au https://smfarrukh.com/insights/databricks-temporary-tables-public-preview https://smfarrukh.com/insights/databricks-temporary-tables-public-preview Wed, 28 Jan 2026 00:00:00 GMT Databricks just introduced Temporary Tables in SQL — now available in public preview on SQL warehouses — and it’s a simple but powerful addition to the Lakehouse toolkit that makes working with intermediate session da… https://smfarrukh.com/insights/governance-for-genai-on-databricks-poc-to-production https://smfarrukh.com/insights/governance-for-genai-on-databricks-poc-to-production Tue, 20 Jan 2026 00:00:00 GMT Over the last couple of years, I’ve seen many organisations successfully build GenAI proofs of concept on Databricks — and then struggle when it comes time to move those solutions into production. https://smfarrukh.com/insights/devops-with-kubernetes https://smfarrukh.com/insights/devops-with-kubernetes Sat, 15 Dec 2018 00:00:00 GMT DevOps with Kubernetes – slides and notes. https://smfarrukh.com/insights/azure-iot-edge-for-edge-computing https://smfarrukh.com/insights/azure-iot-edge-for-edge-computing Sun, 25 Nov 2018 00:00:00 GMT Azore IoT Edge service is built on top of IoT hub. The service is useful because you don’t need to send the data to cloud for analyzing it, instead you can analyze it on the device itself, that’s why it’s called “at t… https://smfarrukh.com/insights/real-world-applications-of-reinforcement-learning https://smfarrukh.com/insights/real-world-applications-of-reinforcement-learning Sun, 25 Nov 2018 00:00:00 GMT Reinforcement learning is a type of machine learning that determines the action within a specific environment in order to maximize a reward. One of the characteristics of reinforcement learning is that the agent can o… https://smfarrukh.com/insights/markov-decision-process-reinforcement-learning https://smfarrukh.com/insights/markov-decision-process-reinforcement-learning Sun, 25 Nov 2018 00:00:00 GMT cover: https://img1.wsimg.com/isteam/ip/7ecb9a34-1c63-4a1f-89db-2f3124edebd3/f4272377-c479-4863-a068-dd6bb6559be0.png