Load Balancing Azure OpenAI using Application Gateway
March 2024 Update: This post shares one out of the five ways to address Azure OpenAI’s Tokens per Minute (TPM) limitations. To learn all five approaches, check out my latest post. In my previo...
March 2024 Update: This post shares one out of the five ways to address Azure OpenAI’s Tokens per Minute (TPM) limitations. To learn all five approaches, check out my latest post. In my previo...
March 2024 Update: Although the methods in this post are still valid, the data is outdated. For the latest, please go here. As with any service, Azure OpenAI has service quotas and limits, dep...
This post concludes the my series of notes as I learn how to integrate LLMs like OpenAI in enterprise applications. Intro and Architecture Development with Semantic Kernel Develop...
In my last two posts, I wrote about my high-level thoughts on infusing OpenAI with enterprise applications. Then I explored Semantic Kernel as the lightweight SDK for developing the Orchestrator Se...
These notes are outdated. Please find my latest learning notes here. These notes were written during version dotnet-0.13. A lot a has changed since then. I am keeping these notes for my personal...
Building applications integrated with AI used to be much simpler. Before ChatGPT, the main idea of building AI-infused apps was divided into two steps: Machine learning engineers/data scientists...
Did you know that you can rapidly develop REST APIs using GPT Prompt Engineering? In this article, I show how you can use Azure API Management (APIM) inbound and outbound policies to create useful ...
Azure DevOps is one of the best DevOps tools in the market that has task management, code repository, CI/CD, test case management, artifact repository, wiki, and dashboards built into one product. ...
I’m excited to announce that I’ve just created a new public Git repository for my self-created hands-on labs! You can check it out here: https://github.com/raffertyuy/RazHandsOnLabs The repository...
This is a GitHub Enterprise overview on how a developer could quickly start coding on a new application project… TikTok style :) This video shows: GitHub Enterprise, GitHub Advanced Security, GitH...