Professional
Azure OpenAI

Rainer Stropek | time cockpit
https://rainerstropek.me/

Rainer Stropek

Passionate software developer
IT-Entrepreneur, CoderDojo-Mentor, Teacher

software architects gmbh
rainer@software-architects.at
https://rainerstropek.me

OpenAI vs.
Azure OpenAI

OpenAI vs. Azure OpenAI

• Same models, OpenAI makes models available earlier
  • ChatGPT 4: OpenAI 🔗, Azure OpenAI 🔗
  • Embeddings: OpenAI 🔗, Azure OpenAI 🔗
  • Azure: Models have to be explicitly deployed
• Payment
  • Pay AI costs via Azure, important for commercial customers
  • Pricing is practically identical
• Content Filtering
  • Azure: (Customizable) Content filtering 🔗
  • OpenAI: Moderation API 🔗

OpenAI vs. Azure OpenAI

• Portal
  • Azure: Quite limited compared to OpenAI
• Mostly identical REST APIs
  • OpenAI makes new APIs available earlier
  • Differences: Authentication, URL paths, content moderation
  • Language APIs are (mostly) compatible
• Authentication
  • OpenAI: API key 😟
  • Azure OpenAI: API keys, Entra ID (Managed Identity)

OpenAI vs. Azure OpenAI

• Network integration
  • OpenAI: No
  • Azure OpenAI: Private Endpoints
• Performance
  • Difficult to say... 😅
  • Azure: Provisioned throughput (large accounts) 🔗
• Regional availability
  • OpenAI: No control
  • Azure: Deployments in multiple regions possible 🔗,
    limits apply 🔗

Demo 🤖

https://github.com/rstropek/Samples/tree/master/KI/OaiAzure