Functions And Plugins In Semantic Kernel

-

It's been a while since Semantic Kernel is around and in the last few months, a lot of many things have changed, specifically from the implementation point of view. Hence, I thought of summarize the key functions to help you understand better, which are also listed in Evan's blog.. As of today, there are 3 different ways to add plugins into the Semantic Kernel. Here are those:

  • From a directory: Need to provide parent_directory and plugin_name 
  • Using KernelPlugin instance 
  • Using KernelFunction: Need to create a custom class or a dictionary where methods are decorated with kernel_function

Similarly, there are few different ways to add functions in Semantic Kernel:

  • KernelFunction.from_prompt a.k.a KernelFunctionFromPrompt(function_name, plugin_name, description, prompt, template_format, prompt_template, prompt_template_config, prompt_execution_settings) 
  • KernelFunctionFromPrompt.from_yaml(yaml_str, plugin_name (optional))
  • KernelFunctionFromPrompt.from_directory(path, plugin_name (optional)) 
  • KernelFunction.from_method a.k.a KernelFunctionFromMethod(method, plugin_name, stream_method) (where the method has name, description, etc. defined through the decorator)
If you're looking to get started with Semantic Kernel, then check my video series here.

Comments

Post a Comment

Popular posts from this blog

Create Chatbot Based Using GPT-Index/LlamaIndex | OpenAI | Python

-
Image
In this article, I’ll show you how can you create a basic chat bot which utilizes the data provided by you. Here we will be using GPT-Index/LlamaIndex, OpenAI and Pytho n. Let’s get started by installing the required Python module. Install modules/packages We need to install, two packages named  llama-index and langchain and this can be done using below lines: pip install llama-index pip install langchain Importing packages Next, we need to import those packages so that we can use them: from llama_index import SimpleDirectoryReader , GPTListIndex , GPTVectorStoreIndex , LLMPredictor , PromptHelper , ServiceContext , StorageContext ,load_index_from_storage from langchain import OpenAI import sys import os Please note that, here, we don’t need an GPU because we are not doing anything local. All we are doing is using OpenAI server. Grab OpenAI Key To grab the OpenAI key, you need to go to https://openai.com/, login and then grab the keys using highlighted way: Once you got the...
Read more

Azure Model Router: The Smart AI Traffic Controller

-
Image
Imagine you're at a busy airport, and planes from different airlines are landing and taking off. To keep everything running smoothly, air traffic controllers decide which runway each plane should use. Now, think of AI models as those planes—each one has different strengths, speeds, and capabilities. The Azure Model Router  acts like an air traffic controller for AI models, ensuring that every request gets handled by the best model available. What is Azure Model Router? Azure Model Router is a smart AI system that automatically selects the best AI model to respond to a request. Instead of developers manually choosing which AI model to use, the Model Router does it for them, optimizing for speed, cost, and accuracy. It’s part of Azure AI Foundry , a platform that helps businesses and developers deploy AI models efficiently. Why Do We Need It? AI models come in different types—some are great at answering questions, others are better at reasoning, and some are super-fast but less detai...
Read more

Generate The Streamed Response Using Semantic Kernel

-
Image
Semantic Kernel , a powerful tool for integrating large language models into your applications, now supports streaming responses. In this blog post, we’ll explore how to leverage this feature to obtain streamed results from LLMs like AzureOpenAI and OpenAI. Why Streamed Responses Matter When working with language models, especially in conversational scenarios, streaming responses offer several advantages: Real-time Interaction: Streaming allows you to receive partial responses as they become available, enabling more interactive and dynamic conversations. Reduced Latency: Instead of waiting for the entire response, you can start processing and displaying content incrementally, reducing overall latency. Efficient Resource Usage: Streaming conserves memory and resources by handling data in smaller chunks. How to Use Streaming Responses I've published a complete video on how to generate this using Python and that can be found on my YouTube channel named Shweta Lodha . Here, I'm jus...
Read more