AzureTipsAndTricks/blog/tip277.md

10 KiB

type title excerpt tags share date
post Tip 277 - Azure Functions on Kubernetes with KEDA Part 1 of 2 Learn about Azure Functions on Kubernetes with KEDA
Kubernetes
Serverless
true 2020-09-13 02:00:00

::: tip

🔥 Make sure you star the repo to keep up to date with new tips and tricks.

💡 Learn more : Kubernetes Event-driven Autoscaling (KEDA).

📺 Watch the video : Azure Functions on Kubernetes with KEDA.

:::

Azure Functions on Kubernetes with KEDA Part 1 of 2

Azure Functions Running in Kubernetes

Azure Functions are great for running tasks on demand, like processing queue messages or resizing images. And Azure Functions can run anywhere. In Azure in a consumption plan or App Service Plan. Locally, using the Azure Functions runtime. And even in containers, also using the Azure Functions runtime.

Running Azure Functions in containers can be very useful when you want control over your infrastructure. For instance, you can run an Azure Function in a container in Azure Kubernetes Service. But how do you get it to scale on demand, just like a Function that runs on a consumption plan? Kubernetes-based Functions provides the Functions runtime in a Docker container with event-driven scaling through KEDA. KEDA can scale in to 0 instances (when no events are occurring) and out to n instances. It does this by exposing custom metrics for the Kubernetes autoscaler (Horizontal Pod Autoscaler). Using Function containers with KEDA makes it possible to replicate serverless Function capabilities in any Kubernetes cluster.

In this series of posts, we'll create an Azure Function that is triggered by an Azure Storage Queue and runs in Azure Kubernetes Service. And we'll make the Function scale by using KEDA.

This series contains two posts:

  1. Azure Functions on Kubernetes with KEDA Part 1 of 2 (this post) - Creating and building a containerized Azure Function
  2. Azure Functions on Kubernetes with KEDA Part 1 of 2 - Running the Azure Function in AKS with KEDA

Prerequisites

If you want to follow along, you'll need the following:

Creating a containerized Azure Function with an Azure Storage Queue Trigger

Before we create an Azure Function that gets triggered by a message on an Azure Storage Queue, we need to create that queue. Let's do it:

  1. Go to the Azure portal
  2. Click the Create a resource button (the plus-sign in the top left corner)
  3. Search for Storage and click on the result to start creating an Azure Storage account a. This brings you to the create blade of Azure Storage b. Select a Resource Group (or create a new one) c. Fill in a name for the account in the Storage account name field d. Select a Location e. Leave the rest of the settings as they are and click Review + create and Create after that

(Create Azure Storage Account in the Azure portal)

Now that we have a storage account, let's create a queue in it:

  1. In the Azure portal, navigate to the storage account
  2. Click on Queues to access the Azure Storage Queues feature
  3. Click Add queue
  4. Fill in a name for the queue
  5. Click on OK to create the queue

(Create Azure Storage Queue in the Azure portal)

Okay. Now that we have a queue in Azure, we can create the Azure Function. We'll do that with the Azure CLI:

  1. Open the Azure CLI on your local machine
  2. We need to install the Azure Functions Core Tools to be able to create functions and deploy them to AKS. You can install the tools with this command:
npm install -g azure-functions-core-tools@3
  1. Once the tools are installed, we'll create a directory that we will use to create the Azure Function in:
mkdir myfunction
cd myfunction
  1. Alright. The following command creates a containerized Azure Function app in the folder that we've just created, using the Functions Core Tools:
func init --docker
  1. The process will ask you to select the worker runtime. Select dotnet. This creates the Function app with .NET
  2. If you run dir, you'll see that we now have Azure Function files and a Docker file for the container
  3. Next, we'll create a new Function in the Function App that we've just created (Function Apps contain one or more Functions). We can create a new Function with the command:
func new
  1. You'll be asked what type trigger the Function should have. Select the QueueTrigger
  2. Next, type in a name for the Function. I'll use QueueFunction. And that's it, the Function is created

Now that we have a containerized Function App with a QueueTrigger Function in it, let's take a look at it in Visual Studio and add a connection string to the Azure Storage Queue:

  1. Open the myfunction folder that contains the Function App and Function
  2. In the folder, you'll find a Visual Studio project file. Open it with Visual Studio (or VS Code)

(Azure Function in Visual Studio)

  1. In Visual Studio, you can see the Docker file of the Function App. This uses the Azure Functions Runtime to run the Function. There is also a local.settings.json file. Open it
  2. Create a new setting in the local.settings.json file called storageconnection. Make the value of this setting the connection string to Azure Storage. You can find this in the Azure Storage Account in the Azure portal, under the Access Keys menu
  3. Go to the function code file. In my case, this is QueueFunction.cs. Here, change the values in the QueueTrigger attribute a. Replace the "myqueue-items" string by the name of the queue that we've created in Azure Storage b. Put in the name "storageconnection" for the Connection parameter

That's it. The Function is now connected to the Azure Storage Queue. Let's compile the function using the Azure CLI:

  1. Open the Azure CLI
  2. Make sure that you are in the myfunction folder where the Function App is
  3. Also make sure that you have connected your Docker account to your local machine by using:
docker login
  1. Now use the following command to build the container with the Function App in it. The myfunctionapp:v1 represents the name of the container and the tag (v1):
docker build -t myfunctionapp:v1 .

The Function App should build and the container should be created now. With this last step, we've made sure that the Function compiles into a container.

Conclusion

In this post, we've created a containerized Azure Function App with a queue-based trigger in it, on our local machine using the Azure CLI and the Azure Functions Core Tools. In the next post, we'll deploy the container with the Azure Function in it to Azure Kubernetes Service and run it at scale with KEDA.