Orchestration Consumption - Gen AI SDK

Orchestration Consumption - Gen AI SDK

This lesson demonstrates how to use the SDK to interact with the Orchestration Service, enabling the creation of AI-driven workflows by seamlessly integrating various modules, such as templating, large language models (LLMs), data masking and content filtering. By leveraging these modules, you can build complex, automated workflows that enhance the capabilities of your AI solutions. For more details on configuring and using these modules, please refer to the Orchestration Service Documentation.

Try it out!

Jupyter Notebook Extension in Business Application Studio

This exercise uses the Jupyter Notebooks extension in SAP Business Application Studio (BAS).

  1. Click here to open the Business Application Studio.

  2. Log in with your user () and provided credentials.

  3. In the landing page for BAS, click on Create Dev Space to create a virtual environment in which to start a project.

  4. For the Dev Space name, use _GenAIHub and select SAP HANA Native Application as the application type. On the right hand side, under the list of Additional SAP Extensions, choose Python Tools and then select Create Dev Space to start the process. This will create a dedicated development environment with all the tools required to run the notebook.

  1. It will take a few minutes for the Dev Space to start up. The status can be seen beside the name.

  1. Once the status changes to Running, click on the name (_VectorDB) to open it.

Create Cloud Foundry SAP AI Core service key

  1. The Welcome to SAP HANA page will appear. Follow the sequence to login to Cloud Foundry.

  1. The Cloud Foundry Sign In panel will appear with the following options selected:

    Login Option Selection
    Cloud Foundry Endpoint {placeholder|cfapi_coreai}
    Authentication method SSO Passcode

    Select the Open a new browser page to generate your SSO passcode

  1. Choose the identity provider when prompted and enter the academy-platform provider then select the Sign in with alternative provider option.

  1. Copy the newly generate passcode.

  1. Paste the copied passcode in the Enter your SSO passcode field.

Note

Select

  1. Sign into the Cloud Foundry Target by clicking the Sign In button.

  1. Proceed by selecting the desired Cloud Foundry Target and Space as seen below.

    Cloud Foundry Target Selection
    Cloud Foundry Organization {placeholder|cforg_coreai}
    Space dev

    Select Apply

    Notice the all the services associated with the target

Create SAP GenAI Core service key

The following steps are to setup the required notebook.

  1. On the Get Started page in Business Application Studio, select the option Clone from Git to import a repository from Github.

  1. A prompt will appear on top asking for a URL to the repository. Copy and paste in the following URL and then press Enter.

    Code Snippet
    1
    https://github.com/SAP-samples/sap-genai-hub-with-sap-hana-cloud-vector-engine.git

  2. The following message will appear. Select Open to see the imported files in the Explorer window.

  1. The files should now be visible in the Explorer pane on the left hand side. Select the Jupyter Notebook genAI_orchestration.ipynb to open it.

    Note

    If the following message appears, select

  2. Open a new terminal in BAS by following the numbered sequence of steps.

  1. Change to the bin folder where the cf_create_bas_sso.py script is located.

    To change folder use the following shell command as seen below:

    Code Snippet
    1
    cd bin

  1. Create the SAP AI Core service key by executing the following command from the bin folder.

    Code Snippet
    1
    python3 cf_create_bas_sso.py --service "default_aicore" --service_key {placeholder|userid}_key

    The script will indicate if the creation was successful or not.

    Note

    This service key will be deleted once the workshop registration expires.

Configure Jupyter and Python Extensions

  1. The notebook, with executable code cells, will be displayed on the screen.

    In the next section the python environment will be configured so that the code cells can be executed from within the Jupyter notebook.

  1. Run the first code cell to install the required python modules.

    Note

    To execute a code cell, click on the play icon beside the cell. It is also possible to execute it by clicking into the code cell and pressing

  1. When the first cell is executed, a prompt asking to choose a kernel source will appear. Select Python Environments.

  1. On the next screen, select the recommended Python kernel (3.11.2).

  1. The required libraries will now start installing, and some messages about port numbers will also be visible in the lower right corner. This could take a few minutes to complete also.

  1. Once the libraries have been successfully installed, the kernel must be restarted. Do this by clicking on the Restart option in the menu bar at the top.

  1. On the following pop-up message box, click on Restart again to complete the process.

    Note

    It will take a few seconds for the kernel to restart and once done, the environment is ready for use!

  1. Please follow the instructions in the Jupyter Notebook in BAS to continue with the rest of the lesson. For the section on connecting to the GenAI Hub orchestration API please use the following as the endpoint for YOUR_API_URL:

    Code Snippet
    1
    {placeholder|genAI_orchestration_API_ph}

    Copy and paste the YOUR_API_URL when prompted as seen below and press Enter:

Learning

SAP FacebookSAP YoutubeSAP LinkedIn