Updated: Chat with Your Data in Autonomous Database Using Generative …

…AI (#378)

* Update create-share.md

* Nilay changes

* changes

* Update consume-share.md

* Anoosha's feedback

* Update consume-share.md

* updated 2 screens and a sentence

* minor changes

* deleted extra images and added doc references

* new ECPU changes

* more changes to data sharing workshops

* more changes to fork (data studio)

* more changes

* Marty's feedback

* Marty's feedback to plsql workshop too

* Update setup-workshop-environment.md

* Delete 7381.png

* workshop # 3 ADB set up

and a couple of minor typos in workshops 1 and 2

* changes to adb-dcat workshop

* more changes

* minor typos in all 4 workshops

* quarterly qa build data lake

* new lab 11 in build DL with ADW

* minor changes database actions drop-down list

* final changes to build data lake workshop

* AI updates

AI workshop updates

* ai workshop updates

* Update query-using-select-ai.md

* Update query-using-select-ai.md

* updates

* more updates

* Update query-using-select-ai.md

* more new updates to ai workshop

* Update query-using-select-ai.md

* a new screen capture

* push Marty's feedback to fork

Final changes.

* updates sandbox manifest

* updates

* restored sandbox manifest

* Update setup-environment.md

* updates after CloudWorld

* final updates to ai workshop (also new labs 4 and 5)

* marty's feedback

* incorporated feedback

* minor PR edits by Sarah

* removed steps 7 & 8 Lab 2 > Task 3 per Alexey

The customer asked to remove this as it's not a requirement for the bucket to be public.

* more changes

* more changes per Alexey

* Update load-os-data-public.md

* Quarterly QA

I added a new step per the PM's request in the Data Sharing PL/SQL workshop. I also made a minor edit (removed space) in the Data Lake workshop.

* more updates

* Quarterly QA changes

* Update consume-share.md

* minor edit based on workshop user

* quarterly qa November 2023

* Added new videos to the workshop

Replaced 3 old silent videos with new ones. Added two new videos.

* Adding important notes to the two data sharing workshops

Per the PM's request.

* folder structure only  push to production

This push and the PR later is to make sure the folder structure is in the production repo before I start development. Only 1 .md file and the workshops folder.

* typos

* cloud links workshop

* UPDATES

* Update query-view.png

* update

* minor updates to chat ai workshop (Fork)

* test clones

* test pr

* Alexey's feedback

* Update data-sharing-diagram.png

* sarah's edits

* changes to Data Load UI

* removed script causing ML issue

* Update load-local-data.md

* updates: deprecated procedure and new code

* updates and test

* more updates

* minor update

* testing using a building block in a workshop

* updates

* building blocks debugging

* Update manifest.json

* fixing issues

* Update manifest.json

* delete cleanup.md from workshop folder (use common file)

* use common cleanup.md instead of local cleanup.md

* test common tasks

* update data sharing data studio workshop

* Update create-recipient.png

* PM's 1 feedback

* quarterly qa

* missing "Lab 2" from Manifest

* always free note addition

added a note

* always free change

* Update setup-environment.md

* update manage and monitor workshop

* Folder structure for new data share workshop (plus introduction.md)

* Updated Load and Analyze from clone

* Data Lake minor changes from clone

* manage and monitor workshop

* Remove the lab from the workshop per Marty's request

* mark-hornick-feedback

* used marty's setup file

* replaced notebook with a new one

* updates to lab 6 of manage and monitor

* Update adb-auto-scaling.md

* Nilay's feedback

* Update adb-auto-scaling.md

* updates to second ai workshop

* note change

* Changes to Load and Analyze workshop (other minor changes too)

* quarterly qa

* Update diagrams per Alexey (remove delta share icon)

* updated the 15-minutes workshop

* Update analyzing-movie-sales-data.md

* ords updates and misc

* updated data studio workshop

* ORDS and Misc updates

* updated freetier version

* updated livelabs version

* updating the manage and monitor workshop

* more updates

* lab 11 updates

* updated lab 14

* updated freetier

* more updates

* Update adw-connection-wallet.md

* update

* Create purge-scn.png

* livelabs updates

* Update adb-flashback.md

* final updates

* updated screens Ramona's review

* Update click-add-peer-database-second-time.png

* update the adb-dcat workshop

1. New ord 24.1.0 launchpad.
2. New navigation path to create dynamic groups
3. Updated OML UI

* Update see-clone-information-in-details-page-2.png

* Requested changes to the Data Lake workshop

* more updates

* updates to Data Lake workshop

* kscope24 workshop for Alexey

* new lab & other updates

* Update load-os-data-private.md

* Update load-os-data-private.md

* more updates, new lab

* minor update example 2

* Update load-os-data-private.md

* Chat AI workshop changes

* new notebook

* more updates

* minor updates

* New Iceberg Lab

added to the freetier and livelabs workshops

* Update manifest.json

* Update query-iceberg-tables.md

* new livelabs folder to request green button

* folder structure for two more data sharing workshops - green button

* 3rd workshop

* NEW LIVE DATA SHARE WORKSHOP

* Anne's feedback

* update

* Update introduction.md

* changes to manifest files and setup lab

* updated AI Chat workshop

* feedback

* adding the missing lab 4 to the workshop

* Update introduction.md

* Update introduction.md

* notebook update

* Update query-using-select-ai.md

* updated notebook

* changes based on Ramona's qa

* update freetier version

* Green button version for 3881 workshop

* data share cloud links db actions green button version

* (4) data sharing workshops updates (freetier and one sandbox)

* green button for Set up live data sharing between Oracle Databases using Cloud Links and PL/SQL APIs

* Chat with your data in Autonomous Database using generative AI updates

* updated the notebook

* blurred two screens

---------

Co-authored-by: Michelle Malcher <[email protected]>
Co-authored-by: Sarah Hirschfeld <[email protected]>

shared/adb-speaks-human/integrate-genai-old/integrate-genai.md

@@ -0,0 +1,216 @@
+# Integrate OCI Generative AI with Autonomous Database
+
+## Introduction
+
+In the previous lab, you saw a snapshot of the creative responses that can be produced by LLMs. Let's now apply that creativity to your data. The first step is to integrate OCI Generative AI with Autonomous Database.
+
+You can use different LLMs with Autonomous Database. This lets you pick the best model for your use case. Select AI profiles encapsulate the connections to each model; you specify which profile to use when generating results. In this lab, you will enable the user **`MOVIESTREAM`** to use multiple LLMs offered by the OCI Generative AI service. 
+
+Estimated Time: 10 minutes.
+
+### Objectives
+
+In this lab, you will:
+
+* Enable use of Resource Principals for the **`MOVIESTREAM`** user
+* Create Select AI Profile for OCI GenAI
+* Test the AI profile
+
+### Prerequisites
+
+- This lab requires the completion of **Labs 1 and 2** in the **Contents** menu on the left.
+
+## Task 1: Enable Resource Principal Usage for the MOVIESTREAM User
+
+The **`MOVIESTREAM`** user will connect to **OCI Generative AI** using resource principals (for more information, see [Use Resource Principal to Access Oracle Cloud Infrastructure Resources](https://docs.oracle.com/en/cloud/paas/autonomous-database/serverless/adbsb/resource-principal.html#GUID-E283804C-F266-4DFB-A9CF-B098A21E496A)). This means that the ADB resource (i.e. your ADB instance) needs access to OCI Generative AI. The OCI policy you created in the previous lab authorized that access.
+
+In ADB, enable the use of resource principals for the **`MOVIESTREAM`** user.
+
+1. From the **Console,** Open the **Navigation** menu and click **Oracle Database.** Under **Oracle Database,** click **Autonomous Database.**
+
+2. On the **Autonomous Database** page, click your ADB instance name link, **TrainingAIWorkshop** in our example.
+
+    ![Open ADB](./images/click-adb-instance.png "")
+
+3. On the **Autonomous Database details** page, click the **Database actions** drop-down list, and then click **SQL**.
+
+    ![Select SQL option](./images/click-sql.png "")
+
+    >**Note:** The setup script automatically enabled Resource Principals usage for MovieStream. The following 2 steps are optional.
+
+4. _The deployment in Lab 1 already set up resource principals in your database_. To better understand the use of resource principals, let's undo that enablement and recreate it. Disable the use of resource principals for the **`MOVIESTREAM`** user. Copy and paste the following code into your SQL Worksheet, and then click the **Run Script (F5)** icon in the Worksheet toolbar.
+
+    ```
+    <copy>
+    begin
+      dbms_cloud_admin.disable_resource_principal(username  => 'MOVIESTREAM');
+    end;
+    /
+    </copy>
+    ```
+
+    ![Disable resource principal](./images/disable-resource.png "")
+
+5. Now let's re-enable the use of the resource principal by the **`MOVIESTREAM`** user. Copy and paste the following code into your SQL Worksheet, and then click the **Run Script** icon.
+
+    ```
+    <copy>
+    begin
+      dbms_cloud_admin.enable_resource_principal(username  => 'MOVIESTREAM');
+    end;
+    /
+    </copy>
+    ```
+    
+    ![Enable resource principal](./images/enable-resource-principal.png "")
+
+6. Sign out of the **`ADMIN`** user. On the **Oracle Database Actions | SQL banner**, click the drop-down list next to the **`ADMIN`** user, and then select **Sign Out** from the drop-down menu.
+
+    ![Sign out from Admin](./images/sign-out.png "")
+
+## Task 2: Create an AI Profile for OCI Generative AI
+
+A Select AI profile encapsulates connection information for an AI provider. This includes:
+
+1. A security credential (e.g. the resource principal)
+2. The name of the provider
+3. The name of the LLM (optional)
+4. A list of target tables that will be used for natural language queries (required when using NL2SQL)
+You can create as many profiles as you need, which is useful when comparing the quality of the results of different models.
+
+For a complete list of the Select AI profile attributes, see the [DBMS\_CLOUD\_AI\_Package] (https://docs.oracle.com/en/cloud/paas/autonomous-database/serverless/adbsb/dbms-cloud-ai-package.html#GUID-D51B04DE-233B-48A2-BBFA-3AAB18D8C35C) in the Using Oracle Autonomous Database Serverless documentation. 
+
+>**Note:** The deployment script that you ran in **Lab 1 > Task 1 > Step 1** created a `Select AI` profile named **genai** using the code shown in this task; however, you'll practice dropping the file and then recreating it. For the **region** parameter, specify the region name where the OCI GenAI service is running and to which your tenancy is subscribed. In our example, we used **us-chicago-1** (the default). If you are subscribed to **Frankfurt**, then use `eu-frankfurt-1` as the value for the **region** parameter. If you are subscribed to **London**, then use `uk-london-1` as the value for the **region** parameter.
+
+1. Sign into the SQL worksheet as the **`MOVIESTREAM`** user with the password **`watchS0meMovies#`**. On the **Database Actions Launchpad** page, click the **Development** tab, and then click the **SQL** tab. The SQL Worksheet is displayed.
+
+    >**Note:** the **`MOVIESTREAM`** user was created as part of the setup and tables that were created in that schema. You can find the Moviestream password by navigating to **Developer Services** from the Navigation menu. Next, click **Resource Manager** > **Stacks** > Select the stack we created, **Deploy-ChatDB-Autonomous-Database...** > Select the job we created, **ormjob2024117214431** (use your own stack number)> Select **Outputs** under **Resources**.
+
+    ![Moviestream password](./images/moviestream-output-pswd.png "")
+
+2. Create an AI profile for the **Meta Llama 3** model. Copy and paste the following code into your SQL Worksheet, and then click the **Run Script** icon.
+
+```
+<copy>
+BEGIN
+    -- drops the profile if it already exists
+    DBMS_CLOUD_AI.drop_profile(
+        profile_name => 'genai',
+        force => true
+    );     
+
+    -- Meta Llama 3 (this is the default model, so you could skip the model attribute if you like)      
+    DBMS_CLOUD_AI.create_profile (                                              
+        profile_name => 'genai',
+        attributes   =>
+        '{"provider": "oci",
+            "credential_name": "OCI$RESOURCE_PRINCIPAL",
+            "object_list": [
+                {"owner": "moviestream", "name": "GENRE"},
+                {"owner": "moviestream", "name": "CUSTOMER"},
+                {"owner": "moviestream", "name": "PIZZA_SHOP"},
+                {"owner": "moviestream", "name": "STREAMS"},            
+                {"owner": "moviestream", "name": "MOVIES"},
+                {"owner": "moviestream", "name": "ACTORS"}
+            ],
+             "region": "us-chicago-1"
+            }');
+END;                                                                         
+/
+</copy>
+```
+
+![Create AI profile](./images/create-llama.png "")
+
+<!--
+
+3. Create an AI profile for the **Cohere model**. This model will not be used for SQL generation - it will only be used for generating innovative content. Copy and paste the following code into your SQL Worksheet, and then click the **Run Script** icon.
+    
+    ```
+    <copy>
+    BEGIN                                                                        
+        -- drops the profile if it already exists
+        DBMS_CLOUD_AI.drop_profile(profile_name => 'OCIAI_COHERE', force => true);    
+
+        DBMS_CLOUD_AI.CREATE_PROFILE(                                              
+            profile_name => 'OCIAI_COHERE',
+            attributes   => '{"provider": "oci",
+                                "credential_name": "OCI$RESOURCE_PRINCIPAL",                        
+                                "model": "cohere.command-r-plus",
+                                "oci_apiformat":"COHERE"
+                            }');
+    END;
+    /
+    </copy>
+    ```
+    ![Create AI profile](./images/create-cohere.png "")
+
+-->
+
+## Task 3: Test the AI profile
+
+We will use the PL/SQL API to generate a response from the **Meta Llama 3** model. This example is using the **chat** action. It is not using any private data coming from your database.
+
+1. Test the LLM and learn about Autonomous Database as the MOVIESTREAM user using the **genai** model. Copy and paste the following code into your SQL Worksheet, and then click the **Run Script** icon.
+
+    ```
+    <copy>
+    SELECT DBMS_CLOUD_AI.GENERATE(
+        prompt       => 'what is oracle autonomous database',
+        profile_name => 'genai',
+        action       => 'chat')
+    FROM dual;
+    </copy>
+    ```
+    ![Test the LLM](./images/genai-output.png "")
+
+<!--
+2. Compare the **genai** model to the **Llama** model. Copy and paste the following code into your SQL Worksheet, and then click the **Run Script** icon.
+
+    ```
+    <copy>
+    SELECT DBMS_CLOUD_AI.GENERATE(
+        prompt       => 'what is oracle autonomous database',
+        profile_name => 'OCIAI_LLAMA',
+        action       => 'chat')
+    FROM dual;
+    </copy>
+    ```
+    ![Generate sentence-like response](./images/llama-chat.png "")
+-->
+
+
+## Summary
+You learned how to integrate Autonomous Database with OCI Generative AI. And, you chatted with different models hosted on OCI Generative AI. Next, let's see how to use our private data with LLMs.
+ 
+You may now proceed to the next lab.
+
+## Learn More
+* [DBMS\_NETWORK\_ACL\_ADMIN PL/SQL Package](https://docs.oracle.com/en/database/oracle/oracle-database/19/arpls/DBMS_NETWORK_ACL_ADMIN.html#GUID-254AE700-B355-4EBC-84B2-8EE32011E692)
+* [DBMS\_CLOUD\_AI Package](https://docs.oracle.com/en-us/iaas/autonomous-database-serverless/doc/dbms-cloud-ai-package.html)
+* [Using Oracle Autonomous Database Serverless](https://docs.oracle.com/en/cloud/paas/autonomous-database/adbsa/index.html)
+* [Overview of Generative AI Service](https://docs.oracle.com/en-us/iaas/Content/generative-ai/overview.htm)
+
+## Acknowledgements
+
+  * **Authors:** 
+    * Lauran K. Serhal, Consulting User Assistance Developer
+    * Marty Gubar, Product Management
+  * **Contributors:**
+    * Stephen Stuart, Cloud Engineer
+    * Nicholas Cusato, Cloud Engineer
+    * Olivia Maxwell, Cloud Engineer
+    * Taylor Rees, Cloud Engineer
+    * Joanna Espinosa, Cloud Engineer
+
+* **Last Updated By/Date:** Lauran K. Serhal, December 2024
+
+Data about movies in this workshop were sourced from **Wikipedia**.
+
+Copyright (c) 2024  Oracle Corporation.
+
+Permission is granted to copy, distribute and/or modify this document
+under the terms of the GNU Free Documentation License, Version 1.3
+or any later version published by the Free Software Foundation;
+with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts.
+A copy of the license is included in the section entitled [GNU Free Documentation License](files/gnu-free-documentation-license.txt)