Add custom configuration path support and enhance HITL functionality

- Add CustomConfigPath parameter to allow users to specify custom S3 configuration files
- Generalize HITL (Human-in-the-Loop) support from Pattern 1 only to Patterns 1 and 2
- Add conditional IAM permissions for custom config file access
- Update configuration documentation to reflect new CustomConfigPath feature
- Add chat with document resolver functionality
- Downgrade Python runtime from 3.13 to 3.12 for compatibility
- Add cost tracking columns to reporting database

Author: EC2 Default User

docs/configuration.md

@@ -36,12 +36,12 @@ The solution now supports specifying a custom configuration file location via th
 When deploying the stack, you can specify a custom configuration file:
 
 ```yaml
-CustomConfigPath: "s3://my-bucket/path/to/my-config.yaml"
+CustomConfigPath: "s3://my-bucket/custom-config/config.yaml"
 ```
 
 **Key Features:**
 - **Override Default Configuration**: When specified, your custom configuration completely replaces the default pattern configuration
-- **S3 URI Format**: Accepts standard S3 URI format (e.g., `s3://bucket-name/path/to/config.yaml`)
+- **S3 URI Format**: Accepts standard S3 URI format (e.g., `ss3://my-bucket/custom-config/config.yaml`)
 - **Least-Privilege Security**: IAM permissions are conditionally granted only to the specific S3 bucket and object you specify
 - **All Patterns Supported**: Works with Pattern 1 (BDA), Pattern 2 (Textract + Bedrock), and Pattern 3 (Textract + UDOP + Bedrock)
 
@@ -131,7 +131,7 @@ Key parameters that can be configured during CloudFormation deployment:
 - `WAFAllowedIPv4Ranges`: IP restrictions for web UI access (default: allow all)
 - `CloudFrontPriceClass`: Set CloudFront price class for UI distribution
 - `CloudFrontAllowedGeos`: Optional geographic restrictions for UI access
-- `CustomConfigPath`: Optional S3 URI to a custom configuration file (e.g., s3://my-bucket/config.yaml)
+- `CustomConfigPath`: Optional S3 URI to a custom configuration file that overrides pattern presets. Leave blank to use selected pattern configuration. Example: s3://my-bucket/custom-config/config.yaml
 
 ### Pattern Selection
 - `IDPPattern`: Select processing pattern:

template.yaml

@@ -100,16 +100,8 @@ Parameters:
     AllowedValues:
       - "lending-package-sample"
       - "default"
-    Description: >-
-      Select the configuration preset for Pattern 1. Each configuration contains pre-tuned settings for specific document processing scenarios - see https://github.com/aws-samples/sample-genai-idp/blob/main/config_library/README.md. 
-      Note: This selected configuration will be replaced by the Custom Configuration Path if specified.
-
-  CustomConfigPath:
-    Type: String
-    Default: ""
-    Description: Custom S3 path for configuration file (applicable to all patterns). For Example s3://your-bucket/path/to/config.yaml
-    AllowedPattern: '^(|s3://[a-zA-Z0-9.\-_]+(/.*)?)'
-    ConstraintDescription: Must be empty or a valid S3 URI (e.g., s3://my-bucket/my-key)
+    Description: Select the configuration preset for Pattern 1. Each configuration contains pre-tuned settings for specific document processing scenarios - see https://github.com/aws-samples/sample-genai-idp/blob/main/config_library/README.md. 
+    Note: This selected configuration will be replaced by the Custom Configuration Path if specified.
 
   # Pattern 2 Parameters
 
@@ -122,9 +114,8 @@ Parameters:
       - "rvl-cdip-package-sample-with-few-shot-examples"
       - "bank-statement-sample"
       - "default"
-    Description: >-
-      Select the configuration preset for Pattern 2. Each configuration contains pre-tuned settings for specific document processing scenarios - see https://github.com/aws-samples/sample-genai-idp/blob/main/config_library/README.md. 
-      Note: This selected configuration will be replaced by the Custom Configuration Path if specified.
+    Description: Select the configuration preset for Pattern 2. Each configuration contains pre-tuned settings for specific document processing scenarios see https://github.com/aws-samples/sample-genai-idp/blob/main/config_library/README.md. 
+    Note: Custom configuration overrides the selected pattern configuration when provided.
 
   Pattern2CustomClassificationModelARN:
     Type: String
@@ -150,10 +141,8 @@ Parameters:
     AllowedValues:
       - "rvl-cdip-package-sample"
       - "default"
-    Description: >-
-      Select the configuration preset for Pattern 3. Each configuration contains pre-tuned settings for specific document processing scenarios - see https://github.com/aws-samples/sample-genai-idp/blob/main/config_library/README.md. 
-      Note: This selected configuration will be replaced by the Custom Configuration Path if specified.
-
+    Description: Select the configuration preset for Pattern 3. Each configuration contains pre-tuned settings for specific document processing scenarios - see https://github.com/aws-samples/sample-genai-idp/blob/main/config_library/README.md. 
+    Note: Custom configuration overrides the selected pattern configuration when provided.
   # HITL (A2I) Configuration
 
   EnableHITL:
@@ -278,6 +267,13 @@ Parameters:
       If you provided a Bedrock Guardrail Id above, provide the corresponding Guardrail version here (e.g. DRAFT|1|2|...).
 
   # General Configuration
+  CustomConfigPath:
+    Type: String
+    Default: ""
+    Description: S3 URI pointing to your custom configuration YAML file. When provided, this configuration overrides the selected pattern preset and applies to all processing patterns. Leave blank to use the selected pattern configuration preset. Example: s3://my-bucket/custom-config/config.yaml
+    AllowedPattern: '^(|s3://[a-zA-Z0-9.\-_]+(/.*)?)'
+    ConstraintDescription: Must be empty or a valid S3 URI (Example: s3://my-bucket/custom-config/config.yaml)
+
   MaxConcurrentWorkflows:
     Type: Number
     Default: 100