Merge branch 'develop' into 'feat/multimodal_page_boundary_detection'

# Conflicts:
#   .gitignore

Author: rstrahan

CHANGELOG.md

@@ -5,14 +5,35 @@ SPDX-License-Identifier: MIT-0
 
 ## [Unreleased]
 
+## [0.3.10]
+
+### Added
+
+- **Agent Analysis Feature for Natural Language Document Analytics**
+  - Added integrated AI-powered analytics agent that enables natural language querying of processed document data
+  - **Key Capabilities**: Convert natural language questions to SQL queries, generate interactive visualizations and tables, explore database schema automatically
+  - **Secure Architecture**: All Python code execution happens in isolated AWS Bedrock AgentCore sandboxes, not in Lambda functions
+  - **Multi-Tool Agent System**: Database discovery tool for schema exploration, Athena query tool for SQL execution, secure code sandbox for data transfer, Python visualization tool for charts and tables
+  - **Example Use Cases**: Query document processing volumes and trends, analyze confidence scores and extraction accuracy, explore document classifications and content patterns, generate custom charts and data tables
+  - **Sample W2 Test Data**: Includes 20 synthetic W2 tax documents for testing analytics capabilities
+  - **Configurable Models**: Supports multiple AI models including Claude 3.7 Sonnet (default), Claude 3.5 Sonnet, Nova Pro/Lite, and Haiku
+  - **Web UI Integration**: Accessible through "Document Analytics" section with real-time progress display and query history
+
+- **Automatic Glue Table Creation for Document Sections**
+  - Added automatic creation of AWS Glue tables for each document section type (classification) during processing
+  - Tables are created dynamically when new section types are encountered, eliminating manual table creation
+  - Consistent lowercase naming convention for tables ensures compatibility with case-sensitive S3 paths
+  - Tables are configured with partition projection for efficient date-based queries without manual partition management
+  - Automatic schema evolution - tables update when new fields are detected in extraction results
+
+## [0.3.9]
+
 ### Added
 - **Optional Permissions Boundary Support for Enterprise Deployments**
   - Added `PermissionsBoundaryArn` parameter to all CloudFormation templates for organizations with Service Control Policies (SCPs) requiring permissions boundaries
   - Comprehensive support for both explicit IAM roles and implicit roles created by AWS SAM functions and statemachines`
   - Conditional implementation ensures backward compatibility - when no permissions boundary is provided, roles deploy normally
 
-## [0.3.8]
-
 ### Added
 - IDP Configuration and Prompting Best Practices documentation [doc](./docs/idp-configuration-best-practices.md)
 

VERSION

@@ -1 +1 @@
-0.3.10-wip
+0.3.10

config_library/pattern-1/lending-package-sample/config.yaml

@@ -194,3 +194,13 @@ pricing:
         price: '1.5E-6'
       - name: cacheWriteInputTokens
         price: '1.875E-5'
+  - name: bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0
+    units:
+      - name: inputTokens
+        price: '1.5E-5'
+      - name: outputTokens
+        price: '7.5E-5'
+      - name: cacheReadInputTokens
+        price: '1.5E-6'
+      - name: cacheWriteInputTokens
+        price: '1.875E-5'

config_library/pattern-2/lending-package-sample/config.yaml

@@ -1425,3 +1425,13 @@ pricing:
         price: '1.5E-6'
       - name: cacheWriteInputTokens
         price: '1.875E-5'
+  - name: bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0
+    units:
+      - name: inputTokens
+        price: '1.5E-5'
+      - name: outputTokens
+        price: '7.5E-5'
+      - name: cacheReadInputTokens
+        price: '1.5E-6'
+      - name: cacheWriteInputTokens
+        price: '1.875E-5'

config_library/pattern-2/rvl-cdip-package-sample/config.yaml

@@ -891,3 +891,13 @@ pricing:
         price: '1.5E-6'
       - name: cacheWriteInputTokens
         price: '1.875E-5'
+  - name: bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0
+    units:
+      - name: inputTokens
+        price: '1.5E-5'
+      - name: outputTokens
+        price: '7.5E-5'
+      - name: cacheReadInputTokens
+        price: '1.5E-6'
+      - name: cacheWriteInputTokens
+        price: '1.875E-5'

config_library/pattern-3/rvl-cdip-package-sample/config.yaml

@@ -751,3 +751,13 @@ pricing:
         price: '1.5E-6'
       - name: cacheWriteInputTokens
         price: '1.875E-5'
+  - name: bedrock/us.anthropic.claude-opus-4-1-20250805-v1:0
+    units:
+      - name: inputTokens
+        price: '1.5E-5'
+      - name: outputTokens
+        price: '7.5E-5'
+      - name: cacheReadInputTokens
+        price: '1.5E-6'
+      - name: cacheWriteInputTokens
+        price: '1.875E-5'

docs/agent-analysis.md

@@ -15,6 +15,10 @@ The Agent Analysis feature provides intelligent data exploration capabilities th
 - **Real-time Analysis**: Get insights from your processed documents without manual data analysis
 - **Secure Code Execution**: Python visualization code runs in isolated AWS Bedrock AgentCore sandboxes
 
+
+https://github.com/user-attachments/assets/e2dea2c5-5eb1-42f6-9af5-469afd2135a7
+
+
 ## Key Features
 
 - **Multi-Modal AI Agent**: Uses advanced language models (Claude 3.7 Sonnet by default) for intelligent query understanding

docs/architecture.md

@@ -41,6 +41,8 @@ The solution uses a modular architecture with nested CloudFormation stacks to su
 - Pattern-specific optimizations and configurations
 - Optional features that can be enabled across all patterns:
   - Document summarization (controlled by `IsSummarizationEnabled` parameter)
+    - This feature also enables the "Chat with Document" functionality
+    - This feature does not use the Bedrock Knowledge Base but stores a full-text text file in S3
   - Document Knowledge Base (using Amazon Bedrock)
   - Automated accuracy evaluation against baseline data
 

docs/idp-configuration-best-practices.md

@@ -1475,6 +1475,7 @@ Configure from these supported models:
 - `us.anthropic.claude-3-7-sonnet-20250219-v1:0`
 - `us.anthropic.claude-sonnet-4-20250514-v1:0`
 - `us.anthropic.claude-opus-4-20250514-v1:0`
+- `us.anthropic.claude-opus-4-1-20250805-v1:0`
 
 #### When to Configure Bedrock OCR
 

docs/pattern-2.md

@@ -257,6 +257,7 @@ To use Bedrock OCR:
    - `us.anthropic.claude-3-7-sonnet-20250219-v1:0`
    - `us.anthropic.claude-sonnet-4-20250514-v1:0`
    - `us.anthropic.claude-opus-4-20250514-v1:0`
+   - `us.anthropic.claude-opus-4-1-20250805-v1:0`
 3. **Configure prompts**: Customize system and task prompts for your specific use case
 4. **Deploy**: The configuration can be updated through the Web UI without stack redeployment