feat: Implement integration testing

integration-test-app/VERIFICATION_REPORT.md

@@ -0,0 +1,195 @@
+# Android Integration Test Framework - Verification Report
+
+This document verifies the current Android integration test implementation against the requirements outlined in the Integration Testing Framework specification.
+
+## Requirements Checklist
+
+### 1. Lightweight Test App
+
+**Status**: **COMPLETE**
+
+- Minimal Android test app (`integration-test-app/`)
+- Initializes mParticle SDK with WireMock endpoints
+- Sends test events matching iOS integration test scenarios:
+- User attributes (set, increment)
+- Custom events
+- Commerce events
+- Session attributes
+- Error logging
+- Timed events
+- Identity operations
+- Configurable via credentials file (no hardcoded values)
+- Single Activity design for simplicity
+
+**Files**:
+
+- `src/main/java/com/mparticle/integrationtest/IntegrationTestApplication.java`
+- `src/main/java/com/mparticle/integrationtest/MainActivity.java`
+- `src/main/AndroidManifest.xml`
+
+### 2. WireMock Integration
+
+**Status**: **COMPLETE**
+
+- WireMock Docker setup documented
+- Recording script (`record_android_tests.sh`) captures SDK requests
+- Verification script checks WireMock for captured requests
+- Mappings directory structure (`wiremock/mappings/android/`)
+- Example mapping file provided
+- Documentation for mapping format and dynamic fields
+
+**Files**:
+
+- `scripts/record_android_tests.sh`
+- `scripts/common.sh` (WireMock functions)
+- `wiremock/mappings/android/`
+
+### ⚠️ 3. Automated Preprocessing
+
+**Status**: **PARTIAL** - Needs Enhancement
+
+**Current State**:
+
+- Recording script saves mappings to `wiremock/mappings/android/recorded-mappings.json`
+- ❌ No script to extract and normalize request bodies into separate jsonBody files
+- ❌ No automated dynamic field replacement/preprocessing
+- ❌ No baseline preparation script
+
+**Gap**: Need preprocessing script to:
+
+- Extract request bodies from recorded mappings
+- Normalize dynamic fields (timestamps, IDs, etc.)
+- Create clean baseline files for comparison
+- Handle field templating/ignoring
+
+**Recommendation**: Create `scripts/preprocess_recordings.sh` similar to iOS implementation.
+
+### ⚠️ 4. Automated Verification
+
+**Status**: **PARTIAL** - Needs Enhancement
+
+**Current State**:
+
+- Script rebuilds SDK (`build_sdk_and_app()`)
+- Script launches emulator (`start_emulator()`)
+- Script runs test app (`run_test_app()`)
+- Script verifies requests exist in WireMock (`verify_requests()`)
+- ❌ No baseline comparison/diff functionality
+- ❌ No exit code 1 on mismatches (only checks if requests exist)
+- ❌ No detailed diff reporting
+
+**Gap**: Need enhanced verification to:
+
+- Compare captured requests against baseline mappings
+- Generate diffs for mismatches
+- Fail with exit code 1 when baselines don't match
+- Provide detailed mismatch reports
+
+**Recommendation**: Enhance `verify_requests()` function to compare against baselines.
+
+### ❌ 5. CI/CD Integration
+
+**Status**: **MISSING**
+
+**Current State**:
+
+- ❌ No GitHub Actions workflow file
+- ❌ No automated CI pipeline
+- ❌ No artifact uploads (logs, test results)
+- ❌ No integration with pull request checks
+
+**Gap**: Need GitHub Actions workflow that:
+
+- Runs on every build/pull request
+- Executes full pipeline: rebuild → run → verify
+- Uploads logs and artifacts
+- Blocks merges on test failures
+
+**Recommendation**: Create `.github/workflows/android-integration-tests.yml`
+
+### 6. Documentation
+
+**Status**: **COMPLETE** (with minor gaps)
+
+- Main documentation (`INTEGRATION_TESTING.md`)
+- Script documentation (`scripts/README.md`)
+- WireMock mappings documentation (`wiremock/mappings/android/README.md`)
+- README updated with integration testing section
+- ⚠️ Could add more detail on baseline management workflow
+- ⚠️ Could add CI/CD execution flow documentation
+
+## Implementation Summary
+
+### What's Working
+
+1. **Test App**: Fully functional minimal Android app that sends events to WireMock
+2. **Recording**: Script successfully records SDK requests to WireMock
+3. **Basic Verification**: Script verifies that requests were captured
+4. **Emulator Management**: Automated emulator startup and management
+5. **Credentials**: Secure credential handling via file-based approach
+6. **Documentation**: Comprehensive setup and usage documentation
+
+### What's Missing
+
+1. **Preprocessing Script**: Extract and normalize recorded requests
+2. **Baseline Comparison**: Compare requests against stored baselines
+3. **Diff Reporting**: Detailed mismatch reports
+4. **CI/CD Integration**: GitHub Actions workflow
+5. **Enhanced Verification**: Fail on baseline mismatches
+
+## Recommendations
+
+### High Priority
+
+1. **Create Preprocessing Script** (`scripts/preprocess_recordings.sh`)
+    - Extract request bodies from recorded mappings
+    - Normalize dynamic fields (timestamps, IDs, etc.)
+    - Generate clean baseline files
+
+2. **Enhance Verification** (`scripts/common.sh`)
+    - Add baseline comparison logic
+    - Generate diff reports
+    - Fail with exit code 1 on mismatches
+
+3. **Add CI/CD Workflow** (`.github/workflows/android-integration-tests.yml`)
+    - Automated test execution
+    - Artifact uploads
+    - PR checks
+
+### Medium Priority
+
+4. **Improve Error Reporting**
+    - More detailed diff output
+    - Better error messages
+    - Test result summaries
+
+5. **Add Baseline Management**
+    - Script to update baselines
+    - Baseline review process documentation
+    - Version control for baselines
+
+### Low Priority
+
+6. **Performance Optimization**
+    - Parallel test execution
+    - Caching strategies
+    - Tiered test suites (PR vs release)
+
+## Next Steps
+
+1. Implement preprocessing script for baseline extraction
+2. Enhance verification with baseline comparison
+3. Create GitHub Actions workflow
+4. Test end-to-end workflow
+5. Document baseline management process
+
+## Compliance Score
+
+**Overall**: 60% Complete
+
+- Test App: 100%
+- WireMock Integration: 100%
+- ⚠️ Preprocessing: 30%
+- ⚠️ Verification: 50%
+- ❌ CI/CD: 0%
+- Documentation: 85%