Diskover 2.4.1 Release Notes

Overview

Version 2.4.1 brings significant improvements to system stability, performance optimization, and enhanced authentication capabilities, along with a few minor bug fixes.

New Features

Smart Search and Reports Migration (DEV-31)

• Smart searches and reports have been migrated from file-based storage to database storage
• Added default templates for improved user experience
• Enhanced reliability and performance for saved searches and reports
• Simplified backup and recovery processes

Diskover Logs Page (DEV-470)

• New dedicated PHP page for viewing and analyzing Diskover logs
• Improved debugging capabilities with enhanced log visibility
• Better monitoring of system operations and troubleshooting

Okta Integration Improvements (DEV-126)

• Configurable OAuth2 groups scope name for Okta integration
• Added configuration parameter allowing custom group scope names
• Enhanced flexibility for organizations with custom Okta configurations
• Improved compatibility with enterprise Okta deployments

LDAP Improvements (DEV-455)

• Improved error messaging for better troubleshooting
• Fixed API-based nested lookups for LDAP authentication
• Duplicated LDAP logic from login.php to ApiLdapToken.php for consistency

Performance Improvements

Index Management Optimization (DEV-462)

• Reverted to single msearch for index information fetching
• Fixed cost query using aggregates for proper identification of indices containing cost data
• Improved performance for large-scale deployments
• Removed unnecessary checks for cost data existence in indices

Storage Optimization (DEV-461)

• Made storage of relative parent path in documents optional (default: false)
• Reduced index size and improved indexing performance
• Configurable option for environments requiring parent path information

Elasticsearch Cluster Monitoring (DEV-481)

• Added Elasticsearch cluster space information to index page
• Enhanced visibility into cluster health and capacity
• Included cluster space metrics in Diskover logs

Bug Fixes

Windows Path Handling (DEV-453)

• Normalized usage of function for UNC paths
• Fixed post-index plugins not properly handling UNC pathing nomenclature
• Ensured consistent path handling between scan tasks and plugins

Admin Service Permissions

• Fixed SQLite database ownership issue causing HTTP 500 errors on startup
• Database now properly owned by nginx:nginx user
• Resolved permission conflicts on first boot

Index Management (DEV-483)

• Fixed issue where adding many indices to an alias caused "always use latest index" feature to malfunction
• Improved alias handling for large index collections

Web Interface Fixes

Search Results Display (DEV-490)

• Fixed "sizedu allocated" column display in search results table
• Corrected column alignment and data presentation

Error Prevention (DEV-485)

• Prevented 404 errors by validating table data before rendering
• Improved error handling in web interface

Long URL Handling (DEV-478)

• Fixed issues with long URLs on index page
• Improved URL handling and display

API Endpoint Fix (DEV-493)

• Fixed diskover-web API latest endpoint error when encountering corrupt indices
• Added proper error handling for malformed index data

Configuration and Deployment

Scroll Timeout Configuration (DEV-452)

• Added configurable search scroll timeout option for Elasticsearch queries
• Allows customization based on cluster performance and network conditions

User Tracking (DEV-465)

• Implemented changes to support user tracking solution
• Enhanced analytics and usage monitoring capabilities

Proxy Configuration (DEV-95)

• Updated function to handle custom port configuration
• Changed default port from 80 to appropriate values based on configuration variables

OVA Preparation (PLAT-131)

• Updated OVA image preparation for version 2.4.0 / 2.4.1
• Streamlined deployment process

Security and Stability

Application Locking (DEV-330)

• Implemented application lock to protect task start operations
• Prevents race conditions and concurrent task conflicts

Authentication Middleware (DEV-102)

• Restored previous authentication middleware functionality
• Included Swagger page support
• Fixed referral handling

Developer Experience

API Documentation (DEV-487)

• Added metrics API endpoint to the list of available APIs
• Improved API documentation and discoverability

Debug Mode Enhancement (DEV-110)

• Fixed exception when using debug option
• Improved debugging output and error reporting

Index Filtering Debug (DEV-94)

• Added debugging capabilities for index filtering
• Must set specific debug flags for detailed output

Packaging and Distribution

NoArch Updates (DEV-122)

• Updated package architecture specifications
• Improved compatibility across different systems

CI Pipeline Updates (DEV-123)

• Streamlined build and deployment process for RPMs

Service Management (DEV-115)

• Removed unnecessary post-action to restart nginx
• Improved service startup reliability

Known Issues

• None reported for this release

Upgrade Notes

1. Database migration will occur automatically for smart searches and reports
2. Review new configuration parameters for OAuth2 and LDAP if using those authentication methods
3. Update any custom scripts that depend on relative parent paths in documents (now optional)
4. Verify Elasticsearch cluster has adequate space before upgrading

System Requirements

• No changes from version 2.4.0

Deprecations

• File-based storage for smart searches and reports (migrated to database)