5 Commits

Author	SHA1	Message	Date
Arunavo Ray	37e5b68bd5	Added Github API rate limiting ... - Implemented comprehensive GitHub API rate limit handling: - Integrated @octokit/plugin-throttling for automatic retry with exponential backoff - Added RateLimitManager service to track and enforce rate limits - Store rate limit status in database for persistence across restarts - Automatic pause and resume when limits are exceeded - Proper user identification for 5000 req/hr authenticated limit (vs 60 unauthenticated) - Improved rate limit UI/UX: - Removed intrusive rate limit card from dashboard - Toast notifications only at critical thresholds (80% and 100% usage) - All rate limit events logged for debugging - Optimized for GitHub's API constraints: - Reduced default batch size from 10 to 5 repositories - Added documentation about GitHub's 100 concurrent request limit - Better handling of repositories with many issues/PRs	2025-09-09 11:14:43 +05:30
Arunavo Ray	ad7418aef2	tsc issues	2025-08-28 08:34:27 +05:30
Arunavo Ray	beedbaf9a4	Added Encryptions to All stored token and passwords	2025-07-16 16:02:34 +05:30
Arunavo Ray	a988be1028	feat: Implement comprehensive job recovery and resume process improvements ... - Added a startup recovery script to handle interrupted jobs before application startup. - Enhanced recovery system with database connection validation and stale job cleanup. - Improved middleware to check for recovery needs and handle recovery during requests. - Updated health check endpoint to include recovery system status and metrics. - Introduced test scripts for verifying recovery functionality and job state management. - Enhanced logging and error handling throughout the recovery process.	2025-05-24 13:45:25 +05:30
Arunavo Ray	abe3113755	feat: enhance job resilience with new database schema and recovery mechanisms ... - Added new fields to the mirror_jobs table for job resilience, including job_type, batch_id, total_items, completed_items, item_ids, completed_item_ids, in_progress, started_at, completed_at, and last_checkpoint. - Implemented database migration scripts to update the mirror_jobs table schema. - Introduced processWithResilience utility for handling item processing with checkpointing and recovery capabilities. - Updated API routes for mirroring organizations and repositories to utilize the new resilience features. - Created recovery system to detect and resume interrupted jobs on application startup. - Added middleware to initialize the recovery system when the server starts.	2025-05-22 14:33:03 +05:30