mirror of
https://github.com/Monadical-SAS/reflector.git
synced 2025-12-20 20:29:06 +00:00
* feat: calendar integration
* feat: add ICS calendar API endpoints for room configuration and sync
* feat: add Celery background tasks for ICS sync
* feat: implement Phase 2 - Multiple active meetings per room with grace period
This commit adds support for multiple concurrent meetings per room, implementing
grace period logic and improved meeting lifecycle management for calendar integration.
## Database Changes
- Remove unique constraint preventing multiple active meetings per room
- Add last_participant_left_at field to track when meeting becomes empty
- Add grace_period_minutes field (default: 15) for configurable grace period
## Meeting Controller Enhancements
- Add get_all_active_for_room() to retrieve all active meetings for a room
- Add get_active_by_calendar_event() to find meetings by calendar event ID
- Maintain backward compatibility with existing get_active() method
## New API Endpoints
- GET /rooms/{room_name}/meetings/active - List all active meetings
- POST /rooms/{room_name}/meetings/{meeting_id}/join - Join specific meeting
## Meeting Lifecycle Improvements
- 15-minute grace period after last participant leaves
- Automatic reactivation when participant rejoins during grace period
- Force close calendar meetings 30 minutes after scheduled end time
- Update process_meetings task to handle multiple active meetings
## Whereby Integration
- Clear grace period when participants join via webhook events
- Track participant count for grace period management
## Testing
- Add comprehensive tests for multiple active meetings
- Test grace period behavior and participant rejoin scenarios
- Test calendar meeting force closure logic
- All 5 new tests passing
This enables proper calendar integration with overlapping meetings while
preventing accidental meeting closures through the grace period mechanism.
* feat: implement frontend for calendar integration (Phase 3 & 4)
- Created MeetingSelection component for choosing between multiple active meetings
- Shows both active meetings and upcoming calendar events (30 min ahead)
- Displays meeting metadata with privacy controls (owner-only details)
- Supports creation of unscheduled meetings alongside calendar meetings
- Added waiting page for users joining before scheduled start time
- Shows countdown timer until meeting begins
- Auto-transitions to meeting when calendar event becomes active
- Handles early joining with proper routing
- Created collapsible info panel showing meeting details
- Displays calendar metadata (title, description, attendees)
- Shows participant count and duration
- Privacy-aware: sensitive info only visible to room owners
- Integrated ICS settings into room configuration dialog
- Test connection functionality with immediate feedback
- Manual sync trigger with detailed results
- Shows last sync time and ETag for monitoring
- Configurable sync intervals (1 min to 1 hour)
- New /room/{roomName} route for meeting selection
- Waiting room at /room/{roomName}/wait?eventId={id}
- Classic room page at /{roomName} with meeting info
- Uses sessionStorage to pass selected meeting between pages
- Added new endpoints for active/upcoming meetings
- Regenerated TypeScript client with latest OpenAPI spec
- Proper error handling and loading states
- Auto-refresh every 30 seconds for live updates
- Color-coded badges for meeting status
- Attendee status indicators (accepted/declined/tentative)
- Responsive design with Chakra UI components
- Clear visual hierarchy between active and upcoming meetings
- Smart truncation for long attendee lists
This completes the frontend implementation for calendar integration,
enabling users to seamlessly join scheduled meetings from their
calendar applications.
* WIP: Migrate calendar integration frontend to React Query
- Migrate all calendar components from useApi to React Query hooks
- Fix Chakra UI v3 compatibility issues (Card, Progress, spacing props, leftIcon)
- Update backend Meeting model to include calendar fields
- Replace imperative API calls with declarative React Query patterns
- Remove old OpenAPI generated files that conflict with new structure
* fix: alembic migrations
* feat: add calendar migration
* feat: update ics, first version working
* feat: implement tabbed interface for room edit dialog
- Add General, Calendar, and Share tabs to organize room settings
- Move ICS settings to dedicated Calendar tab
- Move Zulip configuration to Share tab
- Keep basic room settings and webhooks in General tab
- Remove redundant migration file
- Fix Chakra UI v3 compatibility issues in calendar components
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
* fix: infinite loop
* feat: improve ICS calendar sync UX and fix room URL matching
- Replace "Test Connection" button with "Force Sync" button (Edit Room only)
- Show detailed sync results: total events downloaded vs room matches
- Remove emoticons and auto-hide timeout for cleaner UX
- Fix room URL matching to use UI_BASE_URL instead of BASE_URL
- Replace FaSync icon with LuRefreshCw for consistency
- Clear sync results when dialog closes or Force Sync pressed
- Update tests to reflect UI_BASE_URL change and exact URL matching
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
* feat: reorganize room edit dialog and fix Force Sync button
- Move WebHook configuration from General to dedicated WebHook tab
- Add WebHook tab after Share tab in room edit dialog
- Fix Force Sync button not appearing by adding missing isEditing prop
- Fix indentation issues in MeetingSelection component
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
* feat: complete calendar integration with UI improvements and code cleanup
Calendar Integration Tasks:
- Update upcoming meetings window from 30 to 120 minutes
- Include currently happening events in upcoming meetings API
- Create shared time utility functions (formatDateTime, formatCountdown, formatStartedAgo)
- Improve ongoing meetings UI logic with proper time detection
- Fix backend code organization and remove excessive documentation
UI/UX Improvements:
- Restructure room page layout using MinimalHeader pattern
- Remove borders from header and footer elements
- Change button text from "Leave Meeting" to "Leave Room"
- Remove "Back to Reflector" footer for cleaner design
- Extract WaitPageClient component for better separation
Backend Changes:
- calendar_events.py: Fix import organization and extend timing window
- rooms.py: Update API default from 30 to 120 minutes
- Enhanced test coverage for ongoing meeting scenarios
Frontend Changes:
- MinimalHeader: Add onLeave prop for custom navigation
- MeetingSelection: Complete layout restructure with shared utilities
- timeUtils: New shared utility file for consistent time formatting
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
* feat: remove wait page and simplify Join button with 5-minute disable logic
- Remove entire wait page directory and associated files
- Update handleJoinUpcoming to create unscheduled meeting directly
- Simplify Join button to single state:
- Always shows "Join" text
- Blue when meeting can be joined (ongoing or within 5 minutes)
- Gray/disabled when more than 5 minutes away
- Remove confusing "Join Now", "Join Early" text variations
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
* feat: improve calendar integration and meeting UI
- Refactor ICS sync tasks to use @asynctask decorator for cleaner async handling
- Extract meeting creation logic into reusable function
- Improve meeting selection UI with distinct current/upcoming sections
- Add early join functionality for upcoming meetings within 5-minute window
- Simplify non-ICS room workflow with direct Whereby embed
- Fix import paths and component organization
🤖 Generated with [Claude Code](https://claude.ai/code)
Co-Authored-By: Claude <noreply@anthropic.com>
* feat: restore original recording consent functionality
- Remove custom ConsentDialogButton and WherebyEmbed components
- Merge RoomClient logic back into main room page
- Restore original consent UI: blue button with toast modal
- Maintain calendar integration features for ICS-enabled rooms
- Add consent-handler.md documentation of original functionality
- Preserve focus management and accessibility features
* fix: redirect Join Now button to local meeting page
- Change handleJoinDirect to use onMeetingSelect instead of opening external URL
- Join Now button now navigates to /{roomName}/{meetingId} instead of whereby.com
- Maintains proper routing within the application
* feat: remove restrictive message for non-owners in private rooms
- Remove confusing message about room owner permissions
- Cleaner UI for all users regardless of ownership status
- Users will only see available meetings and join options
* feat: improve meeting selection UI for better readability
- Limit page content to max 800px width for better 4K display readability
- Remove LIVE tag badge for cleaner interface
- Remove shadow from main live meeting box
- Remove blue border and hover effects for minimal design
- Change background to neutral gray for less visual noise
* feat: add room by name endpoint for non-authenticated access
- Add GET /rooms/name/{room_name} backend endpoint
- Endpoint supports non-authenticated access for public rooms
- Returns RoomDetails with webhook fields hidden for non-owners
- Update useRoomGetByName hook to use new direct endpoint
- Remove authentication requirement from frontend hook
- Regenerate API client types
Fixes: Non-authenticated users can now access room lobbies
* feat: add friendly message when no meetings are ongoing
- Show centered message with calendar icon when no meetings are active
- Message text: 'No meetings right now' with helpful description
- Contextual text for owners/shared rooms mentioning quick meeting option
- Consistent gray styling matching the rest of the interface
- Only displays when both currentMeetings and upcomingMeetings are empty
* style: center no meetings message and remove background
- Change from Box to Flex with flex=1 for vertical centering
- Remove gray background, border radius, and padding
- Message now appears cleanly centered in available space
- Maintains horizontal and vertical centering
* feat: move Create Meeting button to header
- Remove 'Start a Quick Meeting' box from main content area
- Add showCreateButton and onCreateMeeting props to MinimalHeader
- Create Meeting button now appears in header left of Leave Room
- Only shows for room owners or shared room users
- Update no meetings message to remove reference to quick meeting below
- Cleaner, more accessible UI with actions in the header
* style: change room title and no meetings text to pure black
- Update room title in MinimalHeader from gray.700 to black
- Update 'No meetings right now' text from gray.700 to black
- Improves visual hierarchy and readability
- Consistent with other pages' styling
* style: linting
* fix: remove plan files
* fix: alembic migration with named foreign keys
* feat: add SyncStatus enum and refactor ICS sync to use rooms controller
- Add SyncStatus enum to replace string literals in ICS sync status
- Replace direct SQL queries in worker with rooms_controller.get_ics_enabled()
- Improve type safety and maintainability of ICS sync code
- Enum values: SUCCESS, UNCHANGED, ERROR, SKIPPED maintain backward compatibility
* refactor: remove unnecessary docstring from get_ics_enabled method
The function name is self-explanatory
* fix: import top level
* feat: use Literal type for ICSStatus.status field
- Changed ICSStatus.status from str to Literal['enabled', 'disabled']
- Improves type safety and API documentation
* feat: update TypeScript definitions for ICSStatus Literal type
- OpenAPI generation now properly reflects Literal['enabled', 'disabled'] type
- Improves type safety for frontend consumers of the API
- Applied automatic formatting via pre-commit hooks
* refactor: replace loguru with structlog in ics_sync service
- Replace loguru import with structlog in services/ics_sync.py
- Update logging calls to use structlog's structured format with keyword args
- Maintains consistency with other services using structlog
- Changes: logger.info(f'...') -> logger.info('...', key=value) format
* chore: remove loguru dependency and improve type annotations
- Remove loguru from dependencies in pyproject.toml (replaced with structlog)
- Update meeting controller methods to properly return Optional types
- Update dependency lock file after loguru removal
* fix: resolve pyflakes warnings in ics_sync and meetings modules
Remove unused imports and variables to clean up code quality
* Remove grace period logic and improve meeting deactivation
- Removed grace_period_minutes and last_participant_left_at fields
- Simplified deactivation logic based on actual usage patterns:
* Active sessions: Keep meeting active regardless of scheduled time
* Calendar meetings: Wait until scheduled end if unused, deactivate immediately once used and empty
* On-the-fly meetings: Deactivate immediately when empty
- Created migration to drop unused database columns
- Updated tests to remove grace period test cases
* Update test to match new deactivation logic for calendar meetings
* fix: remove unwanted file
* fix: incompleted changes from EVENT_WINDOW*
* fix: update room ICS API tests to include required webhook fields and correct URL
- Add webhook_url and webhook_secret fields to room creation tests
- Fix room URL matching in ICS sync test to use UI_BASE_URL instead of BASE_URL
- Aligns test with actual API requirements and ICS sync service implementation
* fix: add Redis distributed locking to prevent race conditions in process_meetings
- Implement per-meeting locks using Redis to prevent concurrent processing
- Add lock extension after slow API calls (Whereby) to handle long-running operations
- Use redis-py's built-in lock.extend() with replace_ttl=True for simple TTL refresh
- Track and log skipped meetings when locked by other workers
- Document SSRF analysis showing it's low-risk due to async worker isolation
This prevents multiple workers from processing the same meeting simultaneously,
which could cause state corruption or duplicate deactivations.
* refactor: rename MinimalHeader to MeetingMinimalHeader for clarity
* fix: minor code quality improvements - add emoji constants, fix type safety, cleanup comments
* fix: database migration
* self-pr review
* self-pr review
* self-pr review treeshake
* fix: local fixes
* fix: creation of meeting
* fix: meeting selection create button
* compile fix
* fix: meeting selection responsive
* fix: rework process logic for meeting
* fix: meeting useEffect frontend-only dedupe (#647)
* meeting useEffect frontend-only dedupe
* format
* also get room by name backend fix
---------
Co-authored-by: Igor Loskutov <igor.loskutoff@gmail.com>
* invalidate meeting list on new meeting
* test fix
* room url copy button for ics
* calendar refresh quick action icon
* remove work.md
* meeting page frontend fixes
* hide number of meeting participants
* Revert "hide number of meeting participants"
This reverts commit 38906c5d1a.
* ui bits
* ui bits
* remove log
* room name typing stricten
* feat: protect atomic operation involving external service with redlock
---------
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Igor Monadical <igor@monadical.com>
Co-authored-by: Igor Loskutov <igor.loskutoff@gmail.com>
193 lines
6.6 KiB
Python
193 lines
6.6 KiB
Python
import os
|
|
from unittest.mock import AsyncMock, patch
|
|
|
|
import pytest
|
|
|
|
from reflector.db.rooms import rooms_controller
|
|
from reflector.services.ics_sync import ICSSyncService
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_attendee_parsing_bug():
|
|
"""
|
|
Test that reproduces the attendee parsing bug where a string with comma-separated
|
|
emails gets parsed as individual characters instead of separate email addresses.
|
|
|
|
The bug manifests as getting 29 attendees with emails like "M", "A", "I", etc.
|
|
instead of properly parsed email addresses.
|
|
"""
|
|
# Create a test room
|
|
room = await rooms_controller.add(
|
|
name="test-room",
|
|
user_id="test-user",
|
|
zulip_auto_post=False,
|
|
zulip_stream="",
|
|
zulip_topic="",
|
|
is_locked=False,
|
|
room_mode="normal",
|
|
recording_type="cloud",
|
|
recording_trigger="automatic-2nd-participant",
|
|
is_shared=False,
|
|
ics_url="http://test.com/test.ics",
|
|
ics_enabled=True,
|
|
)
|
|
|
|
# Read the test ICS file that reproduces the bug and update it with current time
|
|
from datetime import datetime, timedelta, timezone
|
|
|
|
test_ics_path = os.path.join(
|
|
os.path.dirname(__file__), "test_attendee_parsing_bug.ics"
|
|
)
|
|
with open(test_ics_path, "r") as f:
|
|
ics_content = f.read()
|
|
|
|
# Replace the dates with current time + 1 hour to ensure it's within the 24h window
|
|
now = datetime.now(timezone.utc)
|
|
future_time = now + timedelta(hours=1)
|
|
end_time = future_time + timedelta(hours=1)
|
|
|
|
# Format dates for ICS format
|
|
dtstart = future_time.strftime("%Y%m%dT%H%M%SZ")
|
|
dtend = end_time.strftime("%Y%m%dT%H%M%SZ")
|
|
dtstamp = now.strftime("%Y%m%dT%H%M%SZ")
|
|
|
|
# Update the ICS content with current dates
|
|
ics_content = ics_content.replace("20250910T180000Z", dtstart)
|
|
ics_content = ics_content.replace("20250910T190000Z", dtend)
|
|
ics_content = ics_content.replace("20250910T174000Z", dtstamp)
|
|
|
|
# Create sync service and mock the fetch
|
|
sync_service = ICSSyncService()
|
|
|
|
with patch.object(
|
|
sync_service.fetch_service, "fetch_ics", new_callable=AsyncMock
|
|
) as mock_fetch:
|
|
mock_fetch.return_value = ics_content
|
|
|
|
# Debug: Parse the ICS content directly to examine attendee parsing
|
|
calendar = sync_service.fetch_service.parse_ics(ics_content)
|
|
from reflector.settings import settings
|
|
|
|
room_url = f"{settings.UI_BASE_URL}/{room.name}"
|
|
|
|
print(f"Room URL being used for matching: {room_url}")
|
|
print(f"ICS content:\n{ics_content}")
|
|
|
|
events, total_events = sync_service.fetch_service.extract_room_events(
|
|
calendar, room.name, room_url
|
|
)
|
|
|
|
print(f"Total events in calendar: {total_events}")
|
|
print(f"Events matching room: {len(events)}")
|
|
|
|
# Perform the sync
|
|
result = await sync_service.sync_room_calendar(room)
|
|
|
|
# Check that the sync succeeded
|
|
assert result.get("status") == "success"
|
|
assert result.get("events_found", 0) >= 0 # Allow for debugging
|
|
|
|
# We already have the matching events from the debug code above
|
|
assert len(events) == 1
|
|
event = events[0]
|
|
|
|
# This is where the bug manifests - check the attendees
|
|
attendees = event["attendees"]
|
|
|
|
# Print attendee info for debugging
|
|
print(f"Number of attendees found: {len(attendees)}")
|
|
for i, attendee in enumerate(attendees):
|
|
print(
|
|
f"Attendee {i}: email='{attendee.get('email')}', name='{attendee.get('name')}'"
|
|
)
|
|
|
|
# With the fix, we should now get properly parsed email addresses
|
|
# Check that no single characters are parsed as emails
|
|
single_char_emails = [
|
|
att for att in attendees if att.get("email") and len(att["email"]) == 1
|
|
]
|
|
|
|
if single_char_emails:
|
|
print(
|
|
f"BUG DETECTED: Found {len(single_char_emails)} single-character emails:"
|
|
)
|
|
for att in single_char_emails:
|
|
print(f" - '{att['email']}'")
|
|
|
|
# Should have attendees but not single-character emails
|
|
assert len(attendees) > 0
|
|
assert (
|
|
len(single_char_emails) == 0
|
|
), f"Found {len(single_char_emails)} single-character emails, parsing is still buggy"
|
|
|
|
# Check that all emails are valid (contain @ symbol)
|
|
valid_emails = [
|
|
att for att in attendees if att.get("email") and "@" in att["email"]
|
|
]
|
|
assert len(valid_emails) == len(
|
|
attendees
|
|
), "Some attendees don't have valid email addresses"
|
|
|
|
# We expect around 29 attendees (28 from the comma-separated list + 1 organizer)
|
|
assert (
|
|
len(attendees) >= 25
|
|
), f"Expected around 29 attendees, got {len(attendees)}"
|
|
|
|
|
|
@pytest.mark.asyncio
|
|
async def test_correct_attendee_parsing():
|
|
"""
|
|
Test what correct attendee parsing should look like.
|
|
"""
|
|
from datetime import datetime, timezone
|
|
|
|
from icalendar import Event
|
|
|
|
from reflector.services.ics_sync import ICSFetchService
|
|
|
|
service = ICSFetchService()
|
|
|
|
# Create a properly formatted event with multiple attendees
|
|
event = Event()
|
|
event.add("uid", "test-correct-attendees")
|
|
event.add("summary", "Test Meeting")
|
|
event.add("location", "http://test.com/test")
|
|
event.add("dtstart", datetime.now(timezone.utc))
|
|
event.add("dtend", datetime.now(timezone.utc))
|
|
|
|
# Add attendees the correct way (separate ATTENDEE lines)
|
|
event.add("attendee", "mailto:alice@example.com", parameters={"CN": "Alice"})
|
|
event.add("attendee", "mailto:bob@example.com", parameters={"CN": "Bob"})
|
|
event.add("attendee", "mailto:charlie@example.com", parameters={"CN": "Charlie"})
|
|
event.add(
|
|
"organizer", "mailto:organizer@example.com", parameters={"CN": "Organizer"}
|
|
)
|
|
|
|
# Parse the event
|
|
result = service._parse_event(event)
|
|
|
|
assert result is not None
|
|
attendees = result["attendees"]
|
|
|
|
# Should have 4 attendees (3 attendees + 1 organizer)
|
|
assert len(attendees) == 4
|
|
|
|
# Check that all emails are valid email addresses
|
|
emails = [att["email"] for att in attendees if att.get("email")]
|
|
expected_emails = [
|
|
"alice@example.com",
|
|
"bob@example.com",
|
|
"charlie@example.com",
|
|
"organizer@example.com",
|
|
]
|
|
|
|
for email in emails:
|
|
assert "@" in email, f"Invalid email format: {email}"
|
|
assert len(email) > 5, f"Email too short: {email}"
|
|
|
|
# Check that we have the expected emails
|
|
assert "alice@example.com" in emails
|
|
assert "bob@example.com" in emails
|
|
assert "charlie@example.com" in emails
|
|
assert "organizer@example.com" in emails
|