文件大小: 768.25 KB
最後修改: 2025-10-16 09:59:58
2025-10-16 09:03:31 - 初始化新小時日誌檔案
2025-10-16 09:03:31 - INFO - main - [app_initializer.py:383] - update_hourly_log_file - 小時日誌檔案已更新: 20251016_09.log
2025-10-16 09:03:31 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: True
2025-10-16 09:03:31 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.08 秒,結果: 0
2025-10-16 09:03:32 - INFO - main - [app_initializer.py:383] - update_hourly_log_file - 小時日誌檔案已更新: 20251016_09.log
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: True
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:03:32 - INFO - main - [app_initializer.py:383] - update_hourly_log_file - 小時日誌檔案已更新: 20251016_09.log
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: True
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:03:32 - INFO - main - [app_initializer.py:383] - update_hourly_log_file - 小時日誌檔案已更新: 20251016_09.log
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: True
2025-10-16 09:03:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:03:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.06 秒,結果: 0
2025-10-16 09:04:11 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 85, UID: 9ucrm7crwr, 進度: 0/1
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:04:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:04:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:04:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:04:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:04:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:04:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 123.9MB, CPU 0.0%
2025-10-16 09:04:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 124.5MB, CPU 0.0%
2025-10-16 09:04:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 129.7MB, CPU 0.0%
2025-10-16 09:04:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 144.9MB, CPU 0.0%
2025-10-16 09:05:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:05:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:05:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:05:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:05:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:05:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:05:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:05:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:06:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 123.9MB, CPU 0.0%
2025-10-16 09:06:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 124.5MB, CPU 0.0%
2025-10-16 09:06:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 129.7MB, CPU 0.0%
2025-10-16 09:06:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 144.9MB, CPU 0.0%
2025-10-16 09:06:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:06:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:06:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:06:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:06:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:06:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:06:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:06:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:07:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:07:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:07:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:07:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:07:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:07:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 123.9MB, CPU 0.0%
2025-10-16 09:07:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 124.5MB, CPU 0.0%
2025-10-16 09:07:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 129.7MB, CPU 0.0%
2025-10-16 09:07:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 144.9MB, CPU 0.0%
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.06 秒,結果: 0
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:08:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:08:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:08:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:08:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:08:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:09:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 123.9MB, CPU 0.0%
2025-10-16 09:09:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 124.5MB, CPU 0.0%
2025-10-16 09:09:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 129.7MB, CPU 0.0%
2025-10-16 09:09:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 144.9MB, CPU 0.0%
2025-10-16 09:09:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:09:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:09:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:09:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:09:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:09:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:09:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:09:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:10:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:10:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:10:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:10:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:10:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:10:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 123.9MB, CPU 0.0%
2025-10-16 09:10:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 124.5MB, CPU 0.0%
2025-10-16 09:10:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 129.7MB, CPU 0.0%
2025-10-16 09:10:35 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 144.9MB, CPU 0.0%
2025-10-16 09:11:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:11:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:11:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:11:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:11:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:11:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:11:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:11:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:12:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 123.9MB, CPU 0.0%
2025-10-16 09:12:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 124.5MB, CPU 0.0%
2025-10-16 09:12:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 129.7MB, CPU 0.0%
2025-10-16 09:12:05 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 144.9MB, CPU 0.0%
2025-10-16 09:12:24 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:12:24 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:12:24 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:12:24 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:12:25 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:12:25 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:12:25 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:12:25 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:12:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:12:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:12:32 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:12:32 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:12:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:12:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:12:33 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:12:33 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:13:11 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:13:11 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:13:11 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:13:11 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:13:11 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:13:11 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:13:11 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:13:11 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:13:11 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:13:11 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:13:11 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:13:11 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:13:16 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:13:16 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:13:16 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:13:16 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:13:16 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:13:16 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:13:16 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:13:16 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:13:16 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:13:16 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:13:16 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:13:16 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:13:16 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:13:16 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:13:16 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.64GB
2025-10-16 09:13:16 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:13:16 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:13:16 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:13:16 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.64GB
2025-10-16 09:13:16 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:13:16 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:13:16 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:13:16 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.64GB
2025-10-16 09:13:16 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:13:16 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:13:16 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:13:16 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.64GB
2025-10-16 09:13:16 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:13:16 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:13:16 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:13:16 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:13:16 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:13:16 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:13:16 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:13:16 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:13:16 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:13:16 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:13:16 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:13:16 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:13:16 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:13:16 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:13:16 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:13:16 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:13:16 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:13:16 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:13:16 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:13:16 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:13:16 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:13:16 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:13:16 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:13:16 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:13:16 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:13:16 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:13:16 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:13:16 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:13:16 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:13:16 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:13:16 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:13:16 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:13:16 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:13:16 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:13:16 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:13:16 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:13:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:14:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:14:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:14:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:14:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:14:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:14:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:14:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:14:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:14:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.6MB, CPU 0.0%
2025-10-16 09:14:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.6MB, CPU 0.0%
2025-10-16 09:14:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.2MB, CPU 0.0%
2025-10-16 09:14:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.0MB, CPU 0.0%
2025-10-16 09:15:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:15:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:15:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:15:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:15:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:15:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:15:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:15:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:15:23 - INFO - database - [database.py:420] - process_url - UI 提交生成 UID: txh355k3d2
2025-10-16 09:15:23 - INFO - database - [database.py:426] - process_url - UI 提交 URL https://www.twitch.tv/iamruru,結果將立即顯示
2025-10-16 09:15:23 - INFO - database - [database.py:436] - process_url - URL https://www.twitch.tv/iamruru 已存在,但按照需求視為新提交進行審核
2025-10-16 09:15:23 - INFO - main - [web_routes.py:115] - submit_url - UI 提交,URL ID: 86, Phone: , Email: chengruwu0322@gmail.com
2025-10-16 09:15:23 - INFO - database - [database.py:536] - get_pending_url - 找到待处理的 URL: ID=86, URL=https://www.twitch.tv/iamruru
2025-10-16 09:15:23 - INFO - main - [request_processor.py:690] - process_pending_urls - 已添加 1 個 URL 到處理隊列
2025-10-16 09:15:23 - INFO - main - [url_processor.py:42] - process_url - 工作線程 #1 開始處理 URL ID: 86
2025-10-16 09:15:23 - INFO - main - [url_processor.py:83] - process_url - 分析 URL: https://www.twitch.tv/iamruru
2025-10-16 09:15:23 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 1/3, force_new_driver=False)
2025-10-16 09:15:23 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:15:23 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:15:23 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:15:23 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:23 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:23 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:23 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:23 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:24 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a5b986c44ca <unknown>
#1 0x5a5b98143566 <unknown>
#2 0x5a5b9817eb4c <unknown>
#3 0x5a5b9817a7c4 <unknown>
#4 0x5a5b981c9bd3 <unknown>
#5 0x5a5b981c9286 <unknown>
#6 0x5a5b981bb403 <unknown>
#7 0x5a5b98187b02 <unknown>
#8 0x5a5b981887c1 <unknown>
#9 0x5a5b98688298 <unknown>
#10 0x5a5b9868c0ff <unknown>
#11 0x5a5b9866f729 <unknown>
#12 0x5a5b9868cca5 <unknown>
#13 0x5a5b98654f8f <unknown>
#14 0x5a5b986b1308 <unknown>
#15 0x5a5b986b14e3 <unknown>
#16 0x5a5b986c3463 <unknown>
#17 0x72a152494ac3 <unknown>
2025-10-16 09:15:24 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:24 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:24 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:24 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:24 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:25 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5b9d3f3bc4e3 <unknown>
#1 0x5b9d3f0ebc76 <unknown>
#2 0x5b9d3f114d78 <unknown>
#3 0x5b9d3f111029 <unknown>
#4 0x5b9d3f14fccc <unknown>
#5 0x5b9d3f14f47f <unknown>
#6 0x5b9d3f146de3 <unknown>
#7 0x5b9d3f11c2dd <unknown>
#8 0x5b9d3f11d34e <unknown>
#9 0x5b9d3f37c3e4 <unknown>
#10 0x5b9d3f3803d7 <unknown>
#11 0x5b9d3f38ab20 <unknown>
#12 0x5b9d3f381023 <unknown>
#13 0x5b9d3f34f1aa <unknown>
#14 0x5b9d3f3a56b8 <unknown>
#15 0x5b9d3f3a5847 <unknown>
#16 0x5b9d3f3b5243 <unknown>
#17 0x7df692094ac3 <unknown>
2025-10-16 09:15:25 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:25 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:25 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x55dc080474ca <unknown>
#1 0x55dc07ac6566 <unknown>
#2 0x55dc07b01b4c <unknown>
#3 0x55dc07afd7c4 <unknown>
#4 0x55dc07b4cbd3 <unknown>
#5 0x55dc07b4c286 <unknown>
#6 0x55dc07b3e403 <unknown>
#7 0x55dc07b0ab02 <unknown>
#8 0x55dc07b0b7c1 <unknown>
#9 0x55dc0800b298 <unknown>
#10 0x55dc0800f0ff <unknown>
#11 0x55dc07ff2729 <unknown>
#12 0x55dc0800fca5 <unknown>
#13 0x55dc07fd7f8f <unknown>
#14 0x55dc08034308 <unknown>
#15 0x55dc080344e3 <unknown>
#16 0x55dc08046463 <unknown>
#17 0x722372694ac3 <unknown>
2025-10-16 09:15:25 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:25 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:25 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:25 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:25 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:25 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:25 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:25 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:25 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:25 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:25 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:25 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5c80b245e4ca <unknown>
#1 0x5c80b1edd566 <unknown>
#2 0x5c80b1f18b4c <unknown>
#3 0x5c80b1f147c4 <unknown>
#4 0x5c80b1f63bd3 <unknown>
#5 0x5c80b1f63286 <unknown>
#6 0x5c80b1f55403 <unknown>
#7 0x5c80b1f21b02 <unknown>
#8 0x5c80b1f227c1 <unknown>
#9 0x5c80b2422298 <unknown>
#10 0x5c80b24260ff <unknown>
#11 0x5c80b2409729 <unknown>
#12 0x5c80b2426ca5 <unknown>
#13 0x5c80b23eef8f <unknown>
#14 0x5c80b244b308 <unknown>
#15 0x5c80b244b4e3 <unknown>
#16 0x5c80b245d463 <unknown>
#17 0x77db26494ac3 <unknown>
2025-10-16 09:15:25 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:25 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:25 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:25 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:25 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:25 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:25 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:26 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:26 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x632264d2e4e3 <unknown>
#1 0x632264a5dc76 <unknown>
#2 0x632264a86d78 <unknown>
#3 0x632264a83029 <unknown>
#4 0x632264ac1ccc <unknown>
#5 0x632264ac147f <unknown>
#6 0x632264ab8de3 <unknown>
#7 0x632264a8e2dd <unknown>
#8 0x632264a8f34e <unknown>
#9 0x632264cee3e4 <unknown>
#10 0x632264cf23d7 <unknown>
#11 0x632264cfcb20 <unknown>
#12 0x632264cf3023 <unknown>
#13 0x632264cc11aa <unknown>
#14 0x632264d176b8 <unknown>
#15 0x632264d17847 <unknown>
#16 0x632264d27243 <unknown>
#17 0x7fbbbec94ac3 <unknown>
2025-10-16 09:15:26 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:26 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:26 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 86, UID: txh355k3d2, 進度: 0/1
2025-10-16 09:15:26 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5e3a6ba464ca <unknown>
#1 0x5e3a6b4c5566 <unknown>
#2 0x5e3a6b500b4c <unknown>
#3 0x5e3a6b4fc7c4 <unknown>
#4 0x5e3a6b54bbd3 <unknown>
#5 0x5e3a6b54b286 <unknown>
#6 0x5e3a6b53d403 <unknown>
#7 0x5e3a6b509b02 <unknown>
#8 0x5e3a6b50a7c1 <unknown>
#9 0x5e3a6ba0a298 <unknown>
#10 0x5e3a6ba0e0ff <unknown>
#11 0x5e3a6b9f1729 <unknown>
#12 0x5e3a6ba0eca5 <unknown>
#13 0x5e3a6b9d6f8f <unknown>
#14 0x5e3a6ba33308 <unknown>
#15 0x5e3a6ba334e3 <unknown>
#16 0x5e3a6ba45463 <unknown>
#17 0x75b180694ac3 <unknown>
2025-10-16 09:15:26 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:26 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:26 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:26 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:26 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:15:26 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:15:26 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:15:28 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:15:28 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:28 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:28 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:28 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:28 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:28 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5b91af6404ca <unknown>
#1 0x5b91af0bf566 <unknown>
#2 0x5b91af0fab4c <unknown>
#3 0x5b91af0f67c4 <unknown>
#4 0x5b91af145bd3 <unknown>
#5 0x5b91af145286 <unknown>
#6 0x5b91af137403 <unknown>
#7 0x5b91af103b02 <unknown>
#8 0x5b91af1047c1 <unknown>
#9 0x5b91af604298 <unknown>
#10 0x5b91af6080ff <unknown>
#11 0x5b91af5eb729 <unknown>
#12 0x5b91af608ca5 <unknown>
#13 0x5b91af5d0f8f <unknown>
#14 0x5b91af62d308 <unknown>
#15 0x5b91af62d4e3 <unknown>
#16 0x5b91af63f463 <unknown>
#17 0x782853894ac3 <unknown>
2025-10-16 09:15:28 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:28 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:28 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:28 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:28 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:28 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:29 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:29 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x63a6ee54b4e3 <unknown>
#1 0x63a6ee27ac76 <unknown>
#2 0x63a6ee2a3d78 <unknown>
#3 0x63a6ee2a0029 <unknown>
#4 0x63a6ee2deccc <unknown>
#5 0x63a6ee2de47f <unknown>
#6 0x63a6ee2d5de3 <unknown>
#7 0x63a6ee2ab2dd <unknown>
#8 0x63a6ee2ac34e <unknown>
#9 0x63a6ee50b3e4 <unknown>
#10 0x63a6ee50f3d7 <unknown>
#11 0x63a6ee519b20 <unknown>
#12 0x63a6ee510023 <unknown>
#13 0x63a6ee4de1aa <unknown>
#14 0x63a6ee5346b8 <unknown>
#15 0x63a6ee534847 <unknown>
#16 0x63a6ee544243 <unknown>
#17 0x757ccda94ac3 <unknown>
2025-10-16 09:15:29 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:29 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:29 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x60317bf564ca <unknown>
#1 0x60317b9d5566 <unknown>
#2 0x60317ba10b4c <unknown>
#3 0x60317ba0c7c4 <unknown>
#4 0x60317ba5bbd3 <unknown>
#5 0x60317ba5b286 <unknown>
#6 0x60317ba4d403 <unknown>
#7 0x60317ba19b02 <unknown>
#8 0x60317ba1a7c1 <unknown>
#9 0x60317bf1a298 <unknown>
#10 0x60317bf1e0ff <unknown>
#11 0x60317bf01729 <unknown>
#12 0x60317bf1eca5 <unknown>
#13 0x60317bee6f8f <unknown>
#14 0x60317bf43308 <unknown>
#15 0x60317bf434e3 <unknown>
#16 0x60317bf55463 <unknown>
#17 0x7e3925e94ac3 <unknown>
2025-10-16 09:15:29 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:29 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:29 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:29 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:29 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:29 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:29 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:29 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:29 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:29 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:29 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:29 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5d28040c54ca <unknown>
#1 0x5d2803b44566 <unknown>
#2 0x5d2803b7fb4c <unknown>
#3 0x5d2803b7b7c4 <unknown>
#4 0x5d2803bcabd3 <unknown>
#5 0x5d2803bca286 <unknown>
#6 0x5d2803bbc403 <unknown>
#7 0x5d2803b88b02 <unknown>
#8 0x5d2803b897c1 <unknown>
#9 0x5d2804089298 <unknown>
#10 0x5d280408d0ff <unknown>
#11 0x5d2804070729 <unknown>
#12 0x5d280408dca5 <unknown>
#13 0x5d2804055f8f <unknown>
#14 0x5d28040b2308 <unknown>
#15 0x5d28040b24e3 <unknown>
#16 0x5d28040c4463 <unknown>
#17 0x70bbffc94ac3 <unknown>
2025-10-16 09:15:29 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:29 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:29 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:29 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:30 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:30 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:30 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:30 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5d7e03db34e3 <unknown>
#1 0x5d7e03ae2c76 <unknown>
#2 0x5d7e03b0bd78 <unknown>
#3 0x5d7e03b08029 <unknown>
#4 0x5d7e03b46ccc <unknown>
#5 0x5d7e03b4647f <unknown>
#6 0x5d7e03b3dde3 <unknown>
#7 0x5d7e03b132dd <unknown>
#8 0x5d7e03b1434e <unknown>
#9 0x5d7e03d733e4 <unknown>
#10 0x5d7e03d773d7 <unknown>
#11 0x5d7e03d81b20 <unknown>
#12 0x5d7e03d78023 <unknown>
#13 0x5d7e03d461aa <unknown>
#14 0x5d7e03d9c6b8 <unknown>
#15 0x5d7e03d9c847 <unknown>
#16 0x5d7e03dac243 <unknown>
#17 0x786958894ac3 <unknown>
2025-10-16 09:15:30 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:30 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:30 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5fafc05874ca <unknown>
#1 0x5fafc0006566 <unknown>
#2 0x5fafc0041b4c <unknown>
#3 0x5fafc003d7c4 <unknown>
#4 0x5fafc008cbd3 <unknown>
#5 0x5fafc008c286 <unknown>
#6 0x5fafc007e403 <unknown>
#7 0x5fafc004ab02 <unknown>
#8 0x5fafc004b7c1 <unknown>
#9 0x5fafc054b298 <unknown>
#10 0x5fafc054f0ff <unknown>
#11 0x5fafc0532729 <unknown>
#12 0x5fafc054fca5 <unknown>
#13 0x5fafc0517f8f <unknown>
#14 0x5fafc0574308 <unknown>
#15 0x5fafc05744e3 <unknown>
#16 0x5fafc0586463 <unknown>
#17 0x79afaaa94ac3 <unknown>
2025-10-16 09:15:30 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:30 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:30 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:30 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:30 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:15:30 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:15:30 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:15:34 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:15:34 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:34 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:34 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:34 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:34 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:34 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5b2adeefb4ca <unknown>
#1 0x5b2ade97a566 <unknown>
#2 0x5b2ade9b5b4c <unknown>
#3 0x5b2ade9b17c4 <unknown>
#4 0x5b2adea00bd3 <unknown>
#5 0x5b2adea00286 <unknown>
#6 0x5b2ade9f2403 <unknown>
#7 0x5b2ade9beb02 <unknown>
#8 0x5b2ade9bf7c1 <unknown>
#9 0x5b2adeebf298 <unknown>
#10 0x5b2adeec30ff <unknown>
#11 0x5b2adeea6729 <unknown>
#12 0x5b2adeec3ca5 <unknown>
#13 0x5b2adee8bf8f <unknown>
#14 0x5b2adeee8308 <unknown>
#15 0x5b2adeee84e3 <unknown>
#16 0x5b2adeefa463 <unknown>
#17 0x71b02cc94ac3 <unknown>
2025-10-16 09:15:34 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:34 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:34 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:34 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:35 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:35 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:35 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:35 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:35 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x59ac3a39b4e3 <unknown>
#1 0x59ac3a0cac76 <unknown>
#2 0x59ac3a0f3d78 <unknown>
#3 0x59ac3a0f0029 <unknown>
#4 0x59ac3a12eccc <unknown>
#5 0x59ac3a12e47f <unknown>
#6 0x59ac3a125de3 <unknown>
#7 0x59ac3a0fb2dd <unknown>
#8 0x59ac3a0fc34e <unknown>
#9 0x59ac3a35b3e4 <unknown>
#10 0x59ac3a35f3d7 <unknown>
#11 0x59ac3a369b20 <unknown>
#12 0x59ac3a360023 <unknown>
#13 0x59ac3a32e1aa <unknown>
#14 0x59ac3a3846b8 <unknown>
#15 0x59ac3a384847 <unknown>
#16 0x59ac3a394243 <unknown>
#17 0x722d2d094ac3 <unknown>
2025-10-16 09:15:35 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:35 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:35 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f5969d004ca <unknown>
#1 0x5f596977f566 <unknown>
#2 0x5f59697bab4c <unknown>
#3 0x5f59697b67c4 <unknown>
#4 0x5f5969805bd3 <unknown>
#5 0x5f5969805286 <unknown>
#6 0x5f59697f7403 <unknown>
#7 0x5f59697c3b02 <unknown>
#8 0x5f59697c47c1 <unknown>
#9 0x5f5969cc4298 <unknown>
#10 0x5f5969cc80ff <unknown>
#11 0x5f5969cab729 <unknown>
#12 0x5f5969cc8ca5 <unknown>
#13 0x5f5969c90f8f <unknown>
#14 0x5f5969ced308 <unknown>
#15 0x5f5969ced4e3 <unknown>
#16 0x5f5969cff463 <unknown>
#17 0x79e38ee94ac3 <unknown>
2025-10-16 09:15:35 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:35 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:35 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:35 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:35 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:35 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:35 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:35 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:35 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:35 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:35 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:35 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x581e336444ca <unknown>
#1 0x581e330c3566 <unknown>
#2 0x581e330feb4c <unknown>
#3 0x581e330fa7c4 <unknown>
#4 0x581e33149bd3 <unknown>
#5 0x581e33149286 <unknown>
#6 0x581e3313b403 <unknown>
#7 0x581e33107b02 <unknown>
#8 0x581e331087c1 <unknown>
#9 0x581e33608298 <unknown>
#10 0x581e3360c0ff <unknown>
#11 0x581e335ef729 <unknown>
#12 0x581e3360cca5 <unknown>
#13 0x581e335d4f8f <unknown>
#14 0x581e33631308 <unknown>
#15 0x581e336314e3 <unknown>
#16 0x581e33643463 <unknown>
#17 0x7d2786094ac3 <unknown>
2025-10-16 09:15:35 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:35 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:36 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:36 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:36 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:36 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:36 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 86, UID: txh355k3d2, 進度: 0/1
2025-10-16 09:15:36 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:36 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:36 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x63d00c8b94e3 <unknown>
#1 0x63d00c5e8c76 <unknown>
#2 0x63d00c611d78 <unknown>
#3 0x63d00c60e029 <unknown>
#4 0x63d00c64cccc <unknown>
#5 0x63d00c64c47f <unknown>
#6 0x63d00c643de3 <unknown>
#7 0x63d00c6192dd <unknown>
#8 0x63d00c61a34e <unknown>
#9 0x63d00c8793e4 <unknown>
#10 0x63d00c87d3d7 <unknown>
#11 0x63d00c887b20 <unknown>
#12 0x63d00c87e023 <unknown>
#13 0x63d00c84c1aa <unknown>
#14 0x63d00c8a26b8 <unknown>
#15 0x63d00c8a2847 <unknown>
#16 0x63d00c8b2243 <unknown>
#17 0x7bda09494ac3 <unknown>
2025-10-16 09:15:36 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:36 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:36 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5796f499f4ca <unknown>
#1 0x5796f441e566 <unknown>
#2 0x5796f4459b4c <unknown>
#3 0x5796f44557c4 <unknown>
#4 0x5796f44a4bd3 <unknown>
#5 0x5796f44a4286 <unknown>
#6 0x5796f4496403 <unknown>
#7 0x5796f4462b02 <unknown>
#8 0x5796f44637c1 <unknown>
#9 0x5796f4963298 <unknown>
#10 0x5796f49670ff <unknown>
#11 0x5796f494a729 <unknown>
#12 0x5796f4967ca5 <unknown>
#13 0x5796f492ff8f <unknown>
#14 0x5796f498c308 <unknown>
#15 0x5796f498c4e3 <unknown>
#16 0x5796f499e463 <unknown>
#17 0x70c0c0694ac3 <unknown>
2025-10-16 09:15:36 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:37 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:37 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:37 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:37 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:15:37 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:15:37 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:15:37 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (1/2): WebDriver 創建失敗
2025-10-16 09:15:40 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 2/3, force_new_driver=False)
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:40 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f23e7ad54ca <unknown>
#1 0x5f23e7554566 <unknown>
#2 0x5f23e758fb4c <unknown>
#3 0x5f23e758b7c4 <unknown>
#4 0x5f23e75dabd3 <unknown>
#5 0x5f23e75da286 <unknown>
#6 0x5f23e75cc403 <unknown>
#7 0x5f23e7598b02 <unknown>
#8 0x5f23e75997c1 <unknown>
#9 0x5f23e7a99298 <unknown>
#10 0x5f23e7a9d0ff <unknown>
#11 0x5f23e7a80729 <unknown>
#12 0x5f23e7a9dca5 <unknown>
#13 0x5f23e7a65f8f <unknown>
#14 0x5f23e7ac2308 <unknown>
#15 0x5f23e7ac24e3 <unknown>
#16 0x5f23e7ad4463 <unknown>
#17 0x7231d1294ac3 <unknown>
2025-10-16 09:15:40 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:40 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:40 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:40 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:40 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:40 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:40 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:40 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:41 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x61fc192dc4e3 <unknown>
#1 0x61fc1900bc76 <unknown>
#2 0x61fc19034d78 <unknown>
#3 0x61fc19031029 <unknown>
#4 0x61fc1906fccc <unknown>
#5 0x61fc1906f47f <unknown>
#6 0x61fc19066de3 <unknown>
#7 0x61fc1903c2dd <unknown>
#8 0x61fc1903d34e <unknown>
#9 0x61fc1929c3e4 <unknown>
#10 0x61fc192a03d7 <unknown>
#11 0x61fc192aab20 <unknown>
#12 0x61fc192a1023 <unknown>
#13 0x61fc1926f1aa <unknown>
#14 0x61fc192c56b8 <unknown>
#15 0x61fc192c5847 <unknown>
#16 0x61fc192d5243 <unknown>
#17 0x71f6cfe94ac3 <unknown>
2025-10-16 09:15:41 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:41 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:41 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x60db64dbe4ca <unknown>
#1 0x60db6483d566 <unknown>
#2 0x60db64878b4c <unknown>
#3 0x60db648747c4 <unknown>
#4 0x60db648c3bd3 <unknown>
#5 0x60db648c3286 <unknown>
#6 0x60db648b5403 <unknown>
#7 0x60db64881b02 <unknown>
#8 0x60db648827c1 <unknown>
#9 0x60db64d82298 <unknown>
#10 0x60db64d860ff <unknown>
#11 0x60db64d69729 <unknown>
#12 0x60db64d86ca5 <unknown>
#13 0x60db64d4ef8f <unknown>
#14 0x60db64dab308 <unknown>
#15 0x60db64dab4e3 <unknown>
#16 0x60db64dbd463 <unknown>
#17 0x7bb156294ac3 <unknown>
2025-10-16 09:15:41 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:41 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:41 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:41 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:41 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:41 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:41 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:41 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:41 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:41 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:41 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:41 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5c70562574ca <unknown>
#1 0x5c7055cd6566 <unknown>
#2 0x5c7055d11b4c <unknown>
#3 0x5c7055d0d7c4 <unknown>
#4 0x5c7055d5cbd3 <unknown>
#5 0x5c7055d5c286 <unknown>
#6 0x5c7055d4e403 <unknown>
#7 0x5c7055d1ab02 <unknown>
#8 0x5c7055d1b7c1 <unknown>
#9 0x5c705621b298 <unknown>
#10 0x5c705621f0ff <unknown>
#11 0x5c7056202729 <unknown>
#12 0x5c705621fca5 <unknown>
#13 0x5c70561e7f8f <unknown>
#14 0x5c7056244308 <unknown>
#15 0x5c70562444e3 <unknown>
#16 0x5c7056256463 <unknown>
#17 0x779a07694ac3 <unknown>
2025-10-16 09:15:41 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:41 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:41 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:41 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:41 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:41 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:41 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:42 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:42 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x58fcddfe94e3 <unknown>
#1 0x58fcddd18c76 <unknown>
#2 0x58fcddd41d78 <unknown>
#3 0x58fcddd3e029 <unknown>
#4 0x58fcddd7cccc <unknown>
#5 0x58fcddd7c47f <unknown>
#6 0x58fcddd73de3 <unknown>
#7 0x58fcddd492dd <unknown>
#8 0x58fcddd4a34e <unknown>
#9 0x58fcddfa93e4 <unknown>
#10 0x58fcddfad3d7 <unknown>
#11 0x58fcddfb7b20 <unknown>
#12 0x58fcddfae023 <unknown>
#13 0x58fcddf7c1aa <unknown>
#14 0x58fcddfd26b8 <unknown>
#15 0x58fcddfd2847 <unknown>
#16 0x58fcddfe2243 <unknown>
#17 0x79ca63894ac3 <unknown>
2025-10-16 09:15:42 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:42 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:42 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a4623a634ca <unknown>
#1 0x5a46234e2566 <unknown>
#2 0x5a462351db4c <unknown>
#3 0x5a46235197c4 <unknown>
#4 0x5a4623568bd3 <unknown>
#5 0x5a4623568286 <unknown>
#6 0x5a462355a403 <unknown>
#7 0x5a4623526b02 <unknown>
#8 0x5a46235277c1 <unknown>
#9 0x5a4623a27298 <unknown>
#10 0x5a4623a2b0ff <unknown>
#11 0x5a4623a0e729 <unknown>
#12 0x5a4623a2bca5 <unknown>
#13 0x5a46239f3f8f <unknown>
#14 0x5a4623a50308 <unknown>
#15 0x5a4623a504e3 <unknown>
#16 0x5a4623a62463 <unknown>
#17 0x7a145fa94ac3 <unknown>
2025-10-16 09:15:42 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:42 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:42 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:42 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:42 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:15:42 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:15:42 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:15:44 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:15:44 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:44 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:44 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:44 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:44 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:44 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x57a48692f4ca <unknown>
#1 0x57a4863ae566 <unknown>
#2 0x57a4863e9b4c <unknown>
#3 0x57a4863e57c4 <unknown>
#4 0x57a486434bd3 <unknown>
#5 0x57a486434286 <unknown>
#6 0x57a486426403 <unknown>
#7 0x57a4863f2b02 <unknown>
#8 0x57a4863f37c1 <unknown>
#9 0x57a4868f3298 <unknown>
#10 0x57a4868f70ff <unknown>
#11 0x57a4868da729 <unknown>
#12 0x57a4868f7ca5 <unknown>
#13 0x57a4868bff8f <unknown>
#14 0x57a48691c308 <unknown>
#15 0x57a48691c4e3 <unknown>
#16 0x57a48692e463 <unknown>
#17 0x709255894ac3 <unknown>
2025-10-16 09:15:44 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:44 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:44 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:44 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:44 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:44 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:45 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:45 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:45 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5f1a039694e3 <unknown>
#1 0x5f1a03698c76 <unknown>
#2 0x5f1a036c1d78 <unknown>
#3 0x5f1a036be029 <unknown>
#4 0x5f1a036fcccc <unknown>
#5 0x5f1a036fc47f <unknown>
#6 0x5f1a036f3de3 <unknown>
#7 0x5f1a036c92dd <unknown>
#8 0x5f1a036ca34e <unknown>
#9 0x5f1a039293e4 <unknown>
#10 0x5f1a0392d3d7 <unknown>
#11 0x5f1a03937b20 <unknown>
#12 0x5f1a0392e023 <unknown>
#13 0x5f1a038fc1aa <unknown>
#14 0x5f1a039526b8 <unknown>
#15 0x5f1a03952847 <unknown>
#16 0x5f1a03962243 <unknown>
#17 0x792f9f894ac3 <unknown>
2025-10-16 09:15:45 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:45 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:45 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x62cd96b5f4ca <unknown>
#1 0x62cd965de566 <unknown>
#2 0x62cd96619b4c <unknown>
#3 0x62cd966157c4 <unknown>
#4 0x62cd96664bd3 <unknown>
#5 0x62cd96664286 <unknown>
#6 0x62cd96656403 <unknown>
#7 0x62cd96622b02 <unknown>
#8 0x62cd966237c1 <unknown>
#9 0x62cd96b23298 <unknown>
#10 0x62cd96b270ff <unknown>
#11 0x62cd96b0a729 <unknown>
#12 0x62cd96b27ca5 <unknown>
#13 0x62cd96aeff8f <unknown>
#14 0x62cd96b4c308 <unknown>
#15 0x62cd96b4c4e3 <unknown>
#16 0x62cd96b5e463 <unknown>
#17 0x71a673894ac3 <unknown>
2025-10-16 09:15:45 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:45 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:45 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:45 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:45 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:45 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:45 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:45 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:45 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:45 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:45 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:45 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x59762664b4ca <unknown>
#1 0x5976260ca566 <unknown>
#2 0x597626105b4c <unknown>
#3 0x5976261017c4 <unknown>
#4 0x597626150bd3 <unknown>
#5 0x597626150286 <unknown>
#6 0x597626142403 <unknown>
#7 0x59762610eb02 <unknown>
#8 0x59762610f7c1 <unknown>
#9 0x59762660f298 <unknown>
#10 0x5976266130ff <unknown>
#11 0x5976265f6729 <unknown>
#12 0x597626613ca5 <unknown>
#13 0x5976265dbf8f <unknown>
#14 0x597626638308 <unknown>
#15 0x5976266384e3 <unknown>
#16 0x59762664a463 <unknown>
#17 0x72efb5c94ac3 <unknown>
2025-10-16 09:15:45 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:45 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:45 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:45 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:45 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:45 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:46 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:46 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:46 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5c5def1004e3 <unknown>
#1 0x5c5deee2fc76 <unknown>
#2 0x5c5deee58d78 <unknown>
#3 0x5c5deee55029 <unknown>
#4 0x5c5deee93ccc <unknown>
#5 0x5c5deee9347f <unknown>
#6 0x5c5deee8ade3 <unknown>
#7 0x5c5deee602dd <unknown>
#8 0x5c5deee6134e <unknown>
#9 0x5c5def0c03e4 <unknown>
#10 0x5c5def0c43d7 <unknown>
#11 0x5c5def0ceb20 <unknown>
#12 0x5c5def0c5023 <unknown>
#13 0x5c5def0931aa <unknown>
#14 0x5c5def0e96b8 <unknown>
#15 0x5c5def0e9847 <unknown>
#16 0x5c5def0f9243 <unknown>
#17 0x762771a94ac3 <unknown>
2025-10-16 09:15:46 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:46 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:46 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 86, UID: txh355k3d2, 進度: 0/1
2025-10-16 09:15:46 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f7f56d6c4ca <unknown>
#1 0x5f7f567eb566 <unknown>
#2 0x5f7f56826b4c <unknown>
#3 0x5f7f568227c4 <unknown>
#4 0x5f7f56871bd3 <unknown>
#5 0x5f7f56871286 <unknown>
#6 0x5f7f56863403 <unknown>
#7 0x5f7f5682fb02 <unknown>
#8 0x5f7f568307c1 <unknown>
#9 0x5f7f56d30298 <unknown>
#10 0x5f7f56d340ff <unknown>
#11 0x5f7f56d17729 <unknown>
#12 0x5f7f56d34ca5 <unknown>
#13 0x5f7f56cfcf8f <unknown>
#14 0x5f7f56d59308 <unknown>
#15 0x5f7f56d594e3 <unknown>
#16 0x5f7f56d6b463 <unknown>
#17 0x795d74294ac3 <unknown>
2025-10-16 09:15:46 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:46 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:46 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:46 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:46 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:15:46 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:15:46 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:15:50 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:15:50 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:50 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:50 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:50 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:50 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:50 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x6108fd3b94ca <unknown>
#1 0x6108fce38566 <unknown>
#2 0x6108fce73b4c <unknown>
#3 0x6108fce6f7c4 <unknown>
#4 0x6108fcebebd3 <unknown>
#5 0x6108fcebe286 <unknown>
#6 0x6108fceb0403 <unknown>
#7 0x6108fce7cb02 <unknown>
#8 0x6108fce7d7c1 <unknown>
#9 0x6108fd37d298 <unknown>
#10 0x6108fd3810ff <unknown>
#11 0x6108fd364729 <unknown>
#12 0x6108fd381ca5 <unknown>
#13 0x6108fd349f8f <unknown>
#14 0x6108fd3a6308 <unknown>
#15 0x6108fd3a64e3 <unknown>
#16 0x6108fd3b8463 <unknown>
#17 0x7fb7e0494ac3 <unknown>
2025-10-16 09:15:50 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:50 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:50 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:50 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:51 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:51 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:51 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:51 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:51 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5620c7b464e3 <unknown>
#1 0x5620c7875c76 <unknown>
#2 0x5620c789ed78 <unknown>
#3 0x5620c789b029 <unknown>
#4 0x5620c78d9ccc <unknown>
#5 0x5620c78d947f <unknown>
#6 0x5620c78d0de3 <unknown>
#7 0x5620c78a62dd <unknown>
#8 0x5620c78a734e <unknown>
#9 0x5620c7b063e4 <unknown>
#10 0x5620c7b0a3d7 <unknown>
#11 0x5620c7b14b20 <unknown>
#12 0x5620c7b0b023 <unknown>
#13 0x5620c7ad91aa <unknown>
#14 0x5620c7b2f6b8 <unknown>
#15 0x5620c7b2f847 <unknown>
#16 0x5620c7b3f243 <unknown>
#17 0x74b23da94ac3 <unknown>
2025-10-16 09:15:51 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:51 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:51 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5af2900034ca <unknown>
#1 0x5af28fa82566 <unknown>
#2 0x5af28fabdb4c <unknown>
#3 0x5af28fab97c4 <unknown>
#4 0x5af28fb08bd3 <unknown>
#5 0x5af28fb08286 <unknown>
#6 0x5af28fafa403 <unknown>
#7 0x5af28fac6b02 <unknown>
#8 0x5af28fac77c1 <unknown>
#9 0x5af28ffc7298 <unknown>
#10 0x5af28ffcb0ff <unknown>
#11 0x5af28ffae729 <unknown>
#12 0x5af28ffcbca5 <unknown>
#13 0x5af28ff93f8f <unknown>
#14 0x5af28fff0308 <unknown>
#15 0x5af28fff04e3 <unknown>
#16 0x5af290002463 <unknown>
#17 0x719b0c894ac3 <unknown>
2025-10-16 09:15:51 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:51 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:51 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:51 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:51 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:51 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:51 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:51 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:51 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:51 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:51 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:51 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x59b42cd164ca <unknown>
#1 0x59b42c795566 <unknown>
#2 0x59b42c7d0b4c <unknown>
#3 0x59b42c7cc7c4 <unknown>
#4 0x59b42c81bbd3 <unknown>
#5 0x59b42c81b286 <unknown>
#6 0x59b42c80d403 <unknown>
#7 0x59b42c7d9b02 <unknown>
#8 0x59b42c7da7c1 <unknown>
#9 0x59b42ccda298 <unknown>
#10 0x59b42ccde0ff <unknown>
#11 0x59b42ccc1729 <unknown>
#12 0x59b42ccdeca5 <unknown>
#13 0x59b42cca6f8f <unknown>
#14 0x59b42cd03308 <unknown>
#15 0x59b42cd034e3 <unknown>
#16 0x59b42cd15463 <unknown>
#17 0x794a06494ac3 <unknown>
2025-10-16 09:15:51 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:51 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:51 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:52 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:52 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:52 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:52 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:52 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x641ce94034e3 <unknown>
#1 0x641ce9132c76 <unknown>
#2 0x641ce915bd78 <unknown>
#3 0x641ce9158029 <unknown>
#4 0x641ce9196ccc <unknown>
#5 0x641ce919647f <unknown>
#6 0x641ce918dde3 <unknown>
#7 0x641ce91632dd <unknown>
#8 0x641ce916434e <unknown>
#9 0x641ce93c33e4 <unknown>
#10 0x641ce93c73d7 <unknown>
#11 0x641ce93d1b20 <unknown>
#12 0x641ce93c8023 <unknown>
#13 0x641ce93961aa <unknown>
#14 0x641ce93ec6b8 <unknown>
#15 0x641ce93ec847 <unknown>
#16 0x641ce93fc243 <unknown>
#17 0x7d53a8a94ac3 <unknown>
2025-10-16 09:15:52 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:52 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f20dc71d4ca <unknown>
#1 0x5f20dc19c566 <unknown>
#2 0x5f20dc1d7b4c <unknown>
#3 0x5f20dc1d37c4 <unknown>
#4 0x5f20dc222bd3 <unknown>
#5 0x5f20dc222286 <unknown>
#6 0x5f20dc214403 <unknown>
#7 0x5f20dc1e0b02 <unknown>
#8 0x5f20dc1e17c1 <unknown>
#9 0x5f20dc6e1298 <unknown>
#10 0x5f20dc6e50ff <unknown>
#11 0x5f20dc6c8729 <unknown>
#12 0x5f20dc6e5ca5 <unknown>
#13 0x5f20dc6adf8f <unknown>
#14 0x5f20dc70a308 <unknown>
#15 0x5f20dc70a4e3 <unknown>
#16 0x5f20dc71c463 <unknown>
#17 0x78e6fda94ac3 <unknown>
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:15:52 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:15:52 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (2/2): WebDriver 創建失敗
2025-10-16 09:15:55 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 3/3, force_new_driver=False)
2025-10-16 09:15:55 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:15:55 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:15:55 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:15:55 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:55 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:55 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:55 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:55 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:56 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f3f7cd074ca <unknown>
#1 0x5f3f7c786566 <unknown>
#2 0x5f3f7c7c1b4c <unknown>
#3 0x5f3f7c7bd7c4 <unknown>
#4 0x5f3f7c80cbd3 <unknown>
#5 0x5f3f7c80c286 <unknown>
#6 0x5f3f7c7fe403 <unknown>
#7 0x5f3f7c7cab02 <unknown>
#8 0x5f3f7c7cb7c1 <unknown>
#9 0x5f3f7cccb298 <unknown>
#10 0x5f3f7cccf0ff <unknown>
#11 0x5f3f7ccb2729 <unknown>
#12 0x5f3f7cccfca5 <unknown>
#13 0x5f3f7cc97f8f <unknown>
#14 0x5f3f7ccf4308 <unknown>
#15 0x5f3f7ccf44e3 <unknown>
#16 0x5f3f7cd06463 <unknown>
#17 0x7458d0494ac3 <unknown>
2025-10-16 09:15:56 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:56 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:56 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:56 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:56 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:56 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:56 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 86, UID: txh355k3d2, 進度: 0/1
2025-10-16 09:15:56 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:56 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:57 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5726f38354e3 <unknown>
#1 0x5726f3564c76 <unknown>
#2 0x5726f358dd78 <unknown>
#3 0x5726f358a029 <unknown>
#4 0x5726f35c8ccc <unknown>
#5 0x5726f35c847f <unknown>
#6 0x5726f35bfde3 <unknown>
#7 0x5726f35952dd <unknown>
#8 0x5726f359634e <unknown>
#9 0x5726f37f53e4 <unknown>
#10 0x5726f37f93d7 <unknown>
#11 0x5726f3803b20 <unknown>
#12 0x5726f37fa023 <unknown>
#13 0x5726f37c81aa <unknown>
#14 0x5726f381e6b8 <unknown>
#15 0x5726f381e847 <unknown>
#16 0x5726f382e243 <unknown>
#17 0x7ae239294ac3 <unknown>
2025-10-16 09:15:57 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:57 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:57 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x6454ffc8b4ca <unknown>
#1 0x6454ff70a566 <unknown>
#2 0x6454ff745b4c <unknown>
#3 0x6454ff7417c4 <unknown>
#4 0x6454ff790bd3 <unknown>
#5 0x6454ff790286 <unknown>
#6 0x6454ff782403 <unknown>
#7 0x6454ff74eb02 <unknown>
#8 0x6454ff74f7c1 <unknown>
#9 0x6454ffc4f298 <unknown>
#10 0x6454ffc530ff <unknown>
#11 0x6454ffc36729 <unknown>
#12 0x6454ffc53ca5 <unknown>
#13 0x6454ffc1bf8f <unknown>
#14 0x6454ffc78308 <unknown>
#15 0x6454ffc784e3 <unknown>
#16 0x6454ffc8a463 <unknown>
#17 0x760021c94ac3 <unknown>
2025-10-16 09:15:57 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:57 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:57 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:57 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:57 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:57 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:15:57 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:15:57 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:15:57 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:15:57 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:15:57 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:15:57 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a3ba63f24ca <unknown>
#1 0x5a3ba5e71566 <unknown>
#2 0x5a3ba5eacb4c <unknown>
#3 0x5a3ba5ea87c4 <unknown>
#4 0x5a3ba5ef7bd3 <unknown>
#5 0x5a3ba5ef7286 <unknown>
#6 0x5a3ba5ee9403 <unknown>
#7 0x5a3ba5eb5b02 <unknown>
#8 0x5a3ba5eb67c1 <unknown>
#9 0x5a3ba63b6298 <unknown>
#10 0x5a3ba63ba0ff <unknown>
#11 0x5a3ba639d729 <unknown>
#12 0x5a3ba63baca5 <unknown>
#13 0x5a3ba6382f8f <unknown>
#14 0x5a3ba63df308 <unknown>
#15 0x5a3ba63df4e3 <unknown>
#16 0x5a3ba63f1463 <unknown>
#17 0x7e44e6694ac3 <unknown>
2025-10-16 09:15:57 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:15:57 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:15:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:57 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:15:57 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:15:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:15:58 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:15:58 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x57c4889844e3 <unknown>
#1 0x57c4886b3c76 <unknown>
#2 0x57c4886dcd78 <unknown>
#3 0x57c4886d9029 <unknown>
#4 0x57c488717ccc <unknown>
#5 0x57c48871747f <unknown>
#6 0x57c48870ede3 <unknown>
#7 0x57c4886e42dd <unknown>
#8 0x57c4886e534e <unknown>
#9 0x57c4889443e4 <unknown>
#10 0x57c4889483d7 <unknown>
#11 0x57c488952b20 <unknown>
#12 0x57c488949023 <unknown>
#13 0x57c4889171aa <unknown>
#14 0x57c48896d6b8 <unknown>
#15 0x57c48896d847 <unknown>
#16 0x57c48897d243 <unknown>
#17 0x790fdb894ac3 <unknown>
2025-10-16 09:15:58 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:15:58 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:15:58 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x6506013924ca <unknown>
#1 0x650600e11566 <unknown>
#2 0x650600e4cb4c <unknown>
#3 0x650600e487c4 <unknown>
#4 0x650600e97bd3 <unknown>
#5 0x650600e97286 <unknown>
#6 0x650600e89403 <unknown>
#7 0x650600e55b02 <unknown>
#8 0x650600e567c1 <unknown>
#9 0x650601356298 <unknown>
#10 0x65060135a0ff <unknown>
#11 0x65060133d729 <unknown>
#12 0x65060135aca5 <unknown>
#13 0x650601322f8f <unknown>
#14 0x65060137f308 <unknown>
#15 0x65060137f4e3 <unknown>
#16 0x650601391463 <unknown>
#17 0x77b54b894ac3 <unknown>
2025-10-16 09:15:58 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:15:58 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:15:58 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:15:58 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:15:58 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:15:58 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:15:58 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:16:00 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:16:00 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:16:00 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:16:00 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:16:00 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:16:00 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:16:00 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x617d0033b4ca <unknown>
#1 0x617cffdba566 <unknown>
#2 0x617cffdf5b4c <unknown>
#3 0x617cffdf17c4 <unknown>
#4 0x617cffe40bd3 <unknown>
#5 0x617cffe40286 <unknown>
#6 0x617cffe32403 <unknown>
#7 0x617cffdfeb02 <unknown>
#8 0x617cffdff7c1 <unknown>
#9 0x617d002ff298 <unknown>
#10 0x617d003030ff <unknown>
#11 0x617d002e6729 <unknown>
#12 0x617d00303ca5 <unknown>
#13 0x617d002cbf8f <unknown>
#14 0x617d00328308 <unknown>
#15 0x617d003284e3 <unknown>
#16 0x617d0033a463 <unknown>
#17 0x78a71ea94ac3 <unknown>
2025-10-16 09:16:00 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:16:00 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:16:00 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:00 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:16:00 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:16:00 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:01 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:01 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:16:01 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x569fe49ae4e3 <unknown>
#1 0x569fe46ddc76 <unknown>
#2 0x569fe4706d78 <unknown>
#3 0x569fe4703029 <unknown>
#4 0x569fe4741ccc <unknown>
#5 0x569fe474147f <unknown>
#6 0x569fe4738de3 <unknown>
#7 0x569fe470e2dd <unknown>
#8 0x569fe470f34e <unknown>
#9 0x569fe496e3e4 <unknown>
#10 0x569fe49723d7 <unknown>
#11 0x569fe497cb20 <unknown>
#12 0x569fe4973023 <unknown>
#13 0x569fe49411aa <unknown>
#14 0x569fe49976b8 <unknown>
#15 0x569fe4997847 <unknown>
#16 0x569fe49a7243 <unknown>
#17 0x7b110e894ac3 <unknown>
2025-10-16 09:16:01 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:16:01 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:16:01 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5b3c2a77b4ca <unknown>
#1 0x5b3c2a1fa566 <unknown>
#2 0x5b3c2a235b4c <unknown>
#3 0x5b3c2a2317c4 <unknown>
#4 0x5b3c2a280bd3 <unknown>
#5 0x5b3c2a280286 <unknown>
#6 0x5b3c2a272403 <unknown>
#7 0x5b3c2a23eb02 <unknown>
#8 0x5b3c2a23f7c1 <unknown>
#9 0x5b3c2a73f298 <unknown>
#10 0x5b3c2a7430ff <unknown>
#11 0x5b3c2a726729 <unknown>
#12 0x5b3c2a743ca5 <unknown>
#13 0x5b3c2a70bf8f <unknown>
#14 0x5b3c2a768308 <unknown>
#15 0x5b3c2a7684e3 <unknown>
#16 0x5b3c2a77a463 <unknown>
#17 0x7e9fc9c94ac3 <unknown>
2025-10-16 09:16:01 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:16:01 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:16:01 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:16:01 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:16:01 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:16:01 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:16:01 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:16:01 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:16:01 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:16:01 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:16:01 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:16:01 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5d3fbae064ca <unknown>
#1 0x5d3fba885566 <unknown>
#2 0x5d3fba8c0b4c <unknown>
#3 0x5d3fba8bc7c4 <unknown>
#4 0x5d3fba90bbd3 <unknown>
#5 0x5d3fba90b286 <unknown>
#6 0x5d3fba8fd403 <unknown>
#7 0x5d3fba8c9b02 <unknown>
#8 0x5d3fba8ca7c1 <unknown>
#9 0x5d3fbadca298 <unknown>
#10 0x5d3fbadce0ff <unknown>
#11 0x5d3fbadb1729 <unknown>
#12 0x5d3fbadceca5 <unknown>
#13 0x5d3fbad96f8f <unknown>
#14 0x5d3fbadf3308 <unknown>
#15 0x5d3fbadf34e3 <unknown>
#16 0x5d3fbae05463 <unknown>
#17 0x7c6613a94ac3 <unknown>
2025-10-16 09:16:01 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:16:01 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:16:01 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:01 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:16:01 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:16:01 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:02 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:02 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:16:02 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x569a20d2f4e3 <unknown>
#1 0x569a20a5ec76 <unknown>
#2 0x569a20a87d78 <unknown>
#3 0x569a20a84029 <unknown>
#4 0x569a20ac2ccc <unknown>
#5 0x569a20ac247f <unknown>
#6 0x569a20ab9de3 <unknown>
#7 0x569a20a8f2dd <unknown>
#8 0x569a20a9034e <unknown>
#9 0x569a20cef3e4 <unknown>
#10 0x569a20cf33d7 <unknown>
#11 0x569a20cfdb20 <unknown>
#12 0x569a20cf4023 <unknown>
#13 0x569a20cc21aa <unknown>
#14 0x569a20d186b8 <unknown>
#15 0x569a20d18847 <unknown>
#16 0x569a20d28243 <unknown>
#17 0x7ebef4e94ac3 <unknown>
2025-10-16 09:16:02 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:16:02 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:16:02 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5ca58eced4ca <unknown>
#1 0x5ca58e76c566 <unknown>
#2 0x5ca58e7a7b4c <unknown>
#3 0x5ca58e7a37c4 <unknown>
#4 0x5ca58e7f2bd3 <unknown>
#5 0x5ca58e7f2286 <unknown>
#6 0x5ca58e7e4403 <unknown>
#7 0x5ca58e7b0b02 <unknown>
#8 0x5ca58e7b17c1 <unknown>
#9 0x5ca58ecb1298 <unknown>
#10 0x5ca58ecb50ff <unknown>
#11 0x5ca58ec98729 <unknown>
#12 0x5ca58ecb5ca5 <unknown>
#13 0x5ca58ec7df8f <unknown>
#14 0x5ca58ecda308 <unknown>
#15 0x5ca58ecda4e3 <unknown>
#16 0x5ca58ecec463 <unknown>
#17 0x7a72dee94ac3 <unknown>
2025-10-16 09:16:02 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:16:02 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:16:02 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:16:02 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:16:02 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:16:02 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:16:02 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:16:06 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:16:06 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:16:06 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:16:06 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:16:06 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:16:06 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:16:06 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5c7018bd84ca <unknown>
#1 0x5c7018657566 <unknown>
#2 0x5c7018692b4c <unknown>
#3 0x5c701868e7c4 <unknown>
#4 0x5c70186ddbd3 <unknown>
#5 0x5c70186dd286 <unknown>
#6 0x5c70186cf403 <unknown>
#7 0x5c701869bb02 <unknown>
#8 0x5c701869c7c1 <unknown>
#9 0x5c7018b9c298 <unknown>
#10 0x5c7018ba00ff <unknown>
#11 0x5c7018b83729 <unknown>
#12 0x5c7018ba0ca5 <unknown>
#13 0x5c7018b68f8f <unknown>
#14 0x5c7018bc5308 <unknown>
#15 0x5c7018bc54e3 <unknown>
#16 0x5c7018bd7463 <unknown>
#17 0x7b193ce94ac3 <unknown>
2025-10-16 09:16:06 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:16:06 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:16:06 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:06 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 86, UID: txh355k3d2, 進度: 0/1
2025-10-16 09:16:06 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:16:07 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:16:07 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:07 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:07 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:16:07 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5b8dead224e3 <unknown>
#1 0x5b8deaa51c76 <unknown>
#2 0x5b8deaa7ad78 <unknown>
#3 0x5b8deaa77029 <unknown>
#4 0x5b8deaab5ccc <unknown>
#5 0x5b8deaab547f <unknown>
#6 0x5b8deaaacde3 <unknown>
#7 0x5b8deaa822dd <unknown>
#8 0x5b8deaa8334e <unknown>
#9 0x5b8deace23e4 <unknown>
#10 0x5b8deace63d7 <unknown>
#11 0x5b8deacf0b20 <unknown>
#12 0x5b8deace7023 <unknown>
#13 0x5b8deacb51aa <unknown>
#14 0x5b8dead0b6b8 <unknown>
#15 0x5b8dead0b847 <unknown>
#16 0x5b8dead1b243 <unknown>
#17 0x785999694ac3 <unknown>
2025-10-16 09:16:07 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:16:07 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:16:07 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5b75cd0574ca <unknown>
#1 0x5b75ccad6566 <unknown>
#2 0x5b75ccb11b4c <unknown>
#3 0x5b75ccb0d7c4 <unknown>
#4 0x5b75ccb5cbd3 <unknown>
#5 0x5b75ccb5c286 <unknown>
#6 0x5b75ccb4e403 <unknown>
#7 0x5b75ccb1ab02 <unknown>
#8 0x5b75ccb1b7c1 <unknown>
#9 0x5b75cd01b298 <unknown>
#10 0x5b75cd01f0ff <unknown>
#11 0x5b75cd002729 <unknown>
#12 0x5b75cd01fca5 <unknown>
#13 0x5b75ccfe7f8f <unknown>
#14 0x5b75cd044308 <unknown>
#15 0x5b75cd0444e3 <unknown>
#16 0x5b75cd056463 <unknown>
#17 0x72ca9e494ac3 <unknown>
2025-10-16 09:16:07 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:16:07 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:16:07 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:16:07 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:16:07 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:16:07 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:16:07 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:16:07 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:16:07 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:16:07 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:16:07 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:16:07 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x55a219fa04ca <unknown>
#1 0x55a219a1f566 <unknown>
#2 0x55a219a5ab4c <unknown>
#3 0x55a219a567c4 <unknown>
#4 0x55a219aa5bd3 <unknown>
#5 0x55a219aa5286 <unknown>
#6 0x55a219a97403 <unknown>
#7 0x55a219a63b02 <unknown>
#8 0x55a219a647c1 <unknown>
#9 0x55a219f64298 <unknown>
#10 0x55a219f680ff <unknown>
#11 0x55a219f4b729 <unknown>
#12 0x55a219f68ca5 <unknown>
#13 0x55a219f30f8f <unknown>
#14 0x55a219f8d308 <unknown>
#15 0x55a219f8d4e3 <unknown>
#16 0x55a219f9f463 <unknown>
#17 0x7d474b494ac3 <unknown>
2025-10-16 09:16:07 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:16:07 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:16:07 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:08 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:16:08 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:16:08 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:08 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:16:08 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5a6e8b66a4e3 <unknown>
#1 0x5a6e8b399c76 <unknown>
#2 0x5a6e8b3c2d78 <unknown>
#3 0x5a6e8b3bf029 <unknown>
#4 0x5a6e8b3fdccc <unknown>
#5 0x5a6e8b3fd47f <unknown>
#6 0x5a6e8b3f4de3 <unknown>
#7 0x5a6e8b3ca2dd <unknown>
#8 0x5a6e8b3cb34e <unknown>
#9 0x5a6e8b62a3e4 <unknown>
#10 0x5a6e8b62e3d7 <unknown>
#11 0x5a6e8b638b20 <unknown>
#12 0x5a6e8b62f023 <unknown>
#13 0x5a6e8b5fd1aa <unknown>
#14 0x5a6e8b6536b8 <unknown>
#15 0x5a6e8b653847 <unknown>
#16 0x5a6e8b663243 <unknown>
#17 0x780122c94ac3 <unknown>
2025-10-16 09:16:08 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:16:08 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x63fc7b43e4ca <unknown>
#1 0x63fc7aebd566 <unknown>
#2 0x63fc7aef8b4c <unknown>
#3 0x63fc7aef47c4 <unknown>
#4 0x63fc7af43bd3 <unknown>
#5 0x63fc7af43286 <unknown>
#6 0x63fc7af35403 <unknown>
#7 0x63fc7af01b02 <unknown>
#8 0x63fc7af027c1 <unknown>
#9 0x63fc7b402298 <unknown>
#10 0x63fc7b4060ff <unknown>
#11 0x63fc7b3e9729 <unknown>
#12 0x63fc7b406ca5 <unknown>
#13 0x63fc7b3cef8f <unknown>
#14 0x63fc7b42b308 <unknown>
#15 0x63fc7b42b4e3 <unknown>
#16 0x63fc7b43d463 <unknown>
#17 0x7b6c96494ac3 <unknown>
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:16:08 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:16:08 - ERROR - main - [url_processor.py:123] - process_url - 達到最大重試次數,放棄獲取 URL: https://www.twitch.tv/iamruru
2025-10-16 09:16:08 - ERROR - main - [url_processor.py:640] - process_url - 處理 URL 時發生未預期錯誤: WebDriver 創建失敗
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/processing/url_processor.py", line 98, in process_url
html_content, title, final_url = web_scraper.get_content(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:16:08 - INFO - database - [database.py:505] - update_url_status - URL ID 86 状态已更新为 error
2025-10-16 09:16:08 - INFO - main - [url_processor.py:653] - process_url - 工作線程 #1 完成處理 URL ID: 86
2025-10-16 09:16:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:16:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.6MB, CPU 0.0%
2025-10-16 09:16:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.4MB, CPU 0.0%
2025-10-16 09:16:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:16:16 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 86, UID: txh355k3d2, 進度: 0/1
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:16:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:17:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:17:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:17:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:17:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:17:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:17:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:17:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:17:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:17:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:17:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.6MB, CPU 0.0%
2025-10-16 09:17:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:17:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.15 秒,結果: 0
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.15 秒,結果: 0
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.16 秒,結果: 0
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:18:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.06 秒,結果: 0
2025-10-16 09:19:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:19:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.6MB, CPU 0.0%
2025-10-16 09:19:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:19:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:19:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:20:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:20:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:20:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:20:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:20:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:20:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:20:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:20:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:20:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:20:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.6MB, CPU 0.0%
2025-10-16 09:20:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:20:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:21:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:21:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:21:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:21:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:21:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:21:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:21:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:21:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:22:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:22:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:22:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.6MB, CPU 0.0%
2025-10-16 09:22:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:22:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.10 秒,結果: 0
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.10 秒,結果: 0
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.11 秒,結果: 0
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:23:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:23:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.06 秒,結果: 0
2025-10-16 09:23:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:23:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:23:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:23:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:24:11 - ERROR - main - [main.py:200] - handle_api_exception - 網頁錯誤 [/]: 405 Method Not Allowed: The method is not allowed for the requested URL.
Traceback (most recent call last):
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/flask/app.py", line 917, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/flask/app.py", line 891, in dispatch_request
self.raise_routing_exception(req)
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/flask/app.py", line 500, in raise_routing_exception
raise request.routing_exception # type: ignore[misc]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/flask/ctx.py", line 362, in match_request
result = self.url_adapter.match(return_rule=True) # type: ignore
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/werkzeug/routing/map.py", line 624, in match
raise MethodNotAllowed(valid_methods=list(e.have_match_for)) from None
werkzeug.exceptions.MethodNotAllowed: 405 Method Not Allowed: The method is not allowed for the requested URL.
2025-10-16 09:24:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:24:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:24:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:24:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:24:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:24:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:24:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:24:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:25:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:25:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:25:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:25:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:25:18 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:25:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:25:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:25:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:25:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:26:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:26:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:26:18 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:26:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:26:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:26:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:26:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:26:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:26:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:26:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:26:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:26:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:27:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:27:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:27:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:27:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:27:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:27:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:27:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:27:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:28:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:28:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:28:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:28:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.09 秒,結果: 0
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.09 秒,結果: 0
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.10 秒,結果: 0
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.05 秒,結果: 0
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:28:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:29:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:29:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:29:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:29:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:29:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:29:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:29:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:29:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:29:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:29:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:29:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:29:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:30:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:30:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:30:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:30:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:30:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:30:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:30:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:30:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:31:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:31:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:31:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:31:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:31:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:32:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:32:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:32:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:32:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:32:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:32:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:32:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:32:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:32:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:32:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:32:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:32:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.11 秒,結果: 0
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.11 秒,結果: 0
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.11 秒,結果: 0
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:33:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.08 秒,結果: 0
2025-10-16 09:34:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:34:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:34:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:34:16 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:34:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:35:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:35:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:35:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:35:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:35:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:35:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:35:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:35:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:35:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.9MB, CPU 0.0%
2025-10-16 09:35:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 152.5MB, CPU 0.0%
2025-10-16 09:35:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 151.7MB, CPU 0.0%
2025-10-16 09:35:46 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 153.7MB, CPU 0.0%
2025-10-16 09:36:15 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:36:15 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:36:15 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:36:15 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:36:15 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:36:15 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:36:15 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:36:15 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:36:15 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:36:15 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:36:15 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:36:15 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:36:18 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:36:18 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:36:18 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:36:18 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:36:18 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:36:18 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.80GB
2025-10-16 09:36:18 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:36:18 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:36:18 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:36:18 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:36:18 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:36:18 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:36:18 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:36:18 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:36:18 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:36:18 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:36:18 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:36:18 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:36:18 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:36:18 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:36:18 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:36:18 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:36:18 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:36:18 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:36:18 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:36:18 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:36:18 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.79GB
2025-10-16 09:36:18 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:36:18 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:36:18 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:36:18 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:36:18 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:36:18 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:36:18 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.79GB
2025-10-16 09:36:18 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.79GB
2025-10-16 09:36:18 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:36:18 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:36:18 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:36:18 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:36:18 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:36:18 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:36:18 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:36:18 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:36:18 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:36:18 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:36:18 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:36:18 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:36:18 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:36:18 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:36:18 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:36:18 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:36:18 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:36:18 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:36:18 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:36:18 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:36:18 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:36:18 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:36:18 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:36:18 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:36:18 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:36:18 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:36:18 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:36:18 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:36:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:37:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:37:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:37:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:37:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:37:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:37:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:37:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:37:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:37:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.5MB, CPU 0.0%
2025-10-16 09:37:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:37:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.3MB, CPU 0.0%
2025-10-16 09:37:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 120.6MB, CPU 0.0%
2025-10-16 09:38:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:38:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.05 秒,結果: 0
2025-10-16 09:38:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:38:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:38:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:38:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:38:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:38:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:39:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.5MB, CPU 0.0%
2025-10-16 09:39:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:39:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.4MB, CPU 0.0%
2025-10-16 09:39:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.4MB, CPU 0.0%
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:39:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:39:58 - INFO - database - [database.py:420] - process_url - UI 提交生成 UID: n2zooj3cx0
2025-10-16 09:39:58 - INFO - database - [database.py:426] - process_url - UI 提交 URL https://www.twitch.tv/iamruru,結果將立即顯示
2025-10-16 09:39:58 - INFO - database - [database.py:436] - process_url - URL https://www.twitch.tv/iamruru 已存在,但按照需求視為新提交進行審核
2025-10-16 09:39:58 - INFO - main - [web_routes.py:115] - submit_url - UI 提交,URL ID: 87, Phone: , Email: chengruwu0322@gmail.com
2025-10-16 09:39:58 - INFO - database - [database.py:536] - get_pending_url - 找到待处理的 URL: ID=87, URL=https://www.twitch.tv/iamruru
2025-10-16 09:39:58 - INFO - main - [request_processor.py:690] - process_pending_urls - 已添加 1 個 URL 到處理隊列
2025-10-16 09:39:58 - INFO - main - [url_processor.py:42] - process_url - 工作線程 #1 開始處理 URL ID: 87
2025-10-16 09:39:58 - INFO - main - [url_processor.py:83] - process_url - 分析 URL: https://www.twitch.tv/iamruru
2025-10-16 09:39:58 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 1/3, force_new_driver=False)
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:39:58 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x62af0c8e84ca <unknown>
#1 0x62af0c367566 <unknown>
#2 0x62af0c3a2b4c <unknown>
#3 0x62af0c39e7c4 <unknown>
#4 0x62af0c3edbd3 <unknown>
#5 0x62af0c3ed286 <unknown>
#6 0x62af0c3df403 <unknown>
#7 0x62af0c3abb02 <unknown>
#8 0x62af0c3ac7c1 <unknown>
#9 0x62af0c8ac298 <unknown>
#10 0x62af0c8b00ff <unknown>
#11 0x62af0c893729 <unknown>
#12 0x62af0c8b0ca5 <unknown>
#13 0x62af0c878f8f <unknown>
#14 0x62af0c8d5308 <unknown>
#15 0x62af0c8d54e3 <unknown>
#16 0x62af0c8e7463 <unknown>
#17 0x7a6fe6894ac3 <unknown>
2025-10-16 09:39:58 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:39:58 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:39:58 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:39:59 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 87, UID: n2zooj3cx0, 進度: 0/1
2025-10-16 09:40:02 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:02 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:02 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:03 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:03 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:03 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x601d76ddb4e3 <unknown>
#1 0x601d76b0ac76 <unknown>
#2 0x601d76b33d78 <unknown>
#3 0x601d76b30029 <unknown>
#4 0x601d76b6eccc <unknown>
#5 0x601d76b6e47f <unknown>
#6 0x601d76b65de3 <unknown>
#7 0x601d76b3b2dd <unknown>
#8 0x601d76b3c34e <unknown>
#9 0x601d76d9b3e4 <unknown>
#10 0x601d76d9f3d7 <unknown>
#11 0x601d76da9b20 <unknown>
#12 0x601d76da0023 <unknown>
#13 0x601d76d6e1aa <unknown>
#14 0x601d76dc46b8 <unknown>
#15 0x601d76dc4847 <unknown>
#16 0x601d76dd4243 <unknown>
#17 0x7f308e894ac3 <unknown>
2025-10-16 09:40:03 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:03 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:03 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58a17dbd84ca <unknown>
#1 0x58a17d657566 <unknown>
#2 0x58a17d692b4c <unknown>
#3 0x58a17d68e7c4 <unknown>
#4 0x58a17d6ddbd3 <unknown>
#5 0x58a17d6dd286 <unknown>
#6 0x58a17d6cf403 <unknown>
#7 0x58a17d69bb02 <unknown>
#8 0x58a17d69c7c1 <unknown>
#9 0x58a17db9c298 <unknown>
#10 0x58a17dba00ff <unknown>
#11 0x58a17db83729 <unknown>
#12 0x58a17dba0ca5 <unknown>
#13 0x58a17db68f8f <unknown>
#14 0x58a17dbc5308 <unknown>
#15 0x58a17dbc54e3 <unknown>
#16 0x58a17dbd7463 <unknown>
#17 0x76bd14094ac3 <unknown>
2025-10-16 09:40:03 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:03 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:03 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:03 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:03 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:03 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:03 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:03 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:03 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:03 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:03 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:03 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x57e8183514ca <unknown>
#1 0x57e817dd0566 <unknown>
#2 0x57e817e0bb4c <unknown>
#3 0x57e817e077c4 <unknown>
#4 0x57e817e56bd3 <unknown>
#5 0x57e817e56286 <unknown>
#6 0x57e817e48403 <unknown>
#7 0x57e817e14b02 <unknown>
#8 0x57e817e157c1 <unknown>
#9 0x57e818315298 <unknown>
#10 0x57e8183190ff <unknown>
#11 0x57e8182fc729 <unknown>
#12 0x57e818319ca5 <unknown>
#13 0x57e8182e1f8f <unknown>
#14 0x57e81833e308 <unknown>
#15 0x57e81833e4e3 <unknown>
#16 0x57e818350463 <unknown>
#17 0x7ff3cee94ac3 <unknown>
2025-10-16 09:40:03 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:03 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:03 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:03 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:03 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:04 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:04 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:04 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:04 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x58b062dff4e3 <unknown>
#1 0x58b062b2ec76 <unknown>
#2 0x58b062b57d78 <unknown>
#3 0x58b062b54029 <unknown>
#4 0x58b062b92ccc <unknown>
#5 0x58b062b9247f <unknown>
#6 0x58b062b89de3 <unknown>
#7 0x58b062b5f2dd <unknown>
#8 0x58b062b6034e <unknown>
#9 0x58b062dbf3e4 <unknown>
#10 0x58b062dc33d7 <unknown>
#11 0x58b062dcdb20 <unknown>
#12 0x58b062dc4023 <unknown>
#13 0x58b062d921aa <unknown>
#14 0x58b062de86b8 <unknown>
#15 0x58b062de8847 <unknown>
#16 0x58b062df8243 <unknown>
#17 0x774855494ac3 <unknown>
2025-10-16 09:40:04 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:04 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:04 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x624bf67c04ca <unknown>
#1 0x624bf623f566 <unknown>
#2 0x624bf627ab4c <unknown>
#3 0x624bf62767c4 <unknown>
#4 0x624bf62c5bd3 <unknown>
#5 0x624bf62c5286 <unknown>
#6 0x624bf62b7403 <unknown>
#7 0x624bf6283b02 <unknown>
#8 0x624bf62847c1 <unknown>
#9 0x624bf6784298 <unknown>
#10 0x624bf67880ff <unknown>
#11 0x624bf676b729 <unknown>
#12 0x624bf6788ca5 <unknown>
#13 0x624bf6750f8f <unknown>
#14 0x624bf67ad308 <unknown>
#15 0x624bf67ad4e3 <unknown>
#16 0x624bf67bf463 <unknown>
#17 0x784713c94ac3 <unknown>
2025-10-16 09:40:04 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:04 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:04 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:04 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:04 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:04 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:04 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:40:06 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:40:06 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:06 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:06 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:06 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:06 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:06 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x62131c7bb4ca <unknown>
#1 0x62131c23a566 <unknown>
#2 0x62131c275b4c <unknown>
#3 0x62131c2717c4 <unknown>
#4 0x62131c2c0bd3 <unknown>
#5 0x62131c2c0286 <unknown>
#6 0x62131c2b2403 <unknown>
#7 0x62131c27eb02 <unknown>
#8 0x62131c27f7c1 <unknown>
#9 0x62131c77f298 <unknown>
#10 0x62131c7830ff <unknown>
#11 0x62131c766729 <unknown>
#12 0x62131c783ca5 <unknown>
#13 0x62131c74bf8f <unknown>
#14 0x62131c7a8308 <unknown>
#15 0x62131c7a84e3 <unknown>
#16 0x62131c7ba463 <unknown>
#17 0x7e9b66e94ac3 <unknown>
2025-10-16 09:40:06 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:06 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:06 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:06 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:07 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:07 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:07 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:07 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:07 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5e1c2aa544e3 <unknown>
#1 0x5e1c2a783c76 <unknown>
#2 0x5e1c2a7acd78 <unknown>
#3 0x5e1c2a7a9029 <unknown>
#4 0x5e1c2a7e7ccc <unknown>
#5 0x5e1c2a7e747f <unknown>
#6 0x5e1c2a7dede3 <unknown>
#7 0x5e1c2a7b42dd <unknown>
#8 0x5e1c2a7b534e <unknown>
#9 0x5e1c2aa143e4 <unknown>
#10 0x5e1c2aa183d7 <unknown>
#11 0x5e1c2aa22b20 <unknown>
#12 0x5e1c2aa19023 <unknown>
#13 0x5e1c2a9e71aa <unknown>
#14 0x5e1c2aa3d6b8 <unknown>
#15 0x5e1c2aa3d847 <unknown>
#16 0x5e1c2aa4d243 <unknown>
#17 0x72264ea94ac3 <unknown>
2025-10-16 09:40:07 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:07 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:07 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58c7c37d74ca <unknown>
#1 0x58c7c3256566 <unknown>
#2 0x58c7c3291b4c <unknown>
#3 0x58c7c328d7c4 <unknown>
#4 0x58c7c32dcbd3 <unknown>
#5 0x58c7c32dc286 <unknown>
#6 0x58c7c32ce403 <unknown>
#7 0x58c7c329ab02 <unknown>
#8 0x58c7c329b7c1 <unknown>
#9 0x58c7c379b298 <unknown>
#10 0x58c7c379f0ff <unknown>
#11 0x58c7c3782729 <unknown>
#12 0x58c7c379fca5 <unknown>
#13 0x58c7c3767f8f <unknown>
#14 0x58c7c37c4308 <unknown>
#15 0x58c7c37c44e3 <unknown>
#16 0x58c7c37d6463 <unknown>
#17 0x7d4802494ac3 <unknown>
2025-10-16 09:40:07 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:07 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:07 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:07 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:07 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:07 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:07 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:07 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:07 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:07 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:07 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:07 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x56e0d6e2b4ca <unknown>
#1 0x56e0d68aa566 <unknown>
#2 0x56e0d68e5b4c <unknown>
#3 0x56e0d68e17c4 <unknown>
#4 0x56e0d6930bd3 <unknown>
#5 0x56e0d6930286 <unknown>
#6 0x56e0d6922403 <unknown>
#7 0x56e0d68eeb02 <unknown>
#8 0x56e0d68ef7c1 <unknown>
#9 0x56e0d6def298 <unknown>
#10 0x56e0d6df30ff <unknown>
#11 0x56e0d6dd6729 <unknown>
#12 0x56e0d6df3ca5 <unknown>
#13 0x56e0d6dbbf8f <unknown>
#14 0x56e0d6e18308 <unknown>
#15 0x56e0d6e184e3 <unknown>
#16 0x56e0d6e2a463 <unknown>
#17 0x76351d294ac3 <unknown>
2025-10-16 09:40:07 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:07 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:07 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:08 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:08 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:08 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:08 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:08 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:08 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5e7b3570a4e3 <unknown>
#1 0x5e7b35439c76 <unknown>
#2 0x5e7b35462d78 <unknown>
#3 0x5e7b3545f029 <unknown>
#4 0x5e7b3549dccc <unknown>
#5 0x5e7b3549d47f <unknown>
#6 0x5e7b35494de3 <unknown>
#7 0x5e7b3546a2dd <unknown>
#8 0x5e7b3546b34e <unknown>
#9 0x5e7b356ca3e4 <unknown>
#10 0x5e7b356ce3d7 <unknown>
#11 0x5e7b356d8b20 <unknown>
#12 0x5e7b356cf023 <unknown>
#13 0x5e7b3569d1aa <unknown>
#14 0x5e7b356f36b8 <unknown>
#15 0x5e7b356f3847 <unknown>
#16 0x5e7b35703243 <unknown>
#17 0x7426a3494ac3 <unknown>
2025-10-16 09:40:08 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:08 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:08 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x55f020b5c4ca <unknown>
#1 0x55f0205db566 <unknown>
#2 0x55f020616b4c <unknown>
#3 0x55f0206127c4 <unknown>
#4 0x55f020661bd3 <unknown>
#5 0x55f020661286 <unknown>
#6 0x55f020653403 <unknown>
#7 0x55f02061fb02 <unknown>
#8 0x55f0206207c1 <unknown>
#9 0x55f020b20298 <unknown>
#10 0x55f020b240ff <unknown>
#11 0x55f020b07729 <unknown>
#12 0x55f020b24ca5 <unknown>
#13 0x55f020aecf8f <unknown>
#14 0x55f020b49308 <unknown>
#15 0x55f020b494e3 <unknown>
#16 0x55f020b5b463 <unknown>
#17 0x74272fe94ac3 <unknown>
2025-10-16 09:40:08 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:08 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:08 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:08 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:08 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:08 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:08 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:40:09 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 87, UID: n2zooj3cx0, 進度: 0/1
2025-10-16 09:40:12 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:40:12 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:12 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:12 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:12 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:12 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:12 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58fd7a9764ca <unknown>
#1 0x58fd7a3f5566 <unknown>
#2 0x58fd7a430b4c <unknown>
#3 0x58fd7a42c7c4 <unknown>
#4 0x58fd7a47bbd3 <unknown>
#5 0x58fd7a47b286 <unknown>
#6 0x58fd7a46d403 <unknown>
#7 0x58fd7a439b02 <unknown>
#8 0x58fd7a43a7c1 <unknown>
#9 0x58fd7a93a298 <unknown>
#10 0x58fd7a93e0ff <unknown>
#11 0x58fd7a921729 <unknown>
#12 0x58fd7a93eca5 <unknown>
#13 0x58fd7a906f8f <unknown>
#14 0x58fd7a963308 <unknown>
#15 0x58fd7a9634e3 <unknown>
#16 0x58fd7a975463 <unknown>
#17 0x71d40e494ac3 <unknown>
2025-10-16 09:40:12 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:12 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:13 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:13 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:13 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:13 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:13 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:13 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:13 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5b13450484e3 <unknown>
#1 0x5b1344d77c76 <unknown>
#2 0x5b1344da0d78 <unknown>
#3 0x5b1344d9d029 <unknown>
#4 0x5b1344ddbccc <unknown>
#5 0x5b1344ddb47f <unknown>
#6 0x5b1344dd2de3 <unknown>
#7 0x5b1344da82dd <unknown>
#8 0x5b1344da934e <unknown>
#9 0x5b13450083e4 <unknown>
#10 0x5b134500c3d7 <unknown>
#11 0x5b1345016b20 <unknown>
#12 0x5b134500d023 <unknown>
#13 0x5b1344fdb1aa <unknown>
#14 0x5b13450316b8 <unknown>
#15 0x5b1345031847 <unknown>
#16 0x5b1345041243 <unknown>
#17 0x78ab94e94ac3 <unknown>
2025-10-16 09:40:13 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:13 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:14 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x63bdd42f14ca <unknown>
#1 0x63bdd3d70566 <unknown>
#2 0x63bdd3dabb4c <unknown>
#3 0x63bdd3da77c4 <unknown>
#4 0x63bdd3df6bd3 <unknown>
#5 0x63bdd3df6286 <unknown>
#6 0x63bdd3de8403 <unknown>
#7 0x63bdd3db4b02 <unknown>
#8 0x63bdd3db57c1 <unknown>
#9 0x63bdd42b5298 <unknown>
#10 0x63bdd42b90ff <unknown>
#11 0x63bdd429c729 <unknown>
#12 0x63bdd42b9ca5 <unknown>
#13 0x63bdd4281f8f <unknown>
#14 0x63bdd42de308 <unknown>
#15 0x63bdd42de4e3 <unknown>
#16 0x63bdd42f0463 <unknown>
#17 0x7038d2494ac3 <unknown>
2025-10-16 09:40:14 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:14 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:14 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:14 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:14 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:14 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:14 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:14 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:14 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:14 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:14 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:14 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5d61de2e44ca <unknown>
#1 0x5d61ddd63566 <unknown>
#2 0x5d61ddd9eb4c <unknown>
#3 0x5d61ddd9a7c4 <unknown>
#4 0x5d61ddde9bd3 <unknown>
#5 0x5d61ddde9286 <unknown>
#6 0x5d61ddddb403 <unknown>
#7 0x5d61ddda7b02 <unknown>
#8 0x5d61ddda87c1 <unknown>
#9 0x5d61de2a8298 <unknown>
#10 0x5d61de2ac0ff <unknown>
#11 0x5d61de28f729 <unknown>
#12 0x5d61de2acca5 <unknown>
#13 0x5d61de274f8f <unknown>
#14 0x5d61de2d1308 <unknown>
#15 0x5d61de2d14e3 <unknown>
#16 0x5d61de2e3463 <unknown>
#17 0x7e842bc94ac3 <unknown>
2025-10-16 09:40:14 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:14 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:14 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:14 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:14 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:14 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:14 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:14 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x57699653c4e3 <unknown>
#1 0x57699626bc76 <unknown>
#2 0x576996294d78 <unknown>
#3 0x576996291029 <unknown>
#4 0x5769962cfccc <unknown>
#5 0x5769962cf47f <unknown>
#6 0x5769962c6de3 <unknown>
#7 0x57699629c2dd <unknown>
#8 0x57699629d34e <unknown>
#9 0x5769964fc3e4 <unknown>
#10 0x5769965003d7 <unknown>
#11 0x57699650ab20 <unknown>
#12 0x576996501023 <unknown>
#13 0x5769964cf1aa <unknown>
#14 0x5769965256b8 <unknown>
#15 0x576996525847 <unknown>
#16 0x576996535243 <unknown>
#17 0x7fa5e4a94ac3 <unknown>
2025-10-16 09:40:15 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:15 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x60bad65ff4ca <unknown>
#1 0x60bad607e566 <unknown>
#2 0x60bad60b9b4c <unknown>
#3 0x60bad60b57c4 <unknown>
#4 0x60bad6104bd3 <unknown>
#5 0x60bad6104286 <unknown>
#6 0x60bad60f6403 <unknown>
#7 0x60bad60c2b02 <unknown>
#8 0x60bad60c37c1 <unknown>
#9 0x60bad65c3298 <unknown>
#10 0x60bad65c70ff <unknown>
#11 0x60bad65aa729 <unknown>
#12 0x60bad65c7ca5 <unknown>
#13 0x60bad658ff8f <unknown>
#14 0x60bad65ec308 <unknown>
#15 0x60bad65ec4e3 <unknown>
#16 0x60bad65fe463 <unknown>
#17 0x7c81f1e94ac3 <unknown>
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:15 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:40:15 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (1/2): WebDriver 創建失敗
2025-10-16 09:40:18 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 2/3, force_new_driver=False)
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:18 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5b31c811d4ca <unknown>
#1 0x5b31c7b9c566 <unknown>
#2 0x5b31c7bd7b4c <unknown>
#3 0x5b31c7bd37c4 <unknown>
#4 0x5b31c7c22bd3 <unknown>
#5 0x5b31c7c22286 <unknown>
#6 0x5b31c7c14403 <unknown>
#7 0x5b31c7be0b02 <unknown>
#8 0x5b31c7be17c1 <unknown>
#9 0x5b31c80e1298 <unknown>
#10 0x5b31c80e50ff <unknown>
#11 0x5b31c80c8729 <unknown>
#12 0x5b31c80e5ca5 <unknown>
#13 0x5b31c80adf8f <unknown>
#14 0x5b31c810a308 <unknown>
#15 0x5b31c810a4e3 <unknown>
#16 0x5b31c811c463 <unknown>
#17 0x712f1b894ac3 <unknown>
2025-10-16 09:40:18 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:18 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:18 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:18 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:18 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:18 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:18 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:19 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:19 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5928f41b04e3 <unknown>
#1 0x5928f3edfc76 <unknown>
#2 0x5928f3f08d78 <unknown>
#3 0x5928f3f05029 <unknown>
#4 0x5928f3f43ccc <unknown>
#5 0x5928f3f4347f <unknown>
#6 0x5928f3f3ade3 <unknown>
#7 0x5928f3f102dd <unknown>
#8 0x5928f3f1134e <unknown>
#9 0x5928f41703e4 <unknown>
#10 0x5928f41743d7 <unknown>
#11 0x5928f417eb20 <unknown>
#12 0x5928f4175023 <unknown>
#13 0x5928f41431aa <unknown>
#14 0x5928f41996b8 <unknown>
#15 0x5928f4199847 <unknown>
#16 0x5928f41a9243 <unknown>
#17 0x7c752fa94ac3 <unknown>
2025-10-16 09:40:19 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:19 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:19 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5be29379b4ca <unknown>
#1 0x5be29321a566 <unknown>
#2 0x5be293255b4c <unknown>
#3 0x5be2932517c4 <unknown>
#4 0x5be2932a0bd3 <unknown>
#5 0x5be2932a0286 <unknown>
#6 0x5be293292403 <unknown>
#7 0x5be29325eb02 <unknown>
#8 0x5be29325f7c1 <unknown>
#9 0x5be29375f298 <unknown>
#10 0x5be2937630ff <unknown>
#11 0x5be293746729 <unknown>
#12 0x5be293763ca5 <unknown>
#13 0x5be29372bf8f <unknown>
#14 0x5be293788308 <unknown>
#15 0x5be2937884e3 <unknown>
#16 0x5be29379a463 <unknown>
#17 0x777fa8494ac3 <unknown>
2025-10-16 09:40:19 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:19 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:19 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:19 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:19 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:19 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:19 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:19 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:19 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:19 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:19 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:19 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5590477884ca <unknown>
#1 0x559047207566 <unknown>
#2 0x559047242b4c <unknown>
#3 0x55904723e7c4 <unknown>
#4 0x55904728dbd3 <unknown>
#5 0x55904728d286 <unknown>
#6 0x55904727f403 <unknown>
#7 0x55904724bb02 <unknown>
#8 0x55904724c7c1 <unknown>
#9 0x55904774c298 <unknown>
#10 0x5590477500ff <unknown>
#11 0x559047733729 <unknown>
#12 0x559047750ca5 <unknown>
#13 0x559047718f8f <unknown>
#14 0x559047775308 <unknown>
#15 0x5590477754e3 <unknown>
#16 0x559047787463 <unknown>
#17 0x7c4d96c94ac3 <unknown>
2025-10-16 09:40:19 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:19 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:19 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:19 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:19 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:40:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:40:19 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:40:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:40:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:40:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:40:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:40:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:40:20 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:20 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 87, UID: n2zooj3cx0, 進度: 0/1
2025-10-16 09:40:20 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:20 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5598b188c4e3 <unknown>
#1 0x5598b15bbc76 <unknown>
#2 0x5598b15e4d78 <unknown>
#3 0x5598b15e1029 <unknown>
#4 0x5598b161fccc <unknown>
#5 0x5598b161f47f <unknown>
#6 0x5598b1616de3 <unknown>
#7 0x5598b15ec2dd <unknown>
#8 0x5598b15ed34e <unknown>
#9 0x5598b184c3e4 <unknown>
#10 0x5598b18503d7 <unknown>
#11 0x5598b185ab20 <unknown>
#12 0x5598b1851023 <unknown>
#13 0x5598b181f1aa <unknown>
#14 0x5598b18756b8 <unknown>
#15 0x5598b1875847 <unknown>
#16 0x5598b1885243 <unknown>
#17 0x70a262894ac3 <unknown>
2025-10-16 09:40:20 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:20 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:20 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f992e94b4ca <unknown>
#1 0x5f992e3ca566 <unknown>
#2 0x5f992e405b4c <unknown>
#3 0x5f992e4017c4 <unknown>
#4 0x5f992e450bd3 <unknown>
#5 0x5f992e450286 <unknown>
#6 0x5f992e442403 <unknown>
#7 0x5f992e40eb02 <unknown>
#8 0x5f992e40f7c1 <unknown>
#9 0x5f992e90f298 <unknown>
#10 0x5f992e9130ff <unknown>
#11 0x5f992e8f6729 <unknown>
#12 0x5f992e913ca5 <unknown>
#13 0x5f992e8dbf8f <unknown>
#14 0x5f992e938308 <unknown>
#15 0x5f992e9384e3 <unknown>
#16 0x5f992e94a463 <unknown>
#17 0x705a05a94ac3 <unknown>
2025-10-16 09:40:20 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:20 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:20 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:20 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:20 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:20 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:20 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:40:22 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:40:22 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:22 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:22 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:22 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:22 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:22 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x57c81a80f4ca <unknown>
#1 0x57c81a28e566 <unknown>
#2 0x57c81a2c9b4c <unknown>
#3 0x57c81a2c57c4 <unknown>
#4 0x57c81a314bd3 <unknown>
#5 0x57c81a314286 <unknown>
#6 0x57c81a306403 <unknown>
#7 0x57c81a2d2b02 <unknown>
#8 0x57c81a2d37c1 <unknown>
#9 0x57c81a7d3298 <unknown>
#10 0x57c81a7d70ff <unknown>
#11 0x57c81a7ba729 <unknown>
#12 0x57c81a7d7ca5 <unknown>
#13 0x57c81a79ff8f <unknown>
#14 0x57c81a7fc308 <unknown>
#15 0x57c81a7fc4e3 <unknown>
#16 0x57c81a80e463 <unknown>
#17 0x7ad736894ac3 <unknown>
2025-10-16 09:40:22 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:22 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:22 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:22 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:22 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:22 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:23 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:23 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:23 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5dced7d804e3 <unknown>
#1 0x5dced7aafc76 <unknown>
#2 0x5dced7ad8d78 <unknown>
#3 0x5dced7ad5029 <unknown>
#4 0x5dced7b13ccc <unknown>
#5 0x5dced7b1347f <unknown>
#6 0x5dced7b0ade3 <unknown>
#7 0x5dced7ae02dd <unknown>
#8 0x5dced7ae134e <unknown>
#9 0x5dced7d403e4 <unknown>
#10 0x5dced7d443d7 <unknown>
#11 0x5dced7d4eb20 <unknown>
#12 0x5dced7d45023 <unknown>
#13 0x5dced7d131aa <unknown>
#14 0x5dced7d696b8 <unknown>
#15 0x5dced7d69847 <unknown>
#16 0x5dced7d79243 <unknown>
#17 0x7d9e12e94ac3 <unknown>
2025-10-16 09:40:23 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:23 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:23 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5845337f24ca <unknown>
#1 0x584533271566 <unknown>
#2 0x5845332acb4c <unknown>
#3 0x5845332a87c4 <unknown>
#4 0x5845332f7bd3 <unknown>
#5 0x5845332f7286 <unknown>
#6 0x5845332e9403 <unknown>
#7 0x5845332b5b02 <unknown>
#8 0x5845332b67c1 <unknown>
#9 0x5845337b6298 <unknown>
#10 0x5845337ba0ff <unknown>
#11 0x58453379d729 <unknown>
#12 0x5845337baca5 <unknown>
#13 0x584533782f8f <unknown>
#14 0x5845337df308 <unknown>
#15 0x5845337df4e3 <unknown>
#16 0x5845337f1463 <unknown>
#17 0x77efd7a94ac3 <unknown>
2025-10-16 09:40:23 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:23 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:23 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:23 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:23 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:23 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:23 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:23 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:23 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:23 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:23 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:23 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5e16426874ca <unknown>
#1 0x5e1642106566 <unknown>
#2 0x5e1642141b4c <unknown>
#3 0x5e164213d7c4 <unknown>
#4 0x5e164218cbd3 <unknown>
#5 0x5e164218c286 <unknown>
#6 0x5e164217e403 <unknown>
#7 0x5e164214ab02 <unknown>
#8 0x5e164214b7c1 <unknown>
#9 0x5e164264b298 <unknown>
#10 0x5e164264f0ff <unknown>
#11 0x5e1642632729 <unknown>
#12 0x5e164264fca5 <unknown>
#13 0x5e1642617f8f <unknown>
#14 0x5e1642674308 <unknown>
#15 0x5e16426744e3 <unknown>
#16 0x5e1642686463 <unknown>
#17 0x7dd53b494ac3 <unknown>
2025-10-16 09:40:23 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:23 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:23 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:23 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:23 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:24 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:24 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x562f02e904e3 <unknown>
#1 0x562f02bbfc76 <unknown>
#2 0x562f02be8d78 <unknown>
#3 0x562f02be5029 <unknown>
#4 0x562f02c23ccc <unknown>
#5 0x562f02c2347f <unknown>
#6 0x562f02c1ade3 <unknown>
#7 0x562f02bf02dd <unknown>
#8 0x562f02bf134e <unknown>
#9 0x562f02e503e4 <unknown>
#10 0x562f02e543d7 <unknown>
#11 0x562f02e5eb20 <unknown>
#12 0x562f02e55023 <unknown>
#13 0x562f02e231aa <unknown>
#14 0x562f02e796b8 <unknown>
#15 0x562f02e79847 <unknown>
#16 0x562f02e89243 <unknown>
#17 0x76666f494ac3 <unknown>
2025-10-16 09:40:24 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:24 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:24 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x55e5eebc54ca <unknown>
#1 0x55e5ee644566 <unknown>
#2 0x55e5ee67fb4c <unknown>
#3 0x55e5ee67b7c4 <unknown>
#4 0x55e5ee6cabd3 <unknown>
#5 0x55e5ee6ca286 <unknown>
#6 0x55e5ee6bc403 <unknown>
#7 0x55e5ee688b02 <unknown>
#8 0x55e5ee6897c1 <unknown>
#9 0x55e5eeb89298 <unknown>
#10 0x55e5eeb8d0ff <unknown>
#11 0x55e5eeb70729 <unknown>
#12 0x55e5eeb8dca5 <unknown>
#13 0x55e5eeb55f8f <unknown>
#14 0x55e5eebb2308 <unknown>
#15 0x55e5eebb24e3 <unknown>
#16 0x55e5eebc4463 <unknown>
#17 0x700283694ac3 <unknown>
2025-10-16 09:40:24 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:24 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:24 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:24 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:24 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:24 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:24 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:40:28 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:40:28 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:28 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:28 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:28 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:28 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:28 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5601f2a9a4ca <unknown>
#1 0x5601f2519566 <unknown>
#2 0x5601f2554b4c <unknown>
#3 0x5601f25507c4 <unknown>
#4 0x5601f259fbd3 <unknown>
#5 0x5601f259f286 <unknown>
#6 0x5601f2591403 <unknown>
#7 0x5601f255db02 <unknown>
#8 0x5601f255e7c1 <unknown>
#9 0x5601f2a5e298 <unknown>
#10 0x5601f2a620ff <unknown>
#11 0x5601f2a45729 <unknown>
#12 0x5601f2a62ca5 <unknown>
#13 0x5601f2a2af8f <unknown>
#14 0x5601f2a87308 <unknown>
#15 0x5601f2a874e3 <unknown>
#16 0x5601f2a99463 <unknown>
#17 0x729e06094ac3 <unknown>
2025-10-16 09:40:28 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:28 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:28 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:28 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:29 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:29 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:29 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x63853ae454e3 <unknown>
#1 0x63853ab74c76 <unknown>
#2 0x63853ab9dd78 <unknown>
#3 0x63853ab9a029 <unknown>
#4 0x63853abd8ccc <unknown>
#5 0x63853abd847f <unknown>
#6 0x63853abcfde3 <unknown>
#7 0x63853aba52dd <unknown>
#8 0x63853aba634e <unknown>
#9 0x63853ae053e4 <unknown>
#10 0x63853ae093d7 <unknown>
#11 0x63853ae13b20 <unknown>
#12 0x63853ae0a023 <unknown>
#13 0x63853add81aa <unknown>
#14 0x63853ae2e6b8 <unknown>
#15 0x63853ae2e847 <unknown>
#16 0x63853ae3e243 <unknown>
#17 0x79d3a4694ac3 <unknown>
2025-10-16 09:40:29 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:29 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:29 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5e2f7dc564ca <unknown>
#1 0x5e2f7d6d5566 <unknown>
#2 0x5e2f7d710b4c <unknown>
#3 0x5e2f7d70c7c4 <unknown>
#4 0x5e2f7d75bbd3 <unknown>
#5 0x5e2f7d75b286 <unknown>
#6 0x5e2f7d74d403 <unknown>
#7 0x5e2f7d719b02 <unknown>
#8 0x5e2f7d71a7c1 <unknown>
#9 0x5e2f7dc1a298 <unknown>
#10 0x5e2f7dc1e0ff <unknown>
#11 0x5e2f7dc01729 <unknown>
#12 0x5e2f7dc1eca5 <unknown>
#13 0x5e2f7dbe6f8f <unknown>
#14 0x5e2f7dc43308 <unknown>
#15 0x5e2f7dc434e3 <unknown>
#16 0x5e2f7dc55463 <unknown>
#17 0x7ba084e94ac3 <unknown>
2025-10-16 09:40:29 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:29 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:29 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:29 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:29 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:29 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:29 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:29 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:29 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:29 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:29 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:29 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x556963a814ca <unknown>
#1 0x556963500566 <unknown>
#2 0x55696353bb4c <unknown>
#3 0x5569635377c4 <unknown>
#4 0x556963586bd3 <unknown>
#5 0x556963586286 <unknown>
#6 0x556963578403 <unknown>
#7 0x556963544b02 <unknown>
#8 0x5569635457c1 <unknown>
#9 0x556963a45298 <unknown>
#10 0x556963a490ff <unknown>
#11 0x556963a2c729 <unknown>
#12 0x556963a49ca5 <unknown>
#13 0x556963a11f8f <unknown>
#14 0x556963a6e308 <unknown>
#15 0x556963a6e4e3 <unknown>
#16 0x556963a80463 <unknown>
#17 0x78d16f694ac3 <unknown>
2025-10-16 09:40:29 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:29 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:30 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:30 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:30 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 87, UID: n2zooj3cx0, 進度: 0/1
2025-10-16 09:40:30 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:30 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:30 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5b82b34e04e3 <unknown>
#1 0x5b82b320fc76 <unknown>
#2 0x5b82b3238d78 <unknown>
#3 0x5b82b3235029 <unknown>
#4 0x5b82b3273ccc <unknown>
#5 0x5b82b327347f <unknown>
#6 0x5b82b326ade3 <unknown>
#7 0x5b82b32402dd <unknown>
#8 0x5b82b324134e <unknown>
#9 0x5b82b34a03e4 <unknown>
#10 0x5b82b34a43d7 <unknown>
#11 0x5b82b34aeb20 <unknown>
#12 0x5b82b34a5023 <unknown>
#13 0x5b82b34731aa <unknown>
#14 0x5b82b34c96b8 <unknown>
#15 0x5b82b34c9847 <unknown>
#16 0x5b82b34d9243 <unknown>
#17 0x795a00e94ac3 <unknown>
2025-10-16 09:40:30 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:30 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x6393817b84ca <unknown>
#1 0x639381237566 <unknown>
#2 0x639381272b4c <unknown>
#3 0x63938126e7c4 <unknown>
#4 0x6393812bdbd3 <unknown>
#5 0x6393812bd286 <unknown>
#6 0x6393812af403 <unknown>
#7 0x63938127bb02 <unknown>
#8 0x63938127c7c1 <unknown>
#9 0x63938177c298 <unknown>
#10 0x6393817800ff <unknown>
#11 0x639381763729 <unknown>
#12 0x639381780ca5 <unknown>
#13 0x639381748f8f <unknown>
#14 0x6393817a5308 <unknown>
#15 0x6393817a54e3 <unknown>
#16 0x6393817b7463 <unknown>
#17 0x7542f2a94ac3 <unknown>
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:30 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:40:30 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (2/2): WebDriver 創建失敗
2025-10-16 09:40:33 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 3/3, force_new_driver=False)
2025-10-16 09:40:33 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:40:33 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:40:33 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:40:33 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:33 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:33 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:33 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:33 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:34 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x57f4f61584ca <unknown>
#1 0x57f4f5bd7566 <unknown>
#2 0x57f4f5c12b4c <unknown>
#3 0x57f4f5c0e7c4 <unknown>
#4 0x57f4f5c5dbd3 <unknown>
#5 0x57f4f5c5d286 <unknown>
#6 0x57f4f5c4f403 <unknown>
#7 0x57f4f5c1bb02 <unknown>
#8 0x57f4f5c1c7c1 <unknown>
#9 0x57f4f611c298 <unknown>
#10 0x57f4f61200ff <unknown>
#11 0x57f4f6103729 <unknown>
#12 0x57f4f6120ca5 <unknown>
#13 0x57f4f60e8f8f <unknown>
#14 0x57f4f6145308 <unknown>
#15 0x57f4f61454e3 <unknown>
#16 0x57f4f6157463 <unknown>
#17 0x74fb33e94ac3 <unknown>
2025-10-16 09:40:34 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:34 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:34 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:34 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:34 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:34 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:34 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:34 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:34 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x62e45c2664e3 <unknown>
#1 0x62e45bf95c76 <unknown>
#2 0x62e45bfbed78 <unknown>
#3 0x62e45bfbb029 <unknown>
#4 0x62e45bff9ccc <unknown>
#5 0x62e45bff947f <unknown>
#6 0x62e45bff0de3 <unknown>
#7 0x62e45bfc62dd <unknown>
#8 0x62e45bfc734e <unknown>
#9 0x62e45c2263e4 <unknown>
#10 0x62e45c22a3d7 <unknown>
#11 0x62e45c234b20 <unknown>
#12 0x62e45c22b023 <unknown>
#13 0x62e45c1f91aa <unknown>
#14 0x62e45c24f6b8 <unknown>
#15 0x62e45c24f847 <unknown>
#16 0x62e45c25f243 <unknown>
#17 0x7897bc494ac3 <unknown>
2025-10-16 09:40:34 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:34 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:35 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x61fe885d94ca <unknown>
#1 0x61fe88058566 <unknown>
#2 0x61fe88093b4c <unknown>
#3 0x61fe8808f7c4 <unknown>
#4 0x61fe880debd3 <unknown>
#5 0x61fe880de286 <unknown>
#6 0x61fe880d0403 <unknown>
#7 0x61fe8809cb02 <unknown>
#8 0x61fe8809d7c1 <unknown>
#9 0x61fe8859d298 <unknown>
#10 0x61fe885a10ff <unknown>
#11 0x61fe88584729 <unknown>
#12 0x61fe885a1ca5 <unknown>
#13 0x61fe88569f8f <unknown>
#14 0x61fe885c6308 <unknown>
#15 0x61fe885c64e3 <unknown>
#16 0x61fe885d8463 <unknown>
#17 0x711b40e94ac3 <unknown>
2025-10-16 09:40:35 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:35 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:35 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:35 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:35 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:35 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:35 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:35 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:35 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:35 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:35 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:35 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58d8f5da14ca <unknown>
#1 0x58d8f5820566 <unknown>
#2 0x58d8f585bb4c <unknown>
#3 0x58d8f58577c4 <unknown>
#4 0x58d8f58a6bd3 <unknown>
#5 0x58d8f58a6286 <unknown>
#6 0x58d8f5898403 <unknown>
#7 0x58d8f5864b02 <unknown>
#8 0x58d8f58657c1 <unknown>
#9 0x58d8f5d65298 <unknown>
#10 0x58d8f5d690ff <unknown>
#11 0x58d8f5d4c729 <unknown>
#12 0x58d8f5d69ca5 <unknown>
#13 0x58d8f5d31f8f <unknown>
#14 0x58d8f5d8e308 <unknown>
#15 0x58d8f5d8e4e3 <unknown>
#16 0x58d8f5da0463 <unknown>
#17 0x77ec31694ac3 <unknown>
2025-10-16 09:40:35 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:35 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:35 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:35 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:35 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:35 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:35 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:35 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:36 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5935c2cd94e3 <unknown>
#1 0x5935c2a08c76 <unknown>
#2 0x5935c2a31d78 <unknown>
#3 0x5935c2a2e029 <unknown>
#4 0x5935c2a6cccc <unknown>
#5 0x5935c2a6c47f <unknown>
#6 0x5935c2a63de3 <unknown>
#7 0x5935c2a392dd <unknown>
#8 0x5935c2a3a34e <unknown>
#9 0x5935c2c993e4 <unknown>
#10 0x5935c2c9d3d7 <unknown>
#11 0x5935c2ca7b20 <unknown>
#12 0x5935c2c9e023 <unknown>
#13 0x5935c2c6c1aa <unknown>
#14 0x5935c2cc26b8 <unknown>
#15 0x5935c2cc2847 <unknown>
#16 0x5935c2cd2243 <unknown>
#17 0x78b021e94ac3 <unknown>
2025-10-16 09:40:36 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:36 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:36 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x63b34db874ca <unknown>
#1 0x63b34d606566 <unknown>
#2 0x63b34d641b4c <unknown>
#3 0x63b34d63d7c4 <unknown>
#4 0x63b34d68cbd3 <unknown>
#5 0x63b34d68c286 <unknown>
#6 0x63b34d67e403 <unknown>
#7 0x63b34d64ab02 <unknown>
#8 0x63b34d64b7c1 <unknown>
#9 0x63b34db4b298 <unknown>
#10 0x63b34db4f0ff <unknown>
#11 0x63b34db32729 <unknown>
#12 0x63b34db4fca5 <unknown>
#13 0x63b34db17f8f <unknown>
#14 0x63b34db74308 <unknown>
#15 0x63b34db744e3 <unknown>
#16 0x63b34db86463 <unknown>
#17 0x7cd13d294ac3 <unknown>
2025-10-16 09:40:36 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:36 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:36 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:36 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:36 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:36 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:36 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:40:38 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:40:38 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:38 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:38 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:38 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:38 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:38 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58eb906c34ca <unknown>
#1 0x58eb90142566 <unknown>
#2 0x58eb9017db4c <unknown>
#3 0x58eb901797c4 <unknown>
#4 0x58eb901c8bd3 <unknown>
#5 0x58eb901c8286 <unknown>
#6 0x58eb901ba403 <unknown>
#7 0x58eb90186b02 <unknown>
#8 0x58eb901877c1 <unknown>
#9 0x58eb90687298 <unknown>
#10 0x58eb9068b0ff <unknown>
#11 0x58eb9066e729 <unknown>
#12 0x58eb9068bca5 <unknown>
#13 0x58eb90653f8f <unknown>
#14 0x58eb906b0308 <unknown>
#15 0x58eb906b04e3 <unknown>
#16 0x58eb906c2463 <unknown>
#17 0x76956ba94ac3 <unknown>
2025-10-16 09:40:38 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:38 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:38 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:38 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:38 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:38 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:38 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:39 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:39 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x633e10c214e3 <unknown>
#1 0x633e10950c76 <unknown>
#2 0x633e10979d78 <unknown>
#3 0x633e10976029 <unknown>
#4 0x633e109b4ccc <unknown>
#5 0x633e109b447f <unknown>
#6 0x633e109abde3 <unknown>
#7 0x633e109812dd <unknown>
#8 0x633e1098234e <unknown>
#9 0x633e10be13e4 <unknown>
#10 0x633e10be53d7 <unknown>
#11 0x633e10befb20 <unknown>
#12 0x633e10be6023 <unknown>
#13 0x633e10bb41aa <unknown>
#14 0x633e10c0a6b8 <unknown>
#15 0x633e10c0a847 <unknown>
#16 0x633e10c1a243 <unknown>
#17 0x7dae2dc94ac3 <unknown>
2025-10-16 09:40:39 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:39 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:39 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5ed0490374ca <unknown>
#1 0x5ed048ab6566 <unknown>
#2 0x5ed048af1b4c <unknown>
#3 0x5ed048aed7c4 <unknown>
#4 0x5ed048b3cbd3 <unknown>
#5 0x5ed048b3c286 <unknown>
#6 0x5ed048b2e403 <unknown>
#7 0x5ed048afab02 <unknown>
#8 0x5ed048afb7c1 <unknown>
#9 0x5ed048ffb298 <unknown>
#10 0x5ed048fff0ff <unknown>
#11 0x5ed048fe2729 <unknown>
#12 0x5ed048fffca5 <unknown>
#13 0x5ed048fc7f8f <unknown>
#14 0x5ed049024308 <unknown>
#15 0x5ed0490244e3 <unknown>
#16 0x5ed049036463 <unknown>
#17 0x79267c694ac3 <unknown>
2025-10-16 09:40:39 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:39 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:39 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:39 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:39 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:39 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:39 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:39 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:39 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:39 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:39 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:39 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5c0f621d64ca <unknown>
#1 0x5c0f61c55566 <unknown>
#2 0x5c0f61c90b4c <unknown>
#3 0x5c0f61c8c7c4 <unknown>
#4 0x5c0f61cdbbd3 <unknown>
#5 0x5c0f61cdb286 <unknown>
#6 0x5c0f61ccd403 <unknown>
#7 0x5c0f61c99b02 <unknown>
#8 0x5c0f61c9a7c1 <unknown>
#9 0x5c0f6219a298 <unknown>
#10 0x5c0f6219e0ff <unknown>
#11 0x5c0f62181729 <unknown>
#12 0x5c0f6219eca5 <unknown>
#13 0x5c0f62166f8f <unknown>
#14 0x5c0f621c3308 <unknown>
#15 0x5c0f621c34e3 <unknown>
#16 0x5c0f621d5463 <unknown>
#17 0x71047e694ac3 <unknown>
2025-10-16 09:40:39 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:39 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:39 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:39 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:39 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:39 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:40 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:40 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:40 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 87, UID: n2zooj3cx0, 進度: 0/1
2025-10-16 09:40:40 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x58824a77e4e3 <unknown>
#1 0x58824a4adc76 <unknown>
#2 0x58824a4d6d78 <unknown>
#3 0x58824a4d3029 <unknown>
#4 0x58824a511ccc <unknown>
#5 0x58824a51147f <unknown>
#6 0x58824a508de3 <unknown>
#7 0x58824a4de2dd <unknown>
#8 0x58824a4df34e <unknown>
#9 0x58824a73e3e4 <unknown>
#10 0x58824a7423d7 <unknown>
#11 0x58824a74cb20 <unknown>
#12 0x58824a743023 <unknown>
#13 0x58824a7111aa <unknown>
#14 0x58824a7676b8 <unknown>
#15 0x58824a767847 <unknown>
#16 0x58824a777243 <unknown>
#17 0x73b965294ac3 <unknown>
2025-10-16 09:40:40 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:40 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:40 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5fcd3c6024ca <unknown>
#1 0x5fcd3c081566 <unknown>
#2 0x5fcd3c0bcb4c <unknown>
#3 0x5fcd3c0b87c4 <unknown>
#4 0x5fcd3c107bd3 <unknown>
#5 0x5fcd3c107286 <unknown>
#6 0x5fcd3c0f9403 <unknown>
#7 0x5fcd3c0c5b02 <unknown>
#8 0x5fcd3c0c67c1 <unknown>
#9 0x5fcd3c5c6298 <unknown>
#10 0x5fcd3c5ca0ff <unknown>
#11 0x5fcd3c5ad729 <unknown>
#12 0x5fcd3c5caca5 <unknown>
#13 0x5fcd3c592f8f <unknown>
#14 0x5fcd3c5ef308 <unknown>
#15 0x5fcd3c5ef4e3 <unknown>
#16 0x5fcd3c601463 <unknown>
#17 0x7c8048a94ac3 <unknown>
2025-10-16 09:40:40 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:40 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:40 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:40 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:40 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:40 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:40 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:40:44 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:40:44 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:44 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:44 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:44 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:44 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:44 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5e73fe6774ca <unknown>
#1 0x5e73fe0f6566 <unknown>
#2 0x5e73fe131b4c <unknown>
#3 0x5e73fe12d7c4 <unknown>
#4 0x5e73fe17cbd3 <unknown>
#5 0x5e73fe17c286 <unknown>
#6 0x5e73fe16e403 <unknown>
#7 0x5e73fe13ab02 <unknown>
#8 0x5e73fe13b7c1 <unknown>
#9 0x5e73fe63b298 <unknown>
#10 0x5e73fe63f0ff <unknown>
#11 0x5e73fe622729 <unknown>
#12 0x5e73fe63fca5 <unknown>
#13 0x5e73fe607f8f <unknown>
#14 0x5e73fe664308 <unknown>
#15 0x5e73fe6644e3 <unknown>
#16 0x5e73fe676463 <unknown>
#17 0x78675b294ac3 <unknown>
2025-10-16 09:40:44 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:44 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:44 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:44 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:44 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:44 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:45 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:45 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:45 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x592ac2bb94e3 <unknown>
#1 0x592ac28e8c76 <unknown>
#2 0x592ac2911d78 <unknown>
#3 0x592ac290e029 <unknown>
#4 0x592ac294cccc <unknown>
#5 0x592ac294c47f <unknown>
#6 0x592ac2943de3 <unknown>
#7 0x592ac29192dd <unknown>
#8 0x592ac291a34e <unknown>
#9 0x592ac2b793e4 <unknown>
#10 0x592ac2b7d3d7 <unknown>
#11 0x592ac2b87b20 <unknown>
#12 0x592ac2b7e023 <unknown>
#13 0x592ac2b4c1aa <unknown>
#14 0x592ac2ba26b8 <unknown>
#15 0x592ac2ba2847 <unknown>
#16 0x592ac2bb2243 <unknown>
#17 0x7398ef094ac3 <unknown>
2025-10-16 09:40:45 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:45 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:45 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x6124451424ca <unknown>
#1 0x612444bc1566 <unknown>
#2 0x612444bfcb4c <unknown>
#3 0x612444bf87c4 <unknown>
#4 0x612444c47bd3 <unknown>
#5 0x612444c47286 <unknown>
#6 0x612444c39403 <unknown>
#7 0x612444c05b02 <unknown>
#8 0x612444c067c1 <unknown>
#9 0x612445106298 <unknown>
#10 0x61244510a0ff <unknown>
#11 0x6124450ed729 <unknown>
#12 0x61244510aca5 <unknown>
#13 0x6124450d2f8f <unknown>
#14 0x61244512f308 <unknown>
#15 0x61244512f4e3 <unknown>
#16 0x612445141463 <unknown>
#17 0x7ba620694ac3 <unknown>
2025-10-16 09:40:45 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:45 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:45 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:45 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:45 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:45 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:40:45 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:40:45 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:40:45 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:40:45 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:40:45 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:40:45 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a646a2104ca <unknown>
#1 0x5a6469c8f566 <unknown>
#2 0x5a6469ccab4c <unknown>
#3 0x5a6469cc67c4 <unknown>
#4 0x5a6469d15bd3 <unknown>
#5 0x5a6469d15286 <unknown>
#6 0x5a6469d07403 <unknown>
#7 0x5a6469cd3b02 <unknown>
#8 0x5a6469cd47c1 <unknown>
#9 0x5a646a1d4298 <unknown>
#10 0x5a646a1d80ff <unknown>
#11 0x5a646a1bb729 <unknown>
#12 0x5a646a1d8ca5 <unknown>
#13 0x5a646a1a0f8f <unknown>
#14 0x5a646a1fd308 <unknown>
#15 0x5a646a1fd4e3 <unknown>
#16 0x5a646a20f463 <unknown>
#17 0x78d98be94ac3 <unknown>
2025-10-16 09:40:45 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:40:45 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:40:45 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:45 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:40:45 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:40:46 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:46 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:40:46 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x612d5ea7f4e3 <unknown>
#1 0x612d5e7aec76 <unknown>
#2 0x612d5e7d7d78 <unknown>
#3 0x612d5e7d4029 <unknown>
#4 0x612d5e812ccc <unknown>
#5 0x612d5e81247f <unknown>
#6 0x612d5e809de3 <unknown>
#7 0x612d5e7df2dd <unknown>
#8 0x612d5e7e034e <unknown>
#9 0x612d5ea3f3e4 <unknown>
#10 0x612d5ea433d7 <unknown>
#11 0x612d5ea4db20 <unknown>
#12 0x612d5ea44023 <unknown>
#13 0x612d5ea121aa <unknown>
#14 0x612d5ea686b8 <unknown>
#15 0x612d5ea68847 <unknown>
#16 0x612d5ea78243 <unknown>
#17 0x70be18094ac3 <unknown>
2025-10-16 09:40:46 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:40:46 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a27a8bee4ca <unknown>
#1 0x5a27a866d566 <unknown>
#2 0x5a27a86a8b4c <unknown>
#3 0x5a27a86a47c4 <unknown>
#4 0x5a27a86f3bd3 <unknown>
#5 0x5a27a86f3286 <unknown>
#6 0x5a27a86e5403 <unknown>
#7 0x5a27a86b1b02 <unknown>
#8 0x5a27a86b27c1 <unknown>
#9 0x5a27a8bb2298 <unknown>
#10 0x5a27a8bb60ff <unknown>
#11 0x5a27a8b99729 <unknown>
#12 0x5a27a8bb6ca5 <unknown>
#13 0x5a27a8b7ef8f <unknown>
#14 0x5a27a8bdb308 <unknown>
#15 0x5a27a8bdb4e3 <unknown>
#16 0x5a27a8bed463 <unknown>
#17 0x799767a94ac3 <unknown>
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:40:46 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:40:46 - ERROR - main - [url_processor.py:123] - process_url - 達到最大重試次數,放棄獲取 URL: https://www.twitch.tv/iamruru
2025-10-16 09:40:46 - ERROR - main - [url_processor.py:640] - process_url - 處理 URL 時發生未預期錯誤: WebDriver 創建失敗
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/processing/url_processor.py", line 98, in process_url
html_content, title, final_url = web_scraper.get_content(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:40:46 - INFO - database - [database.py:505] - update_url_status - URL ID 87 状态已更新为 error
2025-10-16 09:40:46 - INFO - main - [url_processor.py:653] - process_url - 工作線程 #1 完成處理 URL ID: 87
2025-10-16 09:40:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:40:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:40:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 124.1MB, CPU 0.0%
2025-10-16 09:40:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 141.9MB, CPU 0.0%
2025-10-16 09:40:50 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 87, UID: n2zooj3cx0, 進度: 0/1
2025-10-16 09:41:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:41:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:41:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:41:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:41:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:41:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:41:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.06 秒,結果: 0
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:41:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.09 秒,結果: 0
2025-10-16 09:41:52 - INFO - database - [database.py:420] - process_url - UI 提交生成 UID: d0qzqru59y
2025-10-16 09:41:52 - INFO - database - [database.py:426] - process_url - UI 提交 URL https://www.ecpay.com.tw/,結果將立即顯示
2025-10-16 09:41:52 - INFO - main - [web_routes.py:115] - submit_url - UI 提交,URL ID: 88, Phone: 02-2655-1775, Email:
2025-10-16 09:41:52 - INFO - database - [database.py:536] - get_pending_url - 找到待处理的 URL: ID=88, URL=https://www.ecpay.com.tw/
2025-10-16 09:41:52 - INFO - main - [request_processor.py:690] - process_pending_urls - 已添加 1 個 URL 到處理隊列
2025-10-16 09:41:52 - INFO - main - [url_processor.py:42] - process_url - 工作線程 #1 開始處理 URL ID: 88
2025-10-16 09:41:52 - INFO - main - [url_processor.py:83] - process_url - 分析 URL: https://www.ecpay.com.tw/
2025-10-16 09:41:52 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 1/3, force_new_driver=False)
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.ecpay.com.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 1/3 次請求
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:41:52 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x62968aeb04ca <unknown>
#1 0x62968a92f566 <unknown>
#2 0x62968a96ab4c <unknown>
#3 0x62968a9667c4 <unknown>
#4 0x62968a9b5bd3 <unknown>
#5 0x62968a9b5286 <unknown>
#6 0x62968a9a7403 <unknown>
#7 0x62968a973b02 <unknown>
#8 0x62968a9747c1 <unknown>
#9 0x62968ae74298 <unknown>
#10 0x62968ae780ff <unknown>
#11 0x62968ae5b729 <unknown>
#12 0x62968ae78ca5 <unknown>
#13 0x62968ae40f8f <unknown>
#14 0x62968ae9d308 <unknown>
#15 0x62968ae9d4e3 <unknown>
#16 0x62968aeaf463 <unknown>
#17 0x7003be694ac3 <unknown>
2025-10-16 09:41:52 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:41:52 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:41:52 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:52 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:41:52 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:41:52 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:52 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:52 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:41:53 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x59775a8f54e3 <unknown>
#1 0x59775a624c76 <unknown>
#2 0x59775a64dd78 <unknown>
#3 0x59775a64a029 <unknown>
#4 0x59775a688ccc <unknown>
#5 0x59775a68847f <unknown>
#6 0x59775a67fde3 <unknown>
#7 0x59775a6552dd <unknown>
#8 0x59775a65634e <unknown>
#9 0x59775a8b53e4 <unknown>
#10 0x59775a8b93d7 <unknown>
#11 0x59775a8c3b20 <unknown>
#12 0x59775a8ba023 <unknown>
#13 0x59775a8881aa <unknown>
#14 0x59775a8de6b8 <unknown>
#15 0x59775a8de847 <unknown>
#16 0x59775a8ee243 <unknown>
#17 0x78274ce94ac3 <unknown>
2025-10-16 09:41:53 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:41:53 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:41:53 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5c8c708094ca <unknown>
#1 0x5c8c70288566 <unknown>
#2 0x5c8c702c3b4c <unknown>
#3 0x5c8c702bf7c4 <unknown>
#4 0x5c8c7030ebd3 <unknown>
#5 0x5c8c7030e286 <unknown>
#6 0x5c8c70300403 <unknown>
#7 0x5c8c702ccb02 <unknown>
#8 0x5c8c702cd7c1 <unknown>
#9 0x5c8c707cd298 <unknown>
#10 0x5c8c707d10ff <unknown>
#11 0x5c8c707b4729 <unknown>
#12 0x5c8c707d1ca5 <unknown>
#13 0x5c8c70799f8f <unknown>
#14 0x5c8c707f6308 <unknown>
#15 0x5c8c707f64e3 <unknown>
#16 0x5c8c70808463 <unknown>
#17 0x7cfe42094ac3 <unknown>
2025-10-16 09:41:53 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:41:53 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:41:53 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:41:53 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:41:53 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:41:53 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:41:53 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:41:53 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:41:53 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:41:53 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:41:53 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:41:53 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 88, UID: d0qzqru59y, 進度: 0/1
2025-10-16 09:41:53 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f2093ab54ca <unknown>
#1 0x5f2093534566 <unknown>
#2 0x5f209356fb4c <unknown>
#3 0x5f209356b7c4 <unknown>
#4 0x5f20935babd3 <unknown>
#5 0x5f20935ba286 <unknown>
#6 0x5f20935ac403 <unknown>
#7 0x5f2093578b02 <unknown>
#8 0x5f20935797c1 <unknown>
#9 0x5f2093a79298 <unknown>
#10 0x5f2093a7d0ff <unknown>
#11 0x5f2093a60729 <unknown>
#12 0x5f2093a7dca5 <unknown>
#13 0x5f2093a45f8f <unknown>
#14 0x5f2093aa2308 <unknown>
#15 0x5f2093aa24e3 <unknown>
#16 0x5f2093ab4463 <unknown>
#17 0x76ac2c094ac3 <unknown>
2025-10-16 09:41:53 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:41:53 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:41:53 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:53 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:41:53 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:41:53 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:54 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:54 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:41:54 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5da30084b4e3 <unknown>
#1 0x5da30057ac76 <unknown>
#2 0x5da3005a3d78 <unknown>
#3 0x5da3005a0029 <unknown>
#4 0x5da3005deccc <unknown>
#5 0x5da3005de47f <unknown>
#6 0x5da3005d5de3 <unknown>
#7 0x5da3005ab2dd <unknown>
#8 0x5da3005ac34e <unknown>
#9 0x5da30080b3e4 <unknown>
#10 0x5da30080f3d7 <unknown>
#11 0x5da300819b20 <unknown>
#12 0x5da300810023 <unknown>
#13 0x5da3007de1aa <unknown>
#14 0x5da3008346b8 <unknown>
#15 0x5da300834847 <unknown>
#16 0x5da300844243 <unknown>
#17 0x771cd7c94ac3 <unknown>
2025-10-16 09:41:54 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:41:54 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:41:54 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x61a7d09b14ca <unknown>
#1 0x61a7d0430566 <unknown>
#2 0x61a7d046bb4c <unknown>
#3 0x61a7d04677c4 <unknown>
#4 0x61a7d04b6bd3 <unknown>
#5 0x61a7d04b6286 <unknown>
#6 0x61a7d04a8403 <unknown>
#7 0x61a7d0474b02 <unknown>
#8 0x61a7d04757c1 <unknown>
#9 0x61a7d0975298 <unknown>
#10 0x61a7d09790ff <unknown>
#11 0x61a7d095c729 <unknown>
#12 0x61a7d0979ca5 <unknown>
#13 0x61a7d0941f8f <unknown>
#14 0x61a7d099e308 <unknown>
#15 0x61a7d099e4e3 <unknown>
#16 0x61a7d09b0463 <unknown>
#17 0x7f6eec894ac3 <unknown>
2025-10-16 09:41:54 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:41:54 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:41:54 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:41:54 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:41:54 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:41:54 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:41:54 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:41:56 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 2/3 次請求
2025-10-16 09:41:56 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:41:56 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:41:56 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:41:56 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:41:56 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:41:56 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x62262a8d64ca <unknown>
#1 0x62262a355566 <unknown>
#2 0x62262a390b4c <unknown>
#3 0x62262a38c7c4 <unknown>
#4 0x62262a3dbbd3 <unknown>
#5 0x62262a3db286 <unknown>
#6 0x62262a3cd403 <unknown>
#7 0x62262a399b02 <unknown>
#8 0x62262a39a7c1 <unknown>
#9 0x62262a89a298 <unknown>
#10 0x62262a89e0ff <unknown>
#11 0x62262a881729 <unknown>
#12 0x62262a89eca5 <unknown>
#13 0x62262a866f8f <unknown>
#14 0x62262a8c3308 <unknown>
#15 0x62262a8c34e3 <unknown>
#16 0x62262a8d5463 <unknown>
#17 0x7a7b7ba94ac3 <unknown>
2025-10-16 09:41:56 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:41:56 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:41:56 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:56 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:41:56 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:41:56 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:57 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:41:57 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x640f415444e3 <unknown>
#1 0x640f41273c76 <unknown>
#2 0x640f4129cd78 <unknown>
#3 0x640f41299029 <unknown>
#4 0x640f412d7ccc <unknown>
#5 0x640f412d747f <unknown>
#6 0x640f412cede3 <unknown>
#7 0x640f412a42dd <unknown>
#8 0x640f412a534e <unknown>
#9 0x640f415043e4 <unknown>
#10 0x640f415083d7 <unknown>
#11 0x640f41512b20 <unknown>
#12 0x640f41509023 <unknown>
#13 0x640f414d71aa <unknown>
#14 0x640f4152d6b8 <unknown>
#15 0x640f4152d847 <unknown>
#16 0x640f4153d243 <unknown>
#17 0x7576aaa94ac3 <unknown>
2025-10-16 09:41:57 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:41:57 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:41:57 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5bec53bcb4ca <unknown>
#1 0x5bec5364a566 <unknown>
#2 0x5bec53685b4c <unknown>
#3 0x5bec536817c4 <unknown>
#4 0x5bec536d0bd3 <unknown>
#5 0x5bec536d0286 <unknown>
#6 0x5bec536c2403 <unknown>
#7 0x5bec5368eb02 <unknown>
#8 0x5bec5368f7c1 <unknown>
#9 0x5bec53b8f298 <unknown>
#10 0x5bec53b930ff <unknown>
#11 0x5bec53b76729 <unknown>
#12 0x5bec53b93ca5 <unknown>
#13 0x5bec53b5bf8f <unknown>
#14 0x5bec53bb8308 <unknown>
#15 0x5bec53bb84e3 <unknown>
#16 0x5bec53bca463 <unknown>
#17 0x715075e94ac3 <unknown>
2025-10-16 09:41:57 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:41:57 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:41:57 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:41:57 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:41:57 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:41:57 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:41:57 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:41:57 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:41:57 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:41:57 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:41:57 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:41:57 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x631d47ca84ca <unknown>
#1 0x631d47727566 <unknown>
#2 0x631d47762b4c <unknown>
#3 0x631d4775e7c4 <unknown>
#4 0x631d477adbd3 <unknown>
#5 0x631d477ad286 <unknown>
#6 0x631d4779f403 <unknown>
#7 0x631d4776bb02 <unknown>
#8 0x631d4776c7c1 <unknown>
#9 0x631d47c6c298 <unknown>
#10 0x631d47c700ff <unknown>
#11 0x631d47c53729 <unknown>
#12 0x631d47c70ca5 <unknown>
#13 0x631d47c38f8f <unknown>
#14 0x631d47c95308 <unknown>
#15 0x631d47c954e3 <unknown>
#16 0x631d47ca7463 <unknown>
#17 0x750d3c094ac3 <unknown>
2025-10-16 09:41:57 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:41:57 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:41:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:57 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:41:57 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:41:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:58 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:41:58 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:41:58 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x59554aead4e3 <unknown>
#1 0x59554abdcc76 <unknown>
#2 0x59554ac05d78 <unknown>
#3 0x59554ac02029 <unknown>
#4 0x59554ac40ccc <unknown>
#5 0x59554ac4047f <unknown>
#6 0x59554ac37de3 <unknown>
#7 0x59554ac0d2dd <unknown>
#8 0x59554ac0e34e <unknown>
#9 0x59554ae6d3e4 <unknown>
#10 0x59554ae713d7 <unknown>
#11 0x59554ae7bb20 <unknown>
#12 0x59554ae72023 <unknown>
#13 0x59554ae401aa <unknown>
#14 0x59554ae966b8 <unknown>
#15 0x59554ae96847 <unknown>
#16 0x59554aea6243 <unknown>
#17 0x75c29ce94ac3 <unknown>
2025-10-16 09:41:58 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:41:58 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:41:58 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x6169748ca4ca <unknown>
#1 0x616974349566 <unknown>
#2 0x616974384b4c <unknown>
#3 0x6169743807c4 <unknown>
#4 0x6169743cfbd3 <unknown>
#5 0x6169743cf286 <unknown>
#6 0x6169743c1403 <unknown>
#7 0x61697438db02 <unknown>
#8 0x61697438e7c1 <unknown>
#9 0x61697488e298 <unknown>
#10 0x6169748920ff <unknown>
#11 0x616974875729 <unknown>
#12 0x616974892ca5 <unknown>
#13 0x61697485af8f <unknown>
#14 0x6169748b7308 <unknown>
#15 0x6169748b74e3 <unknown>
#16 0x6169748c9463 <unknown>
#17 0x7a13d3494ac3 <unknown>
2025-10-16 09:41:58 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:41:58 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:41:58 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:41:58 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:41:58 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:41:58 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:41:58 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:42:02 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 3/3 次請求
2025-10-16 09:42:02 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:02 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:02 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:02 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:02 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:02 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x60996908e4ca <unknown>
#1 0x609968b0d566 <unknown>
#2 0x609968b48b4c <unknown>
#3 0x609968b447c4 <unknown>
#4 0x609968b93bd3 <unknown>
#5 0x609968b93286 <unknown>
#6 0x609968b85403 <unknown>
#7 0x609968b51b02 <unknown>
#8 0x609968b527c1 <unknown>
#9 0x609969052298 <unknown>
#10 0x6099690560ff <unknown>
#11 0x609969039729 <unknown>
#12 0x609969056ca5 <unknown>
#13 0x60996901ef8f <unknown>
#14 0x60996907b308 <unknown>
#15 0x60996907b4e3 <unknown>
#16 0x60996908d463 <unknown>
#17 0x79551d894ac3 <unknown>
2025-10-16 09:42:02 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:02 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:02 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:02 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:02 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:03 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:03 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:03 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 88, UID: d0qzqru59y, 進度: 0/1
2025-10-16 09:42:03 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:03 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5899aa44b4e3 <unknown>
#1 0x5899aa17ac76 <unknown>
#2 0x5899aa1a3d78 <unknown>
#3 0x5899aa1a0029 <unknown>
#4 0x5899aa1deccc <unknown>
#5 0x5899aa1de47f <unknown>
#6 0x5899aa1d5de3 <unknown>
#7 0x5899aa1ab2dd <unknown>
#8 0x5899aa1ac34e <unknown>
#9 0x5899aa40b3e4 <unknown>
#10 0x5899aa40f3d7 <unknown>
#11 0x5899aa419b20 <unknown>
#12 0x5899aa410023 <unknown>
#13 0x5899aa3de1aa <unknown>
#14 0x5899aa4346b8 <unknown>
#15 0x5899aa434847 <unknown>
#16 0x5899aa444243 <unknown>
#17 0x7af0c6294ac3 <unknown>
2025-10-16 09:42:03 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:03 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:03 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x636c662a24ca <unknown>
#1 0x636c65d21566 <unknown>
#2 0x636c65d5cb4c <unknown>
#3 0x636c65d587c4 <unknown>
#4 0x636c65da7bd3 <unknown>
#5 0x636c65da7286 <unknown>
#6 0x636c65d99403 <unknown>
#7 0x636c65d65b02 <unknown>
#8 0x636c65d667c1 <unknown>
#9 0x636c66266298 <unknown>
#10 0x636c6626a0ff <unknown>
#11 0x636c6624d729 <unknown>
#12 0x636c6626aca5 <unknown>
#13 0x636c66232f8f <unknown>
#14 0x636c6628f308 <unknown>
#15 0x636c6628f4e3 <unknown>
#16 0x636c662a1463 <unknown>
#17 0x70f9e4494ac3 <unknown>
2025-10-16 09:42:03 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:03 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:03 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:03 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:03 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:03 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:03 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:03 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:03 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:03 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:03 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:03 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x61656b4db4ca <unknown>
#1 0x61656af5a566 <unknown>
#2 0x61656af95b4c <unknown>
#3 0x61656af917c4 <unknown>
#4 0x61656afe0bd3 <unknown>
#5 0x61656afe0286 <unknown>
#6 0x61656afd2403 <unknown>
#7 0x61656af9eb02 <unknown>
#8 0x61656af9f7c1 <unknown>
#9 0x61656b49f298 <unknown>
#10 0x61656b4a30ff <unknown>
#11 0x61656b486729 <unknown>
#12 0x61656b4a3ca5 <unknown>
#13 0x61656b46bf8f <unknown>
#14 0x61656b4c8308 <unknown>
#15 0x61656b4c84e3 <unknown>
#16 0x61656b4da463 <unknown>
#17 0x7cfec9c94ac3 <unknown>
2025-10-16 09:42:03 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:03 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:03 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:03 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:04 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:04 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:04 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:04 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5ab3dcf7b4e3 <unknown>
#1 0x5ab3dccaac76 <unknown>
#2 0x5ab3dccd3d78 <unknown>
#3 0x5ab3dccd0029 <unknown>
#4 0x5ab3dcd0eccc <unknown>
#5 0x5ab3dcd0e47f <unknown>
#6 0x5ab3dcd05de3 <unknown>
#7 0x5ab3dccdb2dd <unknown>
#8 0x5ab3dccdc34e <unknown>
#9 0x5ab3dcf3b3e4 <unknown>
#10 0x5ab3dcf3f3d7 <unknown>
#11 0x5ab3dcf49b20 <unknown>
#12 0x5ab3dcf40023 <unknown>
#13 0x5ab3dcf0e1aa <unknown>
#14 0x5ab3dcf646b8 <unknown>
#15 0x5ab3dcf64847 <unknown>
#16 0x5ab3dcf74243 <unknown>
#17 0x7501a1494ac3 <unknown>
2025-10-16 09:42:04 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:04 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x61a6252b54ca <unknown>
#1 0x61a624d34566 <unknown>
#2 0x61a624d6fb4c <unknown>
#3 0x61a624d6b7c4 <unknown>
#4 0x61a624dbabd3 <unknown>
#5 0x61a624dba286 <unknown>
#6 0x61a624dac403 <unknown>
#7 0x61a624d78b02 <unknown>
#8 0x61a624d797c1 <unknown>
#9 0x61a625279298 <unknown>
#10 0x61a62527d0ff <unknown>
#11 0x61a625260729 <unknown>
#12 0x61a62527dca5 <unknown>
#13 0x61a625245f8f <unknown>
#14 0x61a6252a2308 <unknown>
#15 0x61a6252a24e3 <unknown>
#16 0x61a6252b4463 <unknown>
#17 0x71ef97294ac3 <unknown>
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:42:04 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:42:04 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (1/2): WebDriver 創建失敗
2025-10-16 09:42:07 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 2/3, force_new_driver=False)
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.ecpay.com.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 1/3 次請求
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:07 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x56eba930a4ca <unknown>
#1 0x56eba8d89566 <unknown>
#2 0x56eba8dc4b4c <unknown>
#3 0x56eba8dc07c4 <unknown>
#4 0x56eba8e0fbd3 <unknown>
#5 0x56eba8e0f286 <unknown>
#6 0x56eba8e01403 <unknown>
#7 0x56eba8dcdb02 <unknown>
#8 0x56eba8dce7c1 <unknown>
#9 0x56eba92ce298 <unknown>
#10 0x56eba92d20ff <unknown>
#11 0x56eba92b5729 <unknown>
#12 0x56eba92d2ca5 <unknown>
#13 0x56eba929af8f <unknown>
#14 0x56eba92f7308 <unknown>
#15 0x56eba92f74e3 <unknown>
#16 0x56eba9309463 <unknown>
#17 0x7b4fb7e94ac3 <unknown>
2025-10-16 09:42:07 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:07 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:07 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:08 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:08 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:08 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:08 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:08 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:08 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x57e16999b4e3 <unknown>
#1 0x57e1696cac76 <unknown>
#2 0x57e1696f3d78 <unknown>
#3 0x57e1696f0029 <unknown>
#4 0x57e16972eccc <unknown>
#5 0x57e16972e47f <unknown>
#6 0x57e169725de3 <unknown>
#7 0x57e1696fb2dd <unknown>
#8 0x57e1696fc34e <unknown>
#9 0x57e16995b3e4 <unknown>
#10 0x57e16995f3d7 <unknown>
#11 0x57e169969b20 <unknown>
#12 0x57e169960023 <unknown>
#13 0x57e16992e1aa <unknown>
#14 0x57e1699846b8 <unknown>
#15 0x57e169984847 <unknown>
#16 0x57e169994243 <unknown>
#17 0x76cee2894ac3 <unknown>
2025-10-16 09:42:08 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:08 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:08 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x595996b3d4ca <unknown>
#1 0x5959965bc566 <unknown>
#2 0x5959965f7b4c <unknown>
#3 0x5959965f37c4 <unknown>
#4 0x595996642bd3 <unknown>
#5 0x595996642286 <unknown>
#6 0x595996634403 <unknown>
#7 0x595996600b02 <unknown>
#8 0x5959966017c1 <unknown>
#9 0x595996b01298 <unknown>
#10 0x595996b050ff <unknown>
#11 0x595996ae8729 <unknown>
#12 0x595996b05ca5 <unknown>
#13 0x595996acdf8f <unknown>
#14 0x595996b2a308 <unknown>
#15 0x595996b2a4e3 <unknown>
#16 0x595996b3c463 <unknown>
#17 0x7d27d1c94ac3 <unknown>
2025-10-16 09:42:08 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:08 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:08 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:08 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:08 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:08 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:08 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:08 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:08 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:08 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:08 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:08 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5bd5cc58b4ca <unknown>
#1 0x5bd5cc00a566 <unknown>
#2 0x5bd5cc045b4c <unknown>
#3 0x5bd5cc0417c4 <unknown>
#4 0x5bd5cc090bd3 <unknown>
#5 0x5bd5cc090286 <unknown>
#6 0x5bd5cc082403 <unknown>
#7 0x5bd5cc04eb02 <unknown>
#8 0x5bd5cc04f7c1 <unknown>
#9 0x5bd5cc54f298 <unknown>
#10 0x5bd5cc5530ff <unknown>
#11 0x5bd5cc536729 <unknown>
#12 0x5bd5cc553ca5 <unknown>
#13 0x5bd5cc51bf8f <unknown>
#14 0x5bd5cc578308 <unknown>
#15 0x5bd5cc5784e3 <unknown>
#16 0x5bd5cc58a463 <unknown>
#17 0x785fb9694ac3 <unknown>
2025-10-16 09:42:08 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:08 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:09 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:09 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:09 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:09 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:09 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:09 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:09 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5e3f0ad304e3 <unknown>
#1 0x5e3f0aa5fc76 <unknown>
#2 0x5e3f0aa88d78 <unknown>
#3 0x5e3f0aa85029 <unknown>
#4 0x5e3f0aac3ccc <unknown>
#5 0x5e3f0aac347f <unknown>
#6 0x5e3f0aabade3 <unknown>
#7 0x5e3f0aa902dd <unknown>
#8 0x5e3f0aa9134e <unknown>
#9 0x5e3f0acf03e4 <unknown>
#10 0x5e3f0acf43d7 <unknown>
#11 0x5e3f0acfeb20 <unknown>
#12 0x5e3f0acf5023 <unknown>
#13 0x5e3f0acc31aa <unknown>
#14 0x5e3f0ad196b8 <unknown>
#15 0x5e3f0ad19847 <unknown>
#16 0x5e3f0ad29243 <unknown>
#17 0x7e20fd294ac3 <unknown>
2025-10-16 09:42:09 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:09 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:09 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5e13650574ca <unknown>
#1 0x5e1364ad6566 <unknown>
#2 0x5e1364b11b4c <unknown>
#3 0x5e1364b0d7c4 <unknown>
#4 0x5e1364b5cbd3 <unknown>
#5 0x5e1364b5c286 <unknown>
#6 0x5e1364b4e403 <unknown>
#7 0x5e1364b1ab02 <unknown>
#8 0x5e1364b1b7c1 <unknown>
#9 0x5e136501b298 <unknown>
#10 0x5e136501f0ff <unknown>
#11 0x5e1365002729 <unknown>
#12 0x5e136501fca5 <unknown>
#13 0x5e1364fe7f8f <unknown>
#14 0x5e1365044308 <unknown>
#15 0x5e13650444e3 <unknown>
#16 0x5e1365056463 <unknown>
#17 0x7e3b05e94ac3 <unknown>
2025-10-16 09:42:09 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:10 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:10 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:10 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:10 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:42:10 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:42:10 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:42:12 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 2/3 次請求
2025-10-16 09:42:12 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:12 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:12 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:12 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:12 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:12 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x6233cb2f04ca <unknown>
#1 0x6233cad6f566 <unknown>
#2 0x6233cadaab4c <unknown>
#3 0x6233cada67c4 <unknown>
#4 0x6233cadf5bd3 <unknown>
#5 0x6233cadf5286 <unknown>
#6 0x6233cade7403 <unknown>
#7 0x6233cadb3b02 <unknown>
#8 0x6233cadb47c1 <unknown>
#9 0x6233cb2b4298 <unknown>
#10 0x6233cb2b80ff <unknown>
#11 0x6233cb29b729 <unknown>
#12 0x6233cb2b8ca5 <unknown>
#13 0x6233cb280f8f <unknown>
#14 0x6233cb2dd308 <unknown>
#15 0x6233cb2dd4e3 <unknown>
#16 0x6233cb2ef463 <unknown>
#17 0x7906e6e94ac3 <unknown>
2025-10-16 09:42:12 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:12 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:12 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:12 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:12 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:12 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:12 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:12 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:13 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5dfd207294e3 <unknown>
#1 0x5dfd20458c76 <unknown>
#2 0x5dfd20481d78 <unknown>
#3 0x5dfd2047e029 <unknown>
#4 0x5dfd204bcccc <unknown>
#5 0x5dfd204bc47f <unknown>
#6 0x5dfd204b3de3 <unknown>
#7 0x5dfd204892dd <unknown>
#8 0x5dfd2048a34e <unknown>
#9 0x5dfd206e93e4 <unknown>
#10 0x5dfd206ed3d7 <unknown>
#11 0x5dfd206f7b20 <unknown>
#12 0x5dfd206ee023 <unknown>
#13 0x5dfd206bc1aa <unknown>
#14 0x5dfd207126b8 <unknown>
#15 0x5dfd20712847 <unknown>
#16 0x5dfd20722243 <unknown>
#17 0x791472294ac3 <unknown>
2025-10-16 09:42:13 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:13 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:13 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5bc4ec2c84ca <unknown>
#1 0x5bc4ebd47566 <unknown>
#2 0x5bc4ebd82b4c <unknown>
#3 0x5bc4ebd7e7c4 <unknown>
#4 0x5bc4ebdcdbd3 <unknown>
#5 0x5bc4ebdcd286 <unknown>
#6 0x5bc4ebdbf403 <unknown>
#7 0x5bc4ebd8bb02 <unknown>
#8 0x5bc4ebd8c7c1 <unknown>
#9 0x5bc4ec28c298 <unknown>
#10 0x5bc4ec2900ff <unknown>
#11 0x5bc4ec273729 <unknown>
#12 0x5bc4ec290ca5 <unknown>
#13 0x5bc4ec258f8f <unknown>
#14 0x5bc4ec2b5308 <unknown>
#15 0x5bc4ec2b54e3 <unknown>
#16 0x5bc4ec2c7463 <unknown>
#17 0x721408694ac3 <unknown>
2025-10-16 09:42:13 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:13 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:13 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:13 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:13 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:13 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:13 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:13 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:13 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:13 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:13 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:13 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5c6b0ffd54ca <unknown>
#1 0x5c6b0fa54566 <unknown>
#2 0x5c6b0fa8fb4c <unknown>
#3 0x5c6b0fa8b7c4 <unknown>
#4 0x5c6b0fadabd3 <unknown>
#5 0x5c6b0fada286 <unknown>
#6 0x5c6b0facc403 <unknown>
#7 0x5c6b0fa98b02 <unknown>
#8 0x5c6b0fa997c1 <unknown>
#9 0x5c6b0ff99298 <unknown>
#10 0x5c6b0ff9d0ff <unknown>
#11 0x5c6b0ff80729 <unknown>
#12 0x5c6b0ff9dca5 <unknown>
#13 0x5c6b0ff65f8f <unknown>
#14 0x5c6b0ffc2308 <unknown>
#15 0x5c6b0ffc24e3 <unknown>
#16 0x5c6b0ffd4463 <unknown>
#17 0x729531894ac3 <unknown>
2025-10-16 09:42:13 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:13 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:13 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:13 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:13 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 88, UID: d0qzqru59y, 進度: 0/1
2025-10-16 09:42:13 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:13 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:13 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:14 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:14 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5cf369db24e3 <unknown>
#1 0x5cf369ae1c76 <unknown>
#2 0x5cf369b0ad78 <unknown>
#3 0x5cf369b07029 <unknown>
#4 0x5cf369b45ccc <unknown>
#5 0x5cf369b4547f <unknown>
#6 0x5cf369b3cde3 <unknown>
#7 0x5cf369b122dd <unknown>
#8 0x5cf369b1334e <unknown>
#9 0x5cf369d723e4 <unknown>
#10 0x5cf369d763d7 <unknown>
#11 0x5cf369d80b20 <unknown>
#12 0x5cf369d77023 <unknown>
#13 0x5cf369d451aa <unknown>
#14 0x5cf369d9b6b8 <unknown>
#15 0x5cf369d9b847 <unknown>
#16 0x5cf369dab243 <unknown>
#17 0x7d8af6c94ac3 <unknown>
2025-10-16 09:42:14 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:14 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:14 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5b5329a1e4ca <unknown>
#1 0x5b532949d566 <unknown>
#2 0x5b53294d8b4c <unknown>
#3 0x5b53294d47c4 <unknown>
#4 0x5b5329523bd3 <unknown>
#5 0x5b5329523286 <unknown>
#6 0x5b5329515403 <unknown>
#7 0x5b53294e1b02 <unknown>
#8 0x5b53294e27c1 <unknown>
#9 0x5b53299e2298 <unknown>
#10 0x5b53299e60ff <unknown>
#11 0x5b53299c9729 <unknown>
#12 0x5b53299e6ca5 <unknown>
#13 0x5b53299aef8f <unknown>
#14 0x5b5329a0b308 <unknown>
#15 0x5b5329a0b4e3 <unknown>
#16 0x5b5329a1d463 <unknown>
#17 0x7f479be94ac3 <unknown>
2025-10-16 09:42:14 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:14 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:14 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:14 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:14 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:42:14 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:42:14 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:42:18 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 3/3 次請求
2025-10-16 09:42:18 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:18 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:18 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:18 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:18 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:18 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x604092ec54ca <unknown>
#1 0x604092944566 <unknown>
#2 0x60409297fb4c <unknown>
#3 0x60409297b7c4 <unknown>
#4 0x6040929cabd3 <unknown>
#5 0x6040929ca286 <unknown>
#6 0x6040929bc403 <unknown>
#7 0x604092988b02 <unknown>
#8 0x6040929897c1 <unknown>
#9 0x604092e89298 <unknown>
#10 0x604092e8d0ff <unknown>
#11 0x604092e70729 <unknown>
#12 0x604092e8dca5 <unknown>
#13 0x604092e55f8f <unknown>
#14 0x604092eb2308 <unknown>
#15 0x604092eb24e3 <unknown>
#16 0x604092ec4463 <unknown>
#17 0x76a259694ac3 <unknown>
2025-10-16 09:42:18 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:18 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:42:18 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:18 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:42:18 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 141.9MB, CPU 0.0%
2025-10-16 09:42:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 1/5, 隊列大小 0, 總處理任務 0, 記憶體 131.0MB, CPU 0.0%
2025-10-16 09:42:18 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:19 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:19 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:19 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5a2f35e884e3 <unknown>
#1 0x5a2f35bb7c76 <unknown>
#2 0x5a2f35be0d78 <unknown>
#3 0x5a2f35bdd029 <unknown>
#4 0x5a2f35c1bccc <unknown>
#5 0x5a2f35c1b47f <unknown>
#6 0x5a2f35c12de3 <unknown>
#7 0x5a2f35be82dd <unknown>
#8 0x5a2f35be934e <unknown>
#9 0x5a2f35e483e4 <unknown>
#10 0x5a2f35e4c3d7 <unknown>
#11 0x5a2f35e56b20 <unknown>
#12 0x5a2f35e4d023 <unknown>
#13 0x5a2f35e1b1aa <unknown>
#14 0x5a2f35e716b8 <unknown>
#15 0x5a2f35e71847 <unknown>
#16 0x5a2f35e81243 <unknown>
#17 0x758370e94ac3 <unknown>
2025-10-16 09:42:19 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:19 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:19 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5ccbcf3f24ca <unknown>
#1 0x5ccbcee71566 <unknown>
#2 0x5ccbceeacb4c <unknown>
#3 0x5ccbceea87c4 <unknown>
#4 0x5ccbceef7bd3 <unknown>
#5 0x5ccbceef7286 <unknown>
#6 0x5ccbceee9403 <unknown>
#7 0x5ccbceeb5b02 <unknown>
#8 0x5ccbceeb67c1 <unknown>
#9 0x5ccbcf3b6298 <unknown>
#10 0x5ccbcf3ba0ff <unknown>
#11 0x5ccbcf39d729 <unknown>
#12 0x5ccbcf3baca5 <unknown>
#13 0x5ccbcf382f8f <unknown>
#14 0x5ccbcf3df308 <unknown>
#15 0x5ccbcf3df4e3 <unknown>
#16 0x5ccbcf3f1463 <unknown>
#17 0x71f5bdc94ac3 <unknown>
2025-10-16 09:42:19 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:19 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:19 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:19 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:19 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:19 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:19 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:19 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:19 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:19 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:19 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:19 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x61fce1e574ca <unknown>
#1 0x61fce18d6566 <unknown>
#2 0x61fce1911b4c <unknown>
#3 0x61fce190d7c4 <unknown>
#4 0x61fce195cbd3 <unknown>
#5 0x61fce195c286 <unknown>
#6 0x61fce194e403 <unknown>
#7 0x61fce191ab02 <unknown>
#8 0x61fce191b7c1 <unknown>
#9 0x61fce1e1b298 <unknown>
#10 0x61fce1e1f0ff <unknown>
#11 0x61fce1e02729 <unknown>
#12 0x61fce1e1fca5 <unknown>
#13 0x61fce1de7f8f <unknown>
#14 0x61fce1e44308 <unknown>
#15 0x61fce1e444e3 <unknown>
#16 0x61fce1e56463 <unknown>
#17 0x7bc3eb494ac3 <unknown>
2025-10-16 09:42:19 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:19 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:19 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:19 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:19 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:42:19 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:42:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:42:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:42:20 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:20 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x59455dd874e3 <unknown>
#1 0x59455dab6c76 <unknown>
#2 0x59455dadfd78 <unknown>
#3 0x59455dadc029 <unknown>
#4 0x59455db1accc <unknown>
#5 0x59455db1a47f <unknown>
#6 0x59455db11de3 <unknown>
#7 0x59455dae72dd <unknown>
#8 0x59455dae834e <unknown>
#9 0x59455dd473e4 <unknown>
#10 0x59455dd4b3d7 <unknown>
#11 0x59455dd55b20 <unknown>
#12 0x59455dd4c023 <unknown>
#13 0x59455dd1a1aa <unknown>
#14 0x59455dd706b8 <unknown>
#15 0x59455dd70847 <unknown>
#16 0x59455dd80243 <unknown>
#17 0x7681ff894ac3 <unknown>
2025-10-16 09:42:20 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:20 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5933872904ca <unknown>
#1 0x593386d0f566 <unknown>
#2 0x593386d4ab4c <unknown>
#3 0x593386d467c4 <unknown>
#4 0x593386d95bd3 <unknown>
#5 0x593386d95286 <unknown>
#6 0x593386d87403 <unknown>
#7 0x593386d53b02 <unknown>
#8 0x593386d547c1 <unknown>
#9 0x593387254298 <unknown>
#10 0x5933872580ff <unknown>
#11 0x59338723b729 <unknown>
#12 0x593387258ca5 <unknown>
#13 0x593387220f8f <unknown>
#14 0x59338727d308 <unknown>
#15 0x59338727d4e3 <unknown>
#16 0x59338728f463 <unknown>
#17 0x72e3d0494ac3 <unknown>
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:42:20 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:42:20 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (2/2): WebDriver 創建失敗
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:42:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:42:23 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 3/3, force_new_driver=False)
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://www.ecpay.com.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 1/3 次請求
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:23 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 88, UID: d0qzqru59y, 進度: 0/1
2025-10-16 09:42:23 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f6e3e6654ca <unknown>
#1 0x5f6e3e0e4566 <unknown>
#2 0x5f6e3e11fb4c <unknown>
#3 0x5f6e3e11b7c4 <unknown>
#4 0x5f6e3e16abd3 <unknown>
#5 0x5f6e3e16a286 <unknown>
#6 0x5f6e3e15c403 <unknown>
#7 0x5f6e3e128b02 <unknown>
#8 0x5f6e3e1297c1 <unknown>
#9 0x5f6e3e629298 <unknown>
#10 0x5f6e3e62d0ff <unknown>
#11 0x5f6e3e610729 <unknown>
#12 0x5f6e3e62dca5 <unknown>
#13 0x5f6e3e5f5f8f <unknown>
#14 0x5f6e3e652308 <unknown>
#15 0x5f6e3e6524e3 <unknown>
#16 0x5f6e3e664463 <unknown>
#17 0x785fbf294ac3 <unknown>
2025-10-16 09:42:23 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:23 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:23 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:23 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:23 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:24 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:24 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x6287d1d054e3 <unknown>
#1 0x6287d1a34c76 <unknown>
#2 0x6287d1a5dd78 <unknown>
#3 0x6287d1a5a029 <unknown>
#4 0x6287d1a98ccc <unknown>
#5 0x6287d1a9847f <unknown>
#6 0x6287d1a8fde3 <unknown>
#7 0x6287d1a652dd <unknown>
#8 0x6287d1a6634e <unknown>
#9 0x6287d1cc53e4 <unknown>
#10 0x6287d1cc93d7 <unknown>
#11 0x6287d1cd3b20 <unknown>
#12 0x6287d1cca023 <unknown>
#13 0x6287d1c981aa <unknown>
#14 0x6287d1cee6b8 <unknown>
#15 0x6287d1cee847 <unknown>
#16 0x6287d1cfe243 <unknown>
#17 0x7213a7a94ac3 <unknown>
2025-10-16 09:42:24 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:24 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:24 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5c04600a64ca <unknown>
#1 0x5c045fb25566 <unknown>
#2 0x5c045fb60b4c <unknown>
#3 0x5c045fb5c7c4 <unknown>
#4 0x5c045fbabbd3 <unknown>
#5 0x5c045fbab286 <unknown>
#6 0x5c045fb9d403 <unknown>
#7 0x5c045fb69b02 <unknown>
#8 0x5c045fb6a7c1 <unknown>
#9 0x5c046006a298 <unknown>
#10 0x5c046006e0ff <unknown>
#11 0x5c0460051729 <unknown>
#12 0x5c046006eca5 <unknown>
#13 0x5c0460036f8f <unknown>
#14 0x5c0460093308 <unknown>
#15 0x5c04600934e3 <unknown>
#16 0x5c04600a5463 <unknown>
#17 0x7f805ba94ac3 <unknown>
2025-10-16 09:42:24 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:24 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:24 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:24 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:24 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:24 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:24 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:24 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:24 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:24 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:24 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:24 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a15cb9324ca <unknown>
#1 0x5a15cb3b1566 <unknown>
#2 0x5a15cb3ecb4c <unknown>
#3 0x5a15cb3e87c4 <unknown>
#4 0x5a15cb437bd3 <unknown>
#5 0x5a15cb437286 <unknown>
#6 0x5a15cb429403 <unknown>
#7 0x5a15cb3f5b02 <unknown>
#8 0x5a15cb3f67c1 <unknown>
#9 0x5a15cb8f6298 <unknown>
#10 0x5a15cb8fa0ff <unknown>
#11 0x5a15cb8dd729 <unknown>
#12 0x5a15cb8faca5 <unknown>
#13 0x5a15cb8c2f8f <unknown>
#14 0x5a15cb91f308 <unknown>
#15 0x5a15cb91f4e3 <unknown>
#16 0x5a15cb931463 <unknown>
#17 0x761422a94ac3 <unknown>
2025-10-16 09:42:24 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:24 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:24 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:25 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:25 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:25 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:25 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:25 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5a2b626d14e3 <unknown>
#1 0x5a2b62400c76 <unknown>
#2 0x5a2b62429d78 <unknown>
#3 0x5a2b62426029 <unknown>
#4 0x5a2b62464ccc <unknown>
#5 0x5a2b6246447f <unknown>
#6 0x5a2b6245bde3 <unknown>
#7 0x5a2b624312dd <unknown>
#8 0x5a2b6243234e <unknown>
#9 0x5a2b626913e4 <unknown>
#10 0x5a2b626953d7 <unknown>
#11 0x5a2b6269fb20 <unknown>
#12 0x5a2b62696023 <unknown>
#13 0x5a2b626641aa <unknown>
#14 0x5a2b626ba6b8 <unknown>
#15 0x5a2b626ba847 <unknown>
#16 0x5a2b626ca243 <unknown>
#17 0x760a46694ac3 <unknown>
2025-10-16 09:42:25 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:25 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:25 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x611cd6d754ca <unknown>
#1 0x611cd67f4566 <unknown>
#2 0x611cd682fb4c <unknown>
#3 0x611cd682b7c4 <unknown>
#4 0x611cd687abd3 <unknown>
#5 0x611cd687a286 <unknown>
#6 0x611cd686c403 <unknown>
#7 0x611cd6838b02 <unknown>
#8 0x611cd68397c1 <unknown>
#9 0x611cd6d39298 <unknown>
#10 0x611cd6d3d0ff <unknown>
#11 0x611cd6d20729 <unknown>
#12 0x611cd6d3dca5 <unknown>
#13 0x611cd6d05f8f <unknown>
#14 0x611cd6d62308 <unknown>
#15 0x611cd6d624e3 <unknown>
#16 0x611cd6d74463 <unknown>
#17 0x7e7e12c94ac3 <unknown>
2025-10-16 09:42:25 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:25 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:25 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:25 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:25 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:42:25 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:42:25 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:42:27 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 2/3 次請求
2025-10-16 09:42:27 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:27 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:27 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:27 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:27 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:27 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x62e194ccc4ca <unknown>
#1 0x62e19474b566 <unknown>
#2 0x62e194786b4c <unknown>
#3 0x62e1947827c4 <unknown>
#4 0x62e1947d1bd3 <unknown>
#5 0x62e1947d1286 <unknown>
#6 0x62e1947c3403 <unknown>
#7 0x62e19478fb02 <unknown>
#8 0x62e1947907c1 <unknown>
#9 0x62e194c90298 <unknown>
#10 0x62e194c940ff <unknown>
#11 0x62e194c77729 <unknown>
#12 0x62e194c94ca5 <unknown>
#13 0x62e194c5cf8f <unknown>
#14 0x62e194cb9308 <unknown>
#15 0x62e194cb94e3 <unknown>
#16 0x62e194ccb463 <unknown>
#17 0x729b3da94ac3 <unknown>
2025-10-16 09:42:27 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:27 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:27 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:28 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:28 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:28 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:28 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:28 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:28 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x57032b30c4e3 <unknown>
#1 0x57032b03bc76 <unknown>
#2 0x57032b064d78 <unknown>
#3 0x57032b061029 <unknown>
#4 0x57032b09fccc <unknown>
#5 0x57032b09f47f <unknown>
#6 0x57032b096de3 <unknown>
#7 0x57032b06c2dd <unknown>
#8 0x57032b06d34e <unknown>
#9 0x57032b2cc3e4 <unknown>
#10 0x57032b2d03d7 <unknown>
#11 0x57032b2dab20 <unknown>
#12 0x57032b2d1023 <unknown>
#13 0x57032b29f1aa <unknown>
#14 0x57032b2f56b8 <unknown>
#15 0x57032b2f5847 <unknown>
#16 0x57032b305243 <unknown>
#17 0x7213ed294ac3 <unknown>
2025-10-16 09:42:28 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:28 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:28 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x62c2b0baa4ca <unknown>
#1 0x62c2b0629566 <unknown>
#2 0x62c2b0664b4c <unknown>
#3 0x62c2b06607c4 <unknown>
#4 0x62c2b06afbd3 <unknown>
#5 0x62c2b06af286 <unknown>
#6 0x62c2b06a1403 <unknown>
#7 0x62c2b066db02 <unknown>
#8 0x62c2b066e7c1 <unknown>
#9 0x62c2b0b6e298 <unknown>
#10 0x62c2b0b720ff <unknown>
#11 0x62c2b0b55729 <unknown>
#12 0x62c2b0b72ca5 <unknown>
#13 0x62c2b0b3af8f <unknown>
#14 0x62c2b0b97308 <unknown>
#15 0x62c2b0b974e3 <unknown>
#16 0x62c2b0ba9463 <unknown>
#17 0x7db984294ac3 <unknown>
2025-10-16 09:42:28 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:28 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:28 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:28 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:28 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:28 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:28 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:28 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:28 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:28 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:28 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:28 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5d86b68974ca <unknown>
#1 0x5d86b6316566 <unknown>
#2 0x5d86b6351b4c <unknown>
#3 0x5d86b634d7c4 <unknown>
#4 0x5d86b639cbd3 <unknown>
#5 0x5d86b639c286 <unknown>
#6 0x5d86b638e403 <unknown>
#7 0x5d86b635ab02 <unknown>
#8 0x5d86b635b7c1 <unknown>
#9 0x5d86b685b298 <unknown>
#10 0x5d86b685f0ff <unknown>
#11 0x5d86b6842729 <unknown>
#12 0x5d86b685fca5 <unknown>
#13 0x5d86b6827f8f <unknown>
#14 0x5d86b6884308 <unknown>
#15 0x5d86b68844e3 <unknown>
#16 0x5d86b6896463 <unknown>
#17 0x7cf61dc94ac3 <unknown>
2025-10-16 09:42:28 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:28 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:29 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:29 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:29 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:29 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5985e8a5c4e3 <unknown>
#1 0x5985e878bc76 <unknown>
#2 0x5985e87b4d78 <unknown>
#3 0x5985e87b1029 <unknown>
#4 0x5985e87efccc <unknown>
#5 0x5985e87ef47f <unknown>
#6 0x5985e87e6de3 <unknown>
#7 0x5985e87bc2dd <unknown>
#8 0x5985e87bd34e <unknown>
#9 0x5985e8a1c3e4 <unknown>
#10 0x5985e8a203d7 <unknown>
#11 0x5985e8a2ab20 <unknown>
#12 0x5985e8a21023 <unknown>
#13 0x5985e89ef1aa <unknown>
#14 0x5985e8a456b8 <unknown>
#15 0x5985e8a45847 <unknown>
#16 0x5985e8a55243 <unknown>
#17 0x7fb7b9694ac3 <unknown>
2025-10-16 09:42:29 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:29 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:29 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5845680ef4ca <unknown>
#1 0x584567b6e566 <unknown>
#2 0x584567ba9b4c <unknown>
#3 0x584567ba57c4 <unknown>
#4 0x584567bf4bd3 <unknown>
#5 0x584567bf4286 <unknown>
#6 0x584567be6403 <unknown>
#7 0x584567bb2b02 <unknown>
#8 0x584567bb37c1 <unknown>
#9 0x5845680b3298 <unknown>
#10 0x5845680b70ff <unknown>
#11 0x58456809a729 <unknown>
#12 0x5845680b7ca5 <unknown>
#13 0x58456807ff8f <unknown>
#14 0x5845680dc308 <unknown>
#15 0x5845680dc4e3 <unknown>
#16 0x5845680ee463 <unknown>
#17 0x779816c94ac3 <unknown>
2025-10-16 09:42:29 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:29 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:29 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:29 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:29 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:42:29 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:42:29 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:42:33 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 88, UID: d0qzqru59y, 進度: 0/1
2025-10-16 09:42:33 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 3/3 次請求
2025-10-16 09:42:33 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:33 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:33 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:33 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:33 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:34 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x594fa8d674ca <unknown>
#1 0x594fa87e6566 <unknown>
#2 0x594fa8821b4c <unknown>
#3 0x594fa881d7c4 <unknown>
#4 0x594fa886cbd3 <unknown>
#5 0x594fa886c286 <unknown>
#6 0x594fa885e403 <unknown>
#7 0x594fa882ab02 <unknown>
#8 0x594fa882b7c1 <unknown>
#9 0x594fa8d2b298 <unknown>
#10 0x594fa8d2f0ff <unknown>
#11 0x594fa8d12729 <unknown>
#12 0x594fa8d2fca5 <unknown>
#13 0x594fa8cf7f8f <unknown>
#14 0x594fa8d54308 <unknown>
#15 0x594fa8d544e3 <unknown>
#16 0x594fa8d66463 <unknown>
#17 0x7edbb9c94ac3 <unknown>
2025-10-16 09:42:34 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:34 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:34 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:34 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:34 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:34 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:34 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:34 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:34 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x58bdedf7c4e3 <unknown>
#1 0x58bdedcabc76 <unknown>
#2 0x58bdedcd4d78 <unknown>
#3 0x58bdedcd1029 <unknown>
#4 0x58bdedd0fccc <unknown>
#5 0x58bdedd0f47f <unknown>
#6 0x58bdedd06de3 <unknown>
#7 0x58bdedcdc2dd <unknown>
#8 0x58bdedcdd34e <unknown>
#9 0x58bdedf3c3e4 <unknown>
#10 0x58bdedf403d7 <unknown>
#11 0x58bdedf4ab20 <unknown>
#12 0x58bdedf41023 <unknown>
#13 0x58bdedf0f1aa <unknown>
#14 0x58bdedf656b8 <unknown>
#15 0x58bdedf65847 <unknown>
#16 0x58bdedf75243 <unknown>
#17 0x7090df694ac3 <unknown>
2025-10-16 09:42:34 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:34 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:35 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5ea171e5c4ca <unknown>
#1 0x5ea1718db566 <unknown>
#2 0x5ea171916b4c <unknown>
#3 0x5ea1719127c4 <unknown>
#4 0x5ea171961bd3 <unknown>
#5 0x5ea171961286 <unknown>
#6 0x5ea171953403 <unknown>
#7 0x5ea17191fb02 <unknown>
#8 0x5ea1719207c1 <unknown>
#9 0x5ea171e20298 <unknown>
#10 0x5ea171e240ff <unknown>
#11 0x5ea171e07729 <unknown>
#12 0x5ea171e24ca5 <unknown>
#13 0x5ea171decf8f <unknown>
#14 0x5ea171e49308 <unknown>
#15 0x5ea171e494e3 <unknown>
#16 0x5ea171e5b463 <unknown>
#17 0x7e39e2c94ac3 <unknown>
2025-10-16 09:42:35 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:35 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:35 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:35 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:35 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:35 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:42:35 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:42:35 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:42:35 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:42:35 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:42:35 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:42:35 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x61a171e264ca <unknown>
#1 0x61a1718a5566 <unknown>
#2 0x61a1718e0b4c <unknown>
#3 0x61a1718dc7c4 <unknown>
#4 0x61a17192bbd3 <unknown>
#5 0x61a17192b286 <unknown>
#6 0x61a17191d403 <unknown>
#7 0x61a1718e9b02 <unknown>
#8 0x61a1718ea7c1 <unknown>
#9 0x61a171dea298 <unknown>
#10 0x61a171dee0ff <unknown>
#11 0x61a171dd1729 <unknown>
#12 0x61a171deeca5 <unknown>
#13 0x61a171db6f8f <unknown>
#14 0x61a171e13308 <unknown>
#15 0x61a171e134e3 <unknown>
#16 0x61a171e25463 <unknown>
#17 0x78e8b0e94ac3 <unknown>
2025-10-16 09:42:35 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:42:35 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:42:35 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:35 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:42:35 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:42:35 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:35 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:42:36 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5e45380624e3 <unknown>
#1 0x5e4537d91c76 <unknown>
#2 0x5e4537dbad78 <unknown>
#3 0x5e4537db7029 <unknown>
#4 0x5e4537df5ccc <unknown>
#5 0x5e4537df547f <unknown>
#6 0x5e4537decde3 <unknown>
#7 0x5e4537dc22dd <unknown>
#8 0x5e4537dc334e <unknown>
#9 0x5e45380223e4 <unknown>
#10 0x5e45380263d7 <unknown>
#11 0x5e4538030b20 <unknown>
#12 0x5e4538027023 <unknown>
#13 0x5e4537ff51aa <unknown>
#14 0x5e453804b6b8 <unknown>
#15 0x5e453804b847 <unknown>
#16 0x5e453805b243 <unknown>
#17 0x7e9ce3694ac3 <unknown>
2025-10-16 09:42:36 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:42:36 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a2b672db4ca <unknown>
#1 0x5a2b66d5a566 <unknown>
#2 0x5a2b66d95b4c <unknown>
#3 0x5a2b66d917c4 <unknown>
#4 0x5a2b66de0bd3 <unknown>
#5 0x5a2b66de0286 <unknown>
#6 0x5a2b66dd2403 <unknown>
#7 0x5a2b66d9eb02 <unknown>
#8 0x5a2b66d9f7c1 <unknown>
#9 0x5a2b6729f298 <unknown>
#10 0x5a2b672a30ff <unknown>
#11 0x5a2b67286729 <unknown>
#12 0x5a2b672a3ca5 <unknown>
#13 0x5a2b6726bf8f <unknown>
#14 0x5a2b672c8308 <unknown>
#15 0x5a2b672c84e3 <unknown>
#16 0x5a2b672da463 <unknown>
#17 0x7d8a20294ac3 <unknown>
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:42:36 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:42:36 - ERROR - main - [url_processor.py:123] - process_url - 達到最大重試次數,放棄獲取 URL: https://www.ecpay.com.tw/
2025-10-16 09:42:36 - ERROR - main - [url_processor.py:640] - process_url - 處理 URL 時發生未預期錯誤: WebDriver 創建失敗
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/processing/url_processor.py", line 98, in process_url
html_content, title, final_url = web_scraper.get_content(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:42:36 - INFO - database - [database.py:505] - update_url_status - URL ID 88 状态已更新为 error
2025-10-16 09:42:36 - INFO - main - [url_processor.py:653] - process_url - 工作線程 #1 完成處理 URL ID: 88
2025-10-16 09:43:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:43:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:43:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:43:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:43:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:43:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:43:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:43:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:43:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:43:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.8MB, CPU 0.0%
2025-10-16 09:43:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 142.5MB, CPU 0.0%
2025-10-16 09:43:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 127.6MB, CPU 0.0%
2025-10-16 09:44:19 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:44:19 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:44:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:44:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:44:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:44:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:44:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:44:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:45:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:45:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.8MB, CPU 0.0%
2025-10-16 09:45:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 142.5MB, CPU 0.0%
2025-10-16 09:45:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 127.6MB, CPU 0.0%
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:45:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:45:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:45:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:45:26 - ERROR - main - [main.py:200] - handle_api_exception - 網頁錯誤 [/]: 405 Method Not Allowed: The method is not allowed for the requested URL.
Traceback (most recent call last):
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/flask/app.py", line 917, in full_dispatch_request
rv = self.dispatch_request()
^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/flask/app.py", line 891, in dispatch_request
self.raise_routing_exception(req)
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/flask/app.py", line 500, in raise_routing_exception
raise request.routing_exception # type: ignore[misc]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/flask/ctx.py", line 362, in match_request
result = self.url_adapter.match(return_rule=True) # type: ignore
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/venv/lib/python3.11/site-packages/werkzeug/routing/map.py", line 624, in match
raise MethodNotAllowed(valid_methods=list(e.have_match_for)) from None
werkzeug.exceptions.MethodNotAllowed: 405 Method Not Allowed: The method is not allowed for the requested URL.
2025-10-16 09:46:18 - INFO - database - [database.py:420] - process_url - UI 提交生成 UID: aoej6tlh5a
2025-10-16 09:46:18 - INFO - database - [database.py:426] - process_url - UI 提交 URL https://sanran.1shop.tw/,結果將立即顯示
2025-10-16 09:46:18 - INFO - main - [web_routes.py:115] - submit_url - UI 提交,URL ID: 89, Phone: 0918919373, Email: milk811228@yahoo.com.tw
2025-10-16 09:46:18 - INFO - database - [database.py:536] - get_pending_url - 找到待处理的 URL: ID=89, URL=https://sanran.1shop.tw/
2025-10-16 09:46:18 - INFO - main - [request_processor.py:690] - process_pending_urls - 已添加 1 個 URL 到處理隊列
2025-10-16 09:46:18 - INFO - main - [url_processor.py:42] - process_url - 工作線程 #2 開始處理 URL ID: 89
2025-10-16 09:46:18 - INFO - main - [url_processor.py:83] - process_url - 分析 URL: https://sanran.1shop.tw/
2025-10-16 09:46:18 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 1/3, force_new_driver=False)
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://sanran.1shop.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 1/3 次請求
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:18 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5de87e5ae4ca <unknown>
#1 0x5de87e02d566 <unknown>
#2 0x5de87e068b4c <unknown>
#3 0x5de87e0647c4 <unknown>
#4 0x5de87e0b3bd3 <unknown>
#5 0x5de87e0b3286 <unknown>
#6 0x5de87e0a5403 <unknown>
#7 0x5de87e071b02 <unknown>
#8 0x5de87e0727c1 <unknown>
#9 0x5de87e572298 <unknown>
#10 0x5de87e5760ff <unknown>
#11 0x5de87e559729 <unknown>
#12 0x5de87e576ca5 <unknown>
#13 0x5de87e53ef8f <unknown>
#14 0x5de87e59b308 <unknown>
#15 0x5de87e59b4e3 <unknown>
#16 0x5de87e5ad463 <unknown>
#17 0x768a79294ac3 <unknown>
2025-10-16 09:46:18 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:18 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:18 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:18 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:18 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:18 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:19 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:19 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:19 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x643a37dbc4e3 <unknown>
#1 0x643a37aebc76 <unknown>
#2 0x643a37b14d78 <unknown>
#3 0x643a37b11029 <unknown>
#4 0x643a37b4fccc <unknown>
#5 0x643a37b4f47f <unknown>
#6 0x643a37b46de3 <unknown>
#7 0x643a37b1c2dd <unknown>
#8 0x643a37b1d34e <unknown>
#9 0x643a37d7c3e4 <unknown>
#10 0x643a37d803d7 <unknown>
#11 0x643a37d8ab20 <unknown>
#12 0x643a37d81023 <unknown>
#13 0x643a37d4f1aa <unknown>
#14 0x643a37da56b8 <unknown>
#15 0x643a37da5847 <unknown>
#16 0x643a37db5243 <unknown>
#17 0x7e2593094ac3 <unknown>
2025-10-16 09:46:19 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:19 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:19 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x620d4eea04ca <unknown>
#1 0x620d4e91f566 <unknown>
#2 0x620d4e95ab4c <unknown>
#3 0x620d4e9567c4 <unknown>
#4 0x620d4e9a5bd3 <unknown>
#5 0x620d4e9a5286 <unknown>
#6 0x620d4e997403 <unknown>
#7 0x620d4e963b02 <unknown>
#8 0x620d4e9647c1 <unknown>
#9 0x620d4ee64298 <unknown>
#10 0x620d4ee680ff <unknown>
#11 0x620d4ee4b729 <unknown>
#12 0x620d4ee68ca5 <unknown>
#13 0x620d4ee30f8f <unknown>
#14 0x620d4ee8d308 <unknown>
#15 0x620d4ee8d4e3 <unknown>
#16 0x620d4ee9f463 <unknown>
#17 0x7ef89d094ac3 <unknown>
2025-10-16 09:46:19 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:19 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:19 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:19 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:19 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:19 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:19 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:19 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:19 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:19 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:19 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:19 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 89, UID: aoej6tlh5a, 進度: 0/1
2025-10-16 09:46:19 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5b1e29c714ca <unknown>
#1 0x5b1e296f0566 <unknown>
#2 0x5b1e2972bb4c <unknown>
#3 0x5b1e297277c4 <unknown>
#4 0x5b1e29776bd3 <unknown>
#5 0x5b1e29776286 <unknown>
#6 0x5b1e29768403 <unknown>
#7 0x5b1e29734b02 <unknown>
#8 0x5b1e297357c1 <unknown>
#9 0x5b1e29c35298 <unknown>
#10 0x5b1e29c390ff <unknown>
#11 0x5b1e29c1c729 <unknown>
#12 0x5b1e29c39ca5 <unknown>
#13 0x5b1e29c01f8f <unknown>
#14 0x5b1e29c5e308 <unknown>
#15 0x5b1e29c5e4e3 <unknown>
#16 0x5b1e29c70463 <unknown>
#17 0x78e56ee94ac3 <unknown>
2025-10-16 09:46:19 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:19 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:19 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:19 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:19 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:19 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:46:20 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.10 秒,結果: 0
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:46:20 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:46:20 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x6127cd4014e3 <unknown>
#1 0x6127cd130c76 <unknown>
#2 0x6127cd159d78 <unknown>
#3 0x6127cd156029 <unknown>
#4 0x6127cd194ccc <unknown>
#5 0x6127cd19447f <unknown>
#6 0x6127cd18bde3 <unknown>
#7 0x6127cd1612dd <unknown>
#8 0x6127cd16234e <unknown>
#9 0x6127cd3c13e4 <unknown>
#10 0x6127cd3c53d7 <unknown>
#11 0x6127cd3cfb20 <unknown>
#12 0x6127cd3c6023 <unknown>
#13 0x6127cd3941aa <unknown>
#14 0x6127cd3ea6b8 <unknown>
#15 0x6127cd3ea847 <unknown>
#16 0x6127cd3fa243 <unknown>
#17 0x72b1a8c94ac3 <unknown>
2025-10-16 09:46:20 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:20 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:20 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x62ee768fe4ca <unknown>
#1 0x62ee7637d566 <unknown>
#2 0x62ee763b8b4c <unknown>
#3 0x62ee763b47c4 <unknown>
#4 0x62ee76403bd3 <unknown>
#5 0x62ee76403286 <unknown>
#6 0x62ee763f5403 <unknown>
#7 0x62ee763c1b02 <unknown>
#8 0x62ee763c27c1 <unknown>
#9 0x62ee768c2298 <unknown>
#10 0x62ee768c60ff <unknown>
#11 0x62ee768a9729 <unknown>
#12 0x62ee768c6ca5 <unknown>
#13 0x62ee7688ef8f <unknown>
#14 0x62ee768eb308 <unknown>
#15 0x62ee768eb4e3 <unknown>
#16 0x62ee768fd463 <unknown>
#17 0x758328094ac3 <unknown>
2025-10-16 09:46:20 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:20 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:20 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:20 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:20 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:46:20 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:46:20 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:46:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.06 秒,結果: 0
2025-10-16 09:46:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:46:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.06 秒,結果: 0
2025-10-16 09:46:22 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 2/3 次請求
2025-10-16 09:46:22 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:22 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:22 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:22 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:22 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:22 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5e3f7a54f4ca <unknown>
#1 0x5e3f79fce566 <unknown>
#2 0x5e3f7a009b4c <unknown>
#3 0x5e3f7a0057c4 <unknown>
#4 0x5e3f7a054bd3 <unknown>
#5 0x5e3f7a054286 <unknown>
#6 0x5e3f7a046403 <unknown>
#7 0x5e3f7a012b02 <unknown>
#8 0x5e3f7a0137c1 <unknown>
#9 0x5e3f7a513298 <unknown>
#10 0x5e3f7a5170ff <unknown>
#11 0x5e3f7a4fa729 <unknown>
#12 0x5e3f7a517ca5 <unknown>
#13 0x5e3f7a4dff8f <unknown>
#14 0x5e3f7a53c308 <unknown>
#15 0x5e3f7a53c4e3 <unknown>
#16 0x5e3f7a54e463 <unknown>
#17 0x7b2861694ac3 <unknown>
2025-10-16 09:46:22 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:22 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:22 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:22 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:22 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:23 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:23 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:23 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:23 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5dc41e7bb4e3 <unknown>
#1 0x5dc41e4eac76 <unknown>
#2 0x5dc41e513d78 <unknown>
#3 0x5dc41e510029 <unknown>
#4 0x5dc41e54eccc <unknown>
#5 0x5dc41e54e47f <unknown>
#6 0x5dc41e545de3 <unknown>
#7 0x5dc41e51b2dd <unknown>
#8 0x5dc41e51c34e <unknown>
#9 0x5dc41e77b3e4 <unknown>
#10 0x5dc41e77f3d7 <unknown>
#11 0x5dc41e789b20 <unknown>
#12 0x5dc41e780023 <unknown>
#13 0x5dc41e74e1aa <unknown>
#14 0x5dc41e7a46b8 <unknown>
#15 0x5dc41e7a4847 <unknown>
#16 0x5dc41e7b4243 <unknown>
#17 0x75e515694ac3 <unknown>
2025-10-16 09:46:23 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:23 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:23 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5d13ac6a54ca <unknown>
#1 0x5d13ac124566 <unknown>
#2 0x5d13ac15fb4c <unknown>
#3 0x5d13ac15b7c4 <unknown>
#4 0x5d13ac1aabd3 <unknown>
#5 0x5d13ac1aa286 <unknown>
#6 0x5d13ac19c403 <unknown>
#7 0x5d13ac168b02 <unknown>
#8 0x5d13ac1697c1 <unknown>
#9 0x5d13ac669298 <unknown>
#10 0x5d13ac66d0ff <unknown>
#11 0x5d13ac650729 <unknown>
#12 0x5d13ac66dca5 <unknown>
#13 0x5d13ac635f8f <unknown>
#14 0x5d13ac692308 <unknown>
#15 0x5d13ac6924e3 <unknown>
#16 0x5d13ac6a4463 <unknown>
#17 0x721bd1c94ac3 <unknown>
2025-10-16 09:46:23 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:23 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:23 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:23 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:23 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:23 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:23 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:23 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:23 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:23 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:23 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:23 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5dd204fb34ca <unknown>
#1 0x5dd204a32566 <unknown>
#2 0x5dd204a6db4c <unknown>
#3 0x5dd204a697c4 <unknown>
#4 0x5dd204ab8bd3 <unknown>
#5 0x5dd204ab8286 <unknown>
#6 0x5dd204aaa403 <unknown>
#7 0x5dd204a76b02 <unknown>
#8 0x5dd204a777c1 <unknown>
#9 0x5dd204f77298 <unknown>
#10 0x5dd204f7b0ff <unknown>
#11 0x5dd204f5e729 <unknown>
#12 0x5dd204f7bca5 <unknown>
#13 0x5dd204f43f8f <unknown>
#14 0x5dd204fa0308 <unknown>
#15 0x5dd204fa04e3 <unknown>
#16 0x5dd204fb2463 <unknown>
#17 0x76e13e494ac3 <unknown>
2025-10-16 09:46:23 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:23 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:23 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:23 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:24 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:24 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:24 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:24 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5d102fa334e3 <unknown>
#1 0x5d102f762c76 <unknown>
#2 0x5d102f78bd78 <unknown>
#3 0x5d102f788029 <unknown>
#4 0x5d102f7c6ccc <unknown>
#5 0x5d102f7c647f <unknown>
#6 0x5d102f7bdde3 <unknown>
#7 0x5d102f7932dd <unknown>
#8 0x5d102f79434e <unknown>
#9 0x5d102f9f33e4 <unknown>
#10 0x5d102f9f73d7 <unknown>
#11 0x5d102fa01b20 <unknown>
#12 0x5d102f9f8023 <unknown>
#13 0x5d102f9c61aa <unknown>
#14 0x5d102fa1c6b8 <unknown>
#15 0x5d102fa1c847 <unknown>
#16 0x5d102fa2c243 <unknown>
#17 0x78ac07a94ac3 <unknown>
2025-10-16 09:46:24 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:24 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:24 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f87653c74ca <unknown>
#1 0x5f8764e46566 <unknown>
#2 0x5f8764e81b4c <unknown>
#3 0x5f8764e7d7c4 <unknown>
#4 0x5f8764eccbd3 <unknown>
#5 0x5f8764ecc286 <unknown>
#6 0x5f8764ebe403 <unknown>
#7 0x5f8764e8ab02 <unknown>
#8 0x5f8764e8b7c1 <unknown>
#9 0x5f876538b298 <unknown>
#10 0x5f876538f0ff <unknown>
#11 0x5f8765372729 <unknown>
#12 0x5f876538fca5 <unknown>
#13 0x5f8765357f8f <unknown>
#14 0x5f87653b4308 <unknown>
#15 0x5f87653b44e3 <unknown>
#16 0x5f87653c6463 <unknown>
#17 0x74c44ae94ac3 <unknown>
2025-10-16 09:46:24 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:24 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:24 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:24 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:24 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:46:24 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:46:24 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:46:28 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 3/3 次請求
2025-10-16 09:46:28 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:28 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:28 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:28 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:28 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:28 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5e79386bb4ca <unknown>
#1 0x5e793813a566 <unknown>
#2 0x5e7938175b4c <unknown>
#3 0x5e79381717c4 <unknown>
#4 0x5e79381c0bd3 <unknown>
#5 0x5e79381c0286 <unknown>
#6 0x5e79381b2403 <unknown>
#7 0x5e793817eb02 <unknown>
#8 0x5e793817f7c1 <unknown>
#9 0x5e793867f298 <unknown>
#10 0x5e79386830ff <unknown>
#11 0x5e7938666729 <unknown>
#12 0x5e7938683ca5 <unknown>
#13 0x5e793864bf8f <unknown>
#14 0x5e79386a8308 <unknown>
#15 0x5e79386a84e3 <unknown>
#16 0x5e79386ba463 <unknown>
#17 0x7ea3a5694ac3 <unknown>
2025-10-16 09:46:28 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:28 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:28 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:29 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:29 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:29 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:30 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 89, UID: aoej6tlh5a, 進度: 0/1
2025-10-16 09:46:31 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:31 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:31 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x62c10a5ba4e3 <unknown>
#1 0x62c10a2e9c76 <unknown>
#2 0x62c10a312d78 <unknown>
#3 0x62c10a30f029 <unknown>
#4 0x62c10a34dccc <unknown>
#5 0x62c10a34d47f <unknown>
#6 0x62c10a344de3 <unknown>
#7 0x62c10a31a2dd <unknown>
#8 0x62c10a31b34e <unknown>
#9 0x62c10a57a3e4 <unknown>
#10 0x62c10a57e3d7 <unknown>
#11 0x62c10a588b20 <unknown>
#12 0x62c10a57f023 <unknown>
#13 0x62c10a54d1aa <unknown>
#14 0x62c10a5a36b8 <unknown>
#15 0x62c10a5a3847 <unknown>
#16 0x62c10a5b3243 <unknown>
#17 0x73bf5dc94ac3 <unknown>
2025-10-16 09:46:31 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:31 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:31 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a86532f44ca <unknown>
#1 0x5a8652d73566 <unknown>
#2 0x5a8652daeb4c <unknown>
#3 0x5a8652daa7c4 <unknown>
#4 0x5a8652df9bd3 <unknown>
#5 0x5a8652df9286 <unknown>
#6 0x5a8652deb403 <unknown>
#7 0x5a8652db7b02 <unknown>
#8 0x5a8652db87c1 <unknown>
#9 0x5a86532b8298 <unknown>
#10 0x5a86532bc0ff <unknown>
#11 0x5a865329f729 <unknown>
#12 0x5a86532bcca5 <unknown>
#13 0x5a8653284f8f <unknown>
#14 0x5a86532e1308 <unknown>
#15 0x5a86532e14e3 <unknown>
#16 0x5a86532f3463 <unknown>
#17 0x790424294ac3 <unknown>
2025-10-16 09:46:31 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:31 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:31 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:31 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:31 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:31 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:31 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:31 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:31 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:31 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:31 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:32 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x647207b204ca <unknown>
#1 0x64720759f566 <unknown>
#2 0x6472075dab4c <unknown>
#3 0x6472075d67c4 <unknown>
#4 0x647207625bd3 <unknown>
#5 0x647207625286 <unknown>
#6 0x647207617403 <unknown>
#7 0x6472075e3b02 <unknown>
#8 0x6472075e47c1 <unknown>
#9 0x647207ae4298 <unknown>
#10 0x647207ae80ff <unknown>
#11 0x647207acb729 <unknown>
#12 0x647207ae8ca5 <unknown>
#13 0x647207ab0f8f <unknown>
#14 0x647207b0d308 <unknown>
#15 0x647207b0d4e3 <unknown>
#16 0x647207b1f463 <unknown>
#17 0x705c56294ac3 <unknown>
2025-10-16 09:46:32 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:32 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:32 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:32 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:32 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:32 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:32 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:32 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:32 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5648240704e3 <unknown>
#1 0x564823d9fc76 <unknown>
#2 0x564823dc8d78 <unknown>
#3 0x564823dc5029 <unknown>
#4 0x564823e03ccc <unknown>
#5 0x564823e0347f <unknown>
#6 0x564823dfade3 <unknown>
#7 0x564823dd02dd <unknown>
#8 0x564823dd134e <unknown>
#9 0x5648240303e4 <unknown>
#10 0x5648240343d7 <unknown>
#11 0x56482403eb20 <unknown>
#12 0x564824035023 <unknown>
#13 0x5648240031aa <unknown>
#14 0x5648240596b8 <unknown>
#15 0x564824059847 <unknown>
#16 0x564824069243 <unknown>
#17 0x73ea29c94ac3 <unknown>
2025-10-16 09:46:32 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:32 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:33 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x59c7de96a4ca <unknown>
#1 0x59c7de3e9566 <unknown>
#2 0x59c7de424b4c <unknown>
#3 0x59c7de4207c4 <unknown>
#4 0x59c7de46fbd3 <unknown>
#5 0x59c7de46f286 <unknown>
#6 0x59c7de461403 <unknown>
#7 0x59c7de42db02 <unknown>
#8 0x59c7de42e7c1 <unknown>
#9 0x59c7de92e298 <unknown>
#10 0x59c7de9320ff <unknown>
#11 0x59c7de915729 <unknown>
#12 0x59c7de932ca5 <unknown>
#13 0x59c7de8faf8f <unknown>
#14 0x59c7de957308 <unknown>
#15 0x59c7de9574e3 <unknown>
#16 0x59c7de969463 <unknown>
#17 0x71d00fc94ac3 <unknown>
2025-10-16 09:46:33 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:33 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:33 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:33 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:33 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:46:33 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:46:33 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:46:33 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (1/2): WebDriver 創建失敗
2025-10-16 09:46:36 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 2/3, force_new_driver=False)
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://sanran.1shop.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 1/3 次請求
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:36 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x641f01f9a4ca <unknown>
#1 0x641f01a19566 <unknown>
#2 0x641f01a54b4c <unknown>
#3 0x641f01a507c4 <unknown>
#4 0x641f01a9fbd3 <unknown>
#5 0x641f01a9f286 <unknown>
#6 0x641f01a91403 <unknown>
#7 0x641f01a5db02 <unknown>
#8 0x641f01a5e7c1 <unknown>
#9 0x641f01f5e298 <unknown>
#10 0x641f01f620ff <unknown>
#11 0x641f01f45729 <unknown>
#12 0x641f01f62ca5 <unknown>
#13 0x641f01f2af8f <unknown>
#14 0x641f01f87308 <unknown>
#15 0x641f01f874e3 <unknown>
#16 0x641f01f99463 <unknown>
#17 0x77ad49294ac3 <unknown>
2025-10-16 09:46:36 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:36 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:36 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:36 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:36 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:36 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:36 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:37 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:37 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5a1f7145f4e3 <unknown>
#1 0x5a1f7118ec76 <unknown>
#2 0x5a1f711b7d78 <unknown>
#3 0x5a1f711b4029 <unknown>
#4 0x5a1f711f2ccc <unknown>
#5 0x5a1f711f247f <unknown>
#6 0x5a1f711e9de3 <unknown>
#7 0x5a1f711bf2dd <unknown>
#8 0x5a1f711c034e <unknown>
#9 0x5a1f7141f3e4 <unknown>
#10 0x5a1f714233d7 <unknown>
#11 0x5a1f7142db20 <unknown>
#12 0x5a1f71424023 <unknown>
#13 0x5a1f713f21aa <unknown>
#14 0x5a1f714486b8 <unknown>
#15 0x5a1f71448847 <unknown>
#16 0x5a1f71458243 <unknown>
#17 0x7aca37694ac3 <unknown>
2025-10-16 09:46:37 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:37 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:37 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x63563c5fc4ca <unknown>
#1 0x63563c07b566 <unknown>
#2 0x63563c0b6b4c <unknown>
#3 0x63563c0b27c4 <unknown>
#4 0x63563c101bd3 <unknown>
#5 0x63563c101286 <unknown>
#6 0x63563c0f3403 <unknown>
#7 0x63563c0bfb02 <unknown>
#8 0x63563c0c07c1 <unknown>
#9 0x63563c5c0298 <unknown>
#10 0x63563c5c40ff <unknown>
#11 0x63563c5a7729 <unknown>
#12 0x63563c5c4ca5 <unknown>
#13 0x63563c58cf8f <unknown>
#14 0x63563c5e9308 <unknown>
#15 0x63563c5e94e3 <unknown>
#16 0x63563c5fb463 <unknown>
#17 0x7b91a5c94ac3 <unknown>
2025-10-16 09:46:37 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:37 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:37 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:37 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:37 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:37 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:37 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:37 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:37 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:37 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:37 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:37 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58d0a43434ca <unknown>
#1 0x58d0a3dc2566 <unknown>
#2 0x58d0a3dfdb4c <unknown>
#3 0x58d0a3df97c4 <unknown>
#4 0x58d0a3e48bd3 <unknown>
#5 0x58d0a3e48286 <unknown>
#6 0x58d0a3e3a403 <unknown>
#7 0x58d0a3e06b02 <unknown>
#8 0x58d0a3e077c1 <unknown>
#9 0x58d0a4307298 <unknown>
#10 0x58d0a430b0ff <unknown>
#11 0x58d0a42ee729 <unknown>
#12 0x58d0a430bca5 <unknown>
#13 0x58d0a42d3f8f <unknown>
#14 0x58d0a4330308 <unknown>
#15 0x58d0a43304e3 <unknown>
#16 0x58d0a4342463 <unknown>
#17 0x7c5d4a294ac3 <unknown>
2025-10-16 09:46:37 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:37 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:37 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:37 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:37 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:37 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:37 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:38 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:38 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x58622768c4e3 <unknown>
#1 0x5862273bbc76 <unknown>
#2 0x5862273e4d78 <unknown>
#3 0x5862273e1029 <unknown>
#4 0x58622741fccc <unknown>
#5 0x58622741f47f <unknown>
#6 0x586227416de3 <unknown>
#7 0x5862273ec2dd <unknown>
#8 0x5862273ed34e <unknown>
#9 0x58622764c3e4 <unknown>
#10 0x5862276503d7 <unknown>
#11 0x58622765ab20 <unknown>
#12 0x586227651023 <unknown>
#13 0x58622761f1aa <unknown>
#14 0x5862276756b8 <unknown>
#15 0x586227675847 <unknown>
#16 0x586227685243 <unknown>
#17 0x75b656894ac3 <unknown>
2025-10-16 09:46:38 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:38 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:38 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x61ea642e14ca <unknown>
#1 0x61ea63d60566 <unknown>
#2 0x61ea63d9bb4c <unknown>
#3 0x61ea63d977c4 <unknown>
#4 0x61ea63de6bd3 <unknown>
#5 0x61ea63de6286 <unknown>
#6 0x61ea63dd8403 <unknown>
#7 0x61ea63da4b02 <unknown>
#8 0x61ea63da57c1 <unknown>
#9 0x61ea642a5298 <unknown>
#10 0x61ea642a90ff <unknown>
#11 0x61ea6428c729 <unknown>
#12 0x61ea642a9ca5 <unknown>
#13 0x61ea64271f8f <unknown>
#14 0x61ea642ce308 <unknown>
#15 0x61ea642ce4e3 <unknown>
#16 0x61ea642e0463 <unknown>
#17 0x7b207da94ac3 <unknown>
2025-10-16 09:46:38 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:38 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:38 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:38 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:38 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:46:38 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:46:38 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:46:40 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 2/3 次請求
2025-10-16 09:46:40 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:40 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:40 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:40 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:40 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:40 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5bc44b1274ca <unknown>
#1 0x5bc44aba6566 <unknown>
#2 0x5bc44abe1b4c <unknown>
#3 0x5bc44abdd7c4 <unknown>
#4 0x5bc44ac2cbd3 <unknown>
#5 0x5bc44ac2c286 <unknown>
#6 0x5bc44ac1e403 <unknown>
#7 0x5bc44abeab02 <unknown>
#8 0x5bc44abeb7c1 <unknown>
#9 0x5bc44b0eb298 <unknown>
#10 0x5bc44b0ef0ff <unknown>
#11 0x5bc44b0d2729 <unknown>
#12 0x5bc44b0efca5 <unknown>
#13 0x5bc44b0b7f8f <unknown>
#14 0x5bc44b114308 <unknown>
#15 0x5bc44b1144e3 <unknown>
#16 0x5bc44b126463 <unknown>
#17 0x773e80494ac3 <unknown>
2025-10-16 09:46:40 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:40 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:40 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:40 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:40 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:40 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:41 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:41 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 89, UID: aoej6tlh5a, 進度: 0/1
2025-10-16 09:46:41 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:41 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5f89dcf614e3 <unknown>
#1 0x5f89dcc90c76 <unknown>
#2 0x5f89dccb9d78 <unknown>
#3 0x5f89dccb6029 <unknown>
#4 0x5f89dccf4ccc <unknown>
#5 0x5f89dccf447f <unknown>
#6 0x5f89dccebde3 <unknown>
#7 0x5f89dccc12dd <unknown>
#8 0x5f89dccc234e <unknown>
#9 0x5f89dcf213e4 <unknown>
#10 0x5f89dcf253d7 <unknown>
#11 0x5f89dcf2fb20 <unknown>
#12 0x5f89dcf26023 <unknown>
#13 0x5f89dcef41aa <unknown>
#14 0x5f89dcf4a6b8 <unknown>
#15 0x5f89dcf4a847 <unknown>
#16 0x5f89dcf5a243 <unknown>
#17 0x780a74a94ac3 <unknown>
2025-10-16 09:46:41 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:41 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:41 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5adca0dd24ca <unknown>
#1 0x5adca0851566 <unknown>
#2 0x5adca088cb4c <unknown>
#3 0x5adca08887c4 <unknown>
#4 0x5adca08d7bd3 <unknown>
#5 0x5adca08d7286 <unknown>
#6 0x5adca08c9403 <unknown>
#7 0x5adca0895b02 <unknown>
#8 0x5adca08967c1 <unknown>
#9 0x5adca0d96298 <unknown>
#10 0x5adca0d9a0ff <unknown>
#11 0x5adca0d7d729 <unknown>
#12 0x5adca0d9aca5 <unknown>
#13 0x5adca0d62f8f <unknown>
#14 0x5adca0dbf308 <unknown>
#15 0x5adca0dbf4e3 <unknown>
#16 0x5adca0dd1463 <unknown>
#17 0x753783094ac3 <unknown>
2025-10-16 09:46:41 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:41 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:41 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:41 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:41 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:41 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:41 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:41 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:41 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:41 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:41 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:41 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5d115d16c4ca <unknown>
#1 0x5d115cbeb566 <unknown>
#2 0x5d115cc26b4c <unknown>
#3 0x5d115cc227c4 <unknown>
#4 0x5d115cc71bd3 <unknown>
#5 0x5d115cc71286 <unknown>
#6 0x5d115cc63403 <unknown>
#7 0x5d115cc2fb02 <unknown>
#8 0x5d115cc307c1 <unknown>
#9 0x5d115d130298 <unknown>
#10 0x5d115d1340ff <unknown>
#11 0x5d115d117729 <unknown>
#12 0x5d115d134ca5 <unknown>
#13 0x5d115d0fcf8f <unknown>
#14 0x5d115d159308 <unknown>
#15 0x5d115d1594e3 <unknown>
#16 0x5d115d16b463 <unknown>
#17 0x78cd15494ac3 <unknown>
2025-10-16 09:46:41 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:41 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:41 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:41 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:41 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:41 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:42 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:42 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:42 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5fa4a5b364e3 <unknown>
#1 0x5fa4a5865c76 <unknown>
#2 0x5fa4a588ed78 <unknown>
#3 0x5fa4a588b029 <unknown>
#4 0x5fa4a58c9ccc <unknown>
#5 0x5fa4a58c947f <unknown>
#6 0x5fa4a58c0de3 <unknown>
#7 0x5fa4a58962dd <unknown>
#8 0x5fa4a589734e <unknown>
#9 0x5fa4a5af63e4 <unknown>
#10 0x5fa4a5afa3d7 <unknown>
#11 0x5fa4a5b04b20 <unknown>
#12 0x5fa4a5afb023 <unknown>
#13 0x5fa4a5ac91aa <unknown>
#14 0x5fa4a5b1f6b8 <unknown>
#15 0x5fa4a5b1f847 <unknown>
#16 0x5fa4a5b2f243 <unknown>
#17 0x7ad56f294ac3 <unknown>
2025-10-16 09:46:42 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:42 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:42 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58b4679634ca <unknown>
#1 0x58b4673e2566 <unknown>
#2 0x58b46741db4c <unknown>
#3 0x58b4674197c4 <unknown>
#4 0x58b467468bd3 <unknown>
#5 0x58b467468286 <unknown>
#6 0x58b46745a403 <unknown>
#7 0x58b467426b02 <unknown>
#8 0x58b4674277c1 <unknown>
#9 0x58b467927298 <unknown>
#10 0x58b46792b0ff <unknown>
#11 0x58b46790e729 <unknown>
#12 0x58b46792bca5 <unknown>
#13 0x58b4678f3f8f <unknown>
#14 0x58b467950308 <unknown>
#15 0x58b4679504e3 <unknown>
#16 0x58b467962463 <unknown>
#17 0x70a968694ac3 <unknown>
2025-10-16 09:46:42 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:42 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:42 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:42 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:42 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:46:42 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:46:42 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:46:46 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 3/3 次請求
2025-10-16 09:46:46 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:46 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:46 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:46 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:46 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:46 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x596909e7a4ca <unknown>
#1 0x5969098f9566 <unknown>
#2 0x596909934b4c <unknown>
#3 0x5969099307c4 <unknown>
#4 0x59690997fbd3 <unknown>
#5 0x59690997f286 <unknown>
#6 0x596909971403 <unknown>
#7 0x59690993db02 <unknown>
#8 0x59690993e7c1 <unknown>
#9 0x596909e3e298 <unknown>
#10 0x596909e420ff <unknown>
#11 0x596909e25729 <unknown>
#12 0x596909e42ca5 <unknown>
#13 0x596909e0af8f <unknown>
#14 0x596909e67308 <unknown>
#15 0x596909e674e3 <unknown>
#16 0x596909e79463 <unknown>
#17 0x7570cc894ac3 <unknown>
2025-10-16 09:46:46 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:46 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:46 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:46 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:46 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:47 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:47 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:47 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:47 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5aeb5a2414e3 <unknown>
#1 0x5aeb59f70c76 <unknown>
#2 0x5aeb59f99d78 <unknown>
#3 0x5aeb59f96029 <unknown>
#4 0x5aeb59fd4ccc <unknown>
#5 0x5aeb59fd447f <unknown>
#6 0x5aeb59fcbde3 <unknown>
#7 0x5aeb59fa12dd <unknown>
#8 0x5aeb59fa234e <unknown>
#9 0x5aeb5a2013e4 <unknown>
#10 0x5aeb5a2053d7 <unknown>
#11 0x5aeb5a20fb20 <unknown>
#12 0x5aeb5a206023 <unknown>
#13 0x5aeb5a1d41aa <unknown>
#14 0x5aeb5a22a6b8 <unknown>
#15 0x5aeb5a22a847 <unknown>
#16 0x5aeb5a23a243 <unknown>
#17 0x7feb33e94ac3 <unknown>
2025-10-16 09:46:47 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:47 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:47 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58c5d41f84ca <unknown>
#1 0x58c5d3c77566 <unknown>
#2 0x58c5d3cb2b4c <unknown>
#3 0x58c5d3cae7c4 <unknown>
#4 0x58c5d3cfdbd3 <unknown>
#5 0x58c5d3cfd286 <unknown>
#6 0x58c5d3cef403 <unknown>
#7 0x58c5d3cbbb02 <unknown>
#8 0x58c5d3cbc7c1 <unknown>
#9 0x58c5d41bc298 <unknown>
#10 0x58c5d41c00ff <unknown>
#11 0x58c5d41a3729 <unknown>
#12 0x58c5d41c0ca5 <unknown>
#13 0x58c5d4188f8f <unknown>
#14 0x58c5d41e5308 <unknown>
#15 0x58c5d41e54e3 <unknown>
#16 0x58c5d41f7463 <unknown>
#17 0x7875a2894ac3 <unknown>
2025-10-16 09:46:47 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:47 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:47 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:47 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:47 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:47 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:47 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:47 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:47 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:47 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:47 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:47 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x626a9e8e04ca <unknown>
#1 0x626a9e35f566 <unknown>
#2 0x626a9e39ab4c <unknown>
#3 0x626a9e3967c4 <unknown>
#4 0x626a9e3e5bd3 <unknown>
#5 0x626a9e3e5286 <unknown>
#6 0x626a9e3d7403 <unknown>
#7 0x626a9e3a3b02 <unknown>
#8 0x626a9e3a47c1 <unknown>
#9 0x626a9e8a4298 <unknown>
#10 0x626a9e8a80ff <unknown>
#11 0x626a9e88b729 <unknown>
#12 0x626a9e8a8ca5 <unknown>
#13 0x626a9e870f8f <unknown>
#14 0x626a9e8cd308 <unknown>
#15 0x626a9e8cd4e3 <unknown>
#16 0x626a9e8df463 <unknown>
#17 0x76a839294ac3 <unknown>
2025-10-16 09:46:47 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:47 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:47 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:47 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:48 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:48 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:46:48 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:48 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.8MB, CPU 0.0%
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5904e22214e3 <unknown>
#1 0x5904e1f50c76 <unknown>
#2 0x5904e1f79d78 <unknown>
#3 0x5904e1f76029 <unknown>
#4 0x5904e1fb4ccc <unknown>
#5 0x5904e1fb447f <unknown>
#6 0x5904e1fabde3 <unknown>
#7 0x5904e1f812dd <unknown>
#8 0x5904e1f8234e <unknown>
#9 0x5904e21e13e4 <unknown>
#10 0x5904e21e53d7 <unknown>
#11 0x5904e21efb20 <unknown>
#12 0x5904e21e6023 <unknown>
#13 0x5904e21b41aa <unknown>
#14 0x5904e220a6b8 <unknown>
#15 0x5904e220a847 <unknown>
#16 0x5904e221a243 <unknown>
#17 0x79c74b894ac3 <unknown>
2025-10-16 09:46:48 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:48 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 1/5, 隊列大小 0, 總處理任務 1, 記憶體 128.9MB, CPU 0.0%
2025-10-16 09:46:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 127.7MB, CPU 0.0%
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a74fcf924ca <unknown>
#1 0x5a74fca11566 <unknown>
#2 0x5a74fca4cb4c <unknown>
#3 0x5a74fca487c4 <unknown>
#4 0x5a74fca97bd3 <unknown>
#5 0x5a74fca97286 <unknown>
#6 0x5a74fca89403 <unknown>
#7 0x5a74fca55b02 <unknown>
#8 0x5a74fca567c1 <unknown>
#9 0x5a74fcf56298 <unknown>
#10 0x5a74fcf5a0ff <unknown>
#11 0x5a74fcf3d729 <unknown>
#12 0x5a74fcf5aca5 <unknown>
#13 0x5a74fcf22f8f <unknown>
#14 0x5a74fcf7f308 <unknown>
#15 0x5a74fcf7f4e3 <unknown>
#16 0x5a74fcf91463 <unknown>
#17 0x72387e494ac3 <unknown>
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:46:48 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:46:48 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (2/2): WebDriver 創建失敗
2025-10-16 09:46:51 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 3/3, force_new_driver=False)
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:1118] - get_content - 正在獲取網頁內容: https://sanran.1shop.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:1149] - get_content - 設置頁面加載超時:20 秒
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 1/3 次請求
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:51 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5783b8d024ca <unknown>
#1 0x5783b8781566 <unknown>
#2 0x5783b87bcb4c <unknown>
#3 0x5783b87b87c4 <unknown>
#4 0x5783b8807bd3 <unknown>
#5 0x5783b8807286 <unknown>
#6 0x5783b87f9403 <unknown>
#7 0x5783b87c5b02 <unknown>
#8 0x5783b87c67c1 <unknown>
#9 0x5783b8cc6298 <unknown>
#10 0x5783b8cca0ff <unknown>
#11 0x5783b8cad729 <unknown>
#12 0x5783b8ccaca5 <unknown>
#13 0x5783b8c92f8f <unknown>
#14 0x5783b8cef308 <unknown>
#15 0x5783b8cef4e3 <unknown>
#16 0x5783b8d01463 <unknown>
#17 0x75d820a94ac3 <unknown>
2025-10-16 09:46:51 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:51 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:51 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:52 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:52 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 89, UID: aoej6tlh5a, 進度: 0/1
2025-10-16 09:46:52 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:52 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:52 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:52 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:52 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5c99ef4ec4e3 <unknown>
#1 0x5c99ef21bc76 <unknown>
#2 0x5c99ef244d78 <unknown>
#3 0x5c99ef241029 <unknown>
#4 0x5c99ef27fccc <unknown>
#5 0x5c99ef27f47f <unknown>
#6 0x5c99ef276de3 <unknown>
#7 0x5c99ef24c2dd <unknown>
#8 0x5c99ef24d34e <unknown>
#9 0x5c99ef4ac3e4 <unknown>
#10 0x5c99ef4b03d7 <unknown>
#11 0x5c99ef4bab20 <unknown>
#12 0x5c99ef4b1023 <unknown>
#13 0x5c99ef47f1aa <unknown>
#14 0x5c99ef4d56b8 <unknown>
#15 0x5c99ef4d5847 <unknown>
#16 0x5c99ef4e5243 <unknown>
#17 0x7aae78894ac3 <unknown>
2025-10-16 09:46:52 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:52 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:52 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5bb9148d84ca <unknown>
#1 0x5bb914357566 <unknown>
#2 0x5bb914392b4c <unknown>
#3 0x5bb91438e7c4 <unknown>
#4 0x5bb9143ddbd3 <unknown>
#5 0x5bb9143dd286 <unknown>
#6 0x5bb9143cf403 <unknown>
#7 0x5bb91439bb02 <unknown>
#8 0x5bb91439c7c1 <unknown>
#9 0x5bb91489c298 <unknown>
#10 0x5bb9148a00ff <unknown>
#11 0x5bb914883729 <unknown>
#12 0x5bb9148a0ca5 <unknown>
#13 0x5bb914868f8f <unknown>
#14 0x5bb9148c5308 <unknown>
#15 0x5bb9148c54e3 <unknown>
#16 0x5bb9148d7463 <unknown>
#17 0x7d9fc5094ac3 <unknown>
2025-10-16 09:46:52 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:52 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:52 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:52 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:52 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:52 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:52 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:52 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:52 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:52 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:52 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:52 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5c09a273c4ca <unknown>
#1 0x5c09a21bb566 <unknown>
#2 0x5c09a21f6b4c <unknown>
#3 0x5c09a21f27c4 <unknown>
#4 0x5c09a2241bd3 <unknown>
#5 0x5c09a2241286 <unknown>
#6 0x5c09a2233403 <unknown>
#7 0x5c09a21ffb02 <unknown>
#8 0x5c09a22007c1 <unknown>
#9 0x5c09a2700298 <unknown>
#10 0x5c09a27040ff <unknown>
#11 0x5c09a26e7729 <unknown>
#12 0x5c09a2704ca5 <unknown>
#13 0x5c09a26ccf8f <unknown>
#14 0x5c09a2729308 <unknown>
#15 0x5c09a27294e3 <unknown>
#16 0x5c09a273b463 <unknown>
#17 0x7bea51894ac3 <unknown>
2025-10-16 09:46:52 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:52 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:53 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:53 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:53 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:53 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:53 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:53 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:53 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5acaa6cf04e3 <unknown>
#1 0x5acaa6a1fc76 <unknown>
#2 0x5acaa6a48d78 <unknown>
#3 0x5acaa6a45029 <unknown>
#4 0x5acaa6a83ccc <unknown>
#5 0x5acaa6a8347f <unknown>
#6 0x5acaa6a7ade3 <unknown>
#7 0x5acaa6a502dd <unknown>
#8 0x5acaa6a5134e <unknown>
#9 0x5acaa6cb03e4 <unknown>
#10 0x5acaa6cb43d7 <unknown>
#11 0x5acaa6cbeb20 <unknown>
#12 0x5acaa6cb5023 <unknown>
#13 0x5acaa6c831aa <unknown>
#14 0x5acaa6cd96b8 <unknown>
#15 0x5acaa6cd9847 <unknown>
#16 0x5acaa6ce9243 <unknown>
#17 0x7403d8894ac3 <unknown>
2025-10-16 09:46:53 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:53 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:53 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x574be1e704ca <unknown>
#1 0x574be18ef566 <unknown>
#2 0x574be192ab4c <unknown>
#3 0x574be19267c4 <unknown>
#4 0x574be1975bd3 <unknown>
#5 0x574be1975286 <unknown>
#6 0x574be1967403 <unknown>
#7 0x574be1933b02 <unknown>
#8 0x574be19347c1 <unknown>
#9 0x574be1e34298 <unknown>
#10 0x574be1e380ff <unknown>
#11 0x574be1e1b729 <unknown>
#12 0x574be1e38ca5 <unknown>
#13 0x574be1e00f8f <unknown>
#14 0x574be1e5d308 <unknown>
#15 0x574be1e5d4e3 <unknown>
#16 0x574be1e6f463 <unknown>
#17 0x7e2f6ec94ac3 <unknown>
2025-10-16 09:46:53 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:53 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:53 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:53 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:53 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:46:53 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:46:53 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 2 秒後重試...
2025-10-16 09:46:55 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 2/3 次請求
2025-10-16 09:46:55 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:55 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:55 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:55 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:55 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:56 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x610b425b04ca <unknown>
#1 0x610b4202f566 <unknown>
#2 0x610b4206ab4c <unknown>
#3 0x610b420667c4 <unknown>
#4 0x610b420b5bd3 <unknown>
#5 0x610b420b5286 <unknown>
#6 0x610b420a7403 <unknown>
#7 0x610b42073b02 <unknown>
#8 0x610b420747c1 <unknown>
#9 0x610b42574298 <unknown>
#10 0x610b425780ff <unknown>
#11 0x610b4255b729 <unknown>
#12 0x610b42578ca5 <unknown>
#13 0x610b42540f8f <unknown>
#14 0x610b4259d308 <unknown>
#15 0x610b4259d4e3 <unknown>
#16 0x610b425af463 <unknown>
#17 0x776d78494ac3 <unknown>
2025-10-16 09:46:56 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:56 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:56 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:56 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:56 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:56 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:56 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:56 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:56 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5ad24a2484e3 <unknown>
#1 0x5ad249f77c76 <unknown>
#2 0x5ad249fa0d78 <unknown>
#3 0x5ad249f9d029 <unknown>
#4 0x5ad249fdbccc <unknown>
#5 0x5ad249fdb47f <unknown>
#6 0x5ad249fd2de3 <unknown>
#7 0x5ad249fa82dd <unknown>
#8 0x5ad249fa934e <unknown>
#9 0x5ad24a2083e4 <unknown>
#10 0x5ad24a20c3d7 <unknown>
#11 0x5ad24a216b20 <unknown>
#12 0x5ad24a20d023 <unknown>
#13 0x5ad24a1db1aa <unknown>
#14 0x5ad24a2316b8 <unknown>
#15 0x5ad24a231847 <unknown>
#16 0x5ad24a241243 <unknown>
#17 0x71bdaa694ac3 <unknown>
2025-10-16 09:46:56 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:56 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:57 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x58687fdc44ca <unknown>
#1 0x58687f843566 <unknown>
#2 0x58687f87eb4c <unknown>
#3 0x58687f87a7c4 <unknown>
#4 0x58687f8c9bd3 <unknown>
#5 0x58687f8c9286 <unknown>
#6 0x58687f8bb403 <unknown>
#7 0x58687f887b02 <unknown>
#8 0x58687f8887c1 <unknown>
#9 0x58687fd88298 <unknown>
#10 0x58687fd8c0ff <unknown>
#11 0x58687fd6f729 <unknown>
#12 0x58687fd8cca5 <unknown>
#13 0x58687fd54f8f <unknown>
#14 0x58687fdb1308 <unknown>
#15 0x58687fdb14e3 <unknown>
#16 0x58687fdc3463 <unknown>
#17 0x7e30f2694ac3 <unknown>
2025-10-16 09:46:57 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:57 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:57 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:57 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:57 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:57 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:46:57 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:46:57 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:46:57 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:46:57 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:46:57 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:46:57 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x64000aafb4ca <unknown>
#1 0x64000a57a566 <unknown>
#2 0x64000a5b5b4c <unknown>
#3 0x64000a5b17c4 <unknown>
#4 0x64000a600bd3 <unknown>
#5 0x64000a600286 <unknown>
#6 0x64000a5f2403 <unknown>
#7 0x64000a5beb02 <unknown>
#8 0x64000a5bf7c1 <unknown>
#9 0x64000aabf298 <unknown>
#10 0x64000aac30ff <unknown>
#11 0x64000aaa6729 <unknown>
#12 0x64000aac3ca5 <unknown>
#13 0x64000aa8bf8f <unknown>
#14 0x64000aae8308 <unknown>
#15 0x64000aae84e3 <unknown>
#16 0x64000aafa463 <unknown>
#17 0x70fc1a494ac3 <unknown>
2025-10-16 09:46:57 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:46:57 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:46:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:57 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:46:57 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:46:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:57 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:46:57 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:46:58 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x5b5b30f3f4e3 <unknown>
#1 0x5b5b30c6ec76 <unknown>
#2 0x5b5b30c97d78 <unknown>
#3 0x5b5b30c94029 <unknown>
#4 0x5b5b30cd2ccc <unknown>
#5 0x5b5b30cd247f <unknown>
#6 0x5b5b30cc9de3 <unknown>
#7 0x5b5b30c9f2dd <unknown>
#8 0x5b5b30ca034e <unknown>
#9 0x5b5b30eff3e4 <unknown>
#10 0x5b5b30f033d7 <unknown>
#11 0x5b5b30f0db20 <unknown>
#12 0x5b5b30f04023 <unknown>
#13 0x5b5b30ed21aa <unknown>
#14 0x5b5b30f286b8 <unknown>
#15 0x5b5b30f28847 <unknown>
#16 0x5b5b30f38243 <unknown>
#17 0x73e12d294ac3 <unknown>
2025-10-16 09:46:58 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:46:58 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:46:58 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5ce57448a4ca <unknown>
#1 0x5ce573f09566 <unknown>
#2 0x5ce573f44b4c <unknown>
#3 0x5ce573f407c4 <unknown>
#4 0x5ce573f8fbd3 <unknown>
#5 0x5ce573f8f286 <unknown>
#6 0x5ce573f81403 <unknown>
#7 0x5ce573f4db02 <unknown>
#8 0x5ce573f4e7c1 <unknown>
#9 0x5ce57444e298 <unknown>
#10 0x5ce5744520ff <unknown>
#11 0x5ce574435729 <unknown>
#12 0x5ce574452ca5 <unknown>
#13 0x5ce57441af8f <unknown>
#14 0x5ce574477308 <unknown>
#15 0x5ce5744774e3 <unknown>
#16 0x5ce574489463 <unknown>
#17 0x7ed040c94ac3 <unknown>
2025-10-16 09:46:58 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:46:58 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:46:58 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:46:58 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:46:58 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:46:58 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:46:58 - INFO - WebScraper - [scraper.py:1621] - get_content - 等待 4 秒後重試...
2025-10-16 09:47:02 - INFO - WebScraper - [scraper.py:1167] - get_content - 嘗試獲取 https://sanran.1shop.tw/ 的第 3/3 次請求
2025-10-16 09:47:02 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:47:02 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:47:02 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:47:02 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:47:02 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:47:02 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5805983d64ca <unknown>
#1 0x580597e55566 <unknown>
#2 0x580597e90b4c <unknown>
#3 0x580597e8c7c4 <unknown>
#4 0x580597edbbd3 <unknown>
#5 0x580597edb286 <unknown>
#6 0x580597ecd403 <unknown>
#7 0x580597e99b02 <unknown>
#8 0x580597e9a7c1 <unknown>
#9 0x58059839a298 <unknown>
#10 0x58059839e0ff <unknown>
#11 0x580598381729 <unknown>
#12 0x58059839eca5 <unknown>
#13 0x580598366f8f <unknown>
#14 0x5805983c3308 <unknown>
#15 0x5805983c34e3 <unknown>
#16 0x5805983d5463 <unknown>
#17 0x723801a94ac3 <unknown>
2025-10-16 09:47:02 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:47:02 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:47:02 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:47:02 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:47:02 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:47:02 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:47:02 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:47:03 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 89, UID: aoej6tlh5a, 進度: 0/1
2025-10-16 09:47:03 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:47:03 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x635562db44e3 <unknown>
#1 0x635562ae3c76 <unknown>
#2 0x635562b0cd78 <unknown>
#3 0x635562b09029 <unknown>
#4 0x635562b47ccc <unknown>
#5 0x635562b4747f <unknown>
#6 0x635562b3ede3 <unknown>
#7 0x635562b142dd <unknown>
#8 0x635562b1534e <unknown>
#9 0x635562d743e4 <unknown>
#10 0x635562d783d7 <unknown>
#11 0x635562d82b20 <unknown>
#12 0x635562d79023 <unknown>
#13 0x635562d471aa <unknown>
#14 0x635562d9d6b8 <unknown>
#15 0x635562d9d847 <unknown>
#16 0x635562dad243 <unknown>
#17 0x7a4542a94ac3 <unknown>
2025-10-16 09:47:03 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:47:03 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:47:03 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5f7c18ab64ca <unknown>
#1 0x5f7c18535566 <unknown>
#2 0x5f7c18570b4c <unknown>
#3 0x5f7c1856c7c4 <unknown>
#4 0x5f7c185bbbd3 <unknown>
#5 0x5f7c185bb286 <unknown>
#6 0x5f7c185ad403 <unknown>
#7 0x5f7c18579b02 <unknown>
#8 0x5f7c1857a7c1 <unknown>
#9 0x5f7c18a7a298 <unknown>
#10 0x5f7c18a7e0ff <unknown>
#11 0x5f7c18a61729 <unknown>
#12 0x5f7c18a7eca5 <unknown>
#13 0x5f7c18a46f8f <unknown>
#14 0x5f7c18aa3308 <unknown>
#15 0x5f7c18aa34e3 <unknown>
#16 0x5f7c18ab5463 <unknown>
#17 0x733df4694ac3 <unknown>
2025-10-16 09:47:03 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:47:03 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:47:03 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:47:03 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:47:03 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:47:03 - ERROR - WebScraper - [scraper.py:1196] - get_content - 通過實例池管理器創建WebDriver失敗: cannot create weak reference to 'NoneType' object
2025-10-16 09:47:03 - INFO - WebScraper - [scraper.py:971] - _create_driver_internal - 正在創建 WebDriver 實例...
2025-10-16 09:47:03 - INFO - WebScraper - [scraper.py:975] - _create_driver_internal - 嘗試方法1:使用智能路徑發現機制
2025-10-16 09:47:03 - INFO - WebScraper - [scraper.py:856] - smart_find_chrome_paths - 找到 ChromeDriver: /usr/local/bin/chromedriver
2025-10-16 09:47:03 - INFO - WebScraper - [scraper.py:892] - smart_find_chrome_paths - 找到 Chrome 二進制文件: /usr/bin/google-chrome
2025-10-16 09:47:03 - INFO - WebScraper - [scraper.py:911] - smart_find_chrome_paths - 智能路徑搜尋成功 - ChromeDriver: /usr/local/bin/chromedriver, Chrome: /usr/bin/google-chrome
2025-10-16 09:47:03 - ERROR - WebScraper - [scraper.py:992] - _create_driver_internal - 智能路徑搜索失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x57dec78ba4ca <unknown>
#1 0x57dec7339566 <unknown>
#2 0x57dec7374b4c <unknown>
#3 0x57dec73707c4 <unknown>
#4 0x57dec73bfbd3 <unknown>
#5 0x57dec73bf286 <unknown>
#6 0x57dec73b1403 <unknown>
#7 0x57dec737db02 <unknown>
#8 0x57dec737e7c1 <unknown>
#9 0x57dec787e298 <unknown>
#10 0x57dec78820ff <unknown>
#11 0x57dec7865729 <unknown>
#12 0x57dec7882ca5 <unknown>
#13 0x57dec784af8f <unknown>
#14 0x57dec78a7308 <unknown>
#15 0x57dec78a74e3 <unknown>
#16 0x57dec78b9463 <unknown>
#17 0x7a3cb5a94ac3 <unknown>
2025-10-16 09:47:03 - INFO - WebScraper - [scraper.py:996] - _create_driver_internal - 嘗試方法2:使用 webdriver-manager 自動管理
2025-10-16 09:47:03 - INFO - WDM - [logger.py:11] - log - ====== WebDriver manager ======
2025-10-16 09:47:03 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:47:03 - INFO - WDM - [logger.py:11] - log - About to download new driver from https://chromedriver.storage.googleapis.com/114.0.5735.90/chromedriver_linux64.zip
2025-10-16 09:47:03 - INFO - WDM - [logger.py:11] - log - Driver downloading response is 200
2025-10-16 09:47:03 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:47:04 - INFO - WDM - [logger.py:11] - log - Get LATEST chromedriver version for google-chrome
2025-10-16 09:47:04 - INFO - WDM - [logger.py:11] - log - Driver has been saved in cache [/opt/urlanalyze/.wdm/drivers/chromedriver/linux64/114.0.5735.90]
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1007] - _create_driver_internal - webdriver-manager 方法失敗: Message: unknown error: Chrome failed to start: exited abnormally.
(unknown error: DevToolsActivePort file doesn't exist)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
Stacktrace:
#0 0x59f5324234e3 <unknown>
#1 0x59f532152c76 <unknown>
#2 0x59f53217bd78 <unknown>
#3 0x59f532178029 <unknown>
#4 0x59f5321b6ccc <unknown>
#5 0x59f5321b647f <unknown>
#6 0x59f5321adde3 <unknown>
#7 0x59f5321832dd <unknown>
#8 0x59f53218434e <unknown>
#9 0x59f5323e33e4 <unknown>
#10 0x59f5323e73d7 <unknown>
#11 0x59f5323f1b20 <unknown>
#12 0x59f5323e8023 <unknown>
#13 0x59f5323b61aa <unknown>
#14 0x59f53240c6b8 <unknown>
#15 0x59f53240c847 <unknown>
#16 0x59f53241c243 <unknown>
#17 0x7f8789494ac3 <unknown>
2025-10-16 09:47:04 - INFO - WebScraper - [scraper.py:1011] - _create_driver_internal - 嘗試方法3:使用系統 PATH 中的 chromedriver
2025-10-16 09:47:04 - INFO - WebScraper - [scraper.py:1030] - _create_driver_internal - 找到 chromedriver: /usr/local/bin/chromedriver
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1039] - _create_driver_internal - 系統 chromedriver 方法失敗: Message: session not created: probably user data directory is already in use, please specify a unique value for --user-data-dir argument, or don't use --user-data-dir; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5e45c55d14ca <unknown>
#1 0x5e45c5050566 <unknown>
#2 0x5e45c508bb4c <unknown>
#3 0x5e45c50877c4 <unknown>
#4 0x5e45c50d6bd3 <unknown>
#5 0x5e45c50d6286 <unknown>
#6 0x5e45c50c8403 <unknown>
#7 0x5e45c5094b02 <unknown>
#8 0x5e45c50957c1 <unknown>
#9 0x5e45c5595298 <unknown>
#10 0x5e45c55990ff <unknown>
#11 0x5e45c557c729 <unknown>
#12 0x5e45c5599ca5 <unknown>
#13 0x5e45c5561f8f <unknown>
#14 0x5e45c55be308 <unknown>
#15 0x5e45c55be4e3 <unknown>
#16 0x5e45c55d0463 <unknown>
#17 0x7696efc94ac3 <unknown>
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1042] - _create_driver_internal - 所有Chrome方法都失敗,嘗試 Firefox 作為備用方案
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1091] - _create_driver_internal - Firefox 系統路徑也失敗: [Errno 2] No such file or directory: 'which'
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1095] - _create_driver_internal - 最終失敗: 所有瀏覽器都無法啟動
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1099] - _create_driver_internal - 創建 WebDriver 完全失敗: 無法創建任何 WebDriver
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1200] - get_content - 降級創建WebDriver也失敗,跳過 Selenium 方法
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1611] - get_content - 獲取 URL https://sanran.1shop.tw/ 時出現意外錯誤: WebDriver 創建失敗
2025-10-16 09:47:04 - ERROR - WebScraper - [scraper.py:1627] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:47:04 - ERROR - main - [url_processor.py:123] - process_url - 達到最大重試次數,放棄獲取 URL: https://sanran.1shop.tw/
2025-10-16 09:47:04 - ERROR - main - [url_processor.py:640] - process_url - 處理 URL 時發生未預期錯誤: WebDriver 創建失敗
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1185, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 303, in get_or_create_instance
self.register_instance(driver)
File "/opt/urlanalyze/webdriver_instance_manager.py", line 78, in register_instance
self._active_instances.add(driver)
File "/usr/lib/python3.11/_weakrefset.py", line 88, in add
self.data.add(ref(item, self._remove))
^^^^^^^^^^^^^^^^^^^^^^^
TypeError: cannot create weak reference to 'NoneType' object
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/processing/url_processor.py", line 98, in process_url
html_content, title, final_url = web_scraper.get_content(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 1201, in get_content
raise Exception("WebDriver 創建失敗")
Exception: WebDriver 創建失敗
2025-10-16 09:47:04 - INFO - database - [database.py:505] - update_url_status - URL ID 89 状态已更新为 error
2025-10-16 09:47:04 - INFO - main - [url_processor.py:653] - process_url - 工作線程 #2 完成處理 URL ID: 89
2025-10-16 09:47:14 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 89, UID: aoej6tlh5a, 進度: 0/1
2025-10-16 09:47:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:47:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:47:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:47:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:47:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:47:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:47:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:47:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:48:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:48:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.8MB, CPU 0.0%
2025-10-16 09:48:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 2, 記憶體 128.9MB, CPU 0.0%
2025-10-16 09:48:18 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 127.7MB, CPU 0.0%
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:48:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:48:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:48:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:48:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:48:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:48:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:48:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:49:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:49:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:49:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:49:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:49:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:49:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:49:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:49:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:49:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:49:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.8MB, CPU 0.0%
2025-10-16 09:49:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 2, 記憶體 128.9MB, CPU 0.0%
2025-10-16 09:49:48 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 127.7MB, CPU 0.0%
2025-10-16 09:50:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:50:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:50:20 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:50:20 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:50:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:50:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:50:21 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:50:21 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:51:12 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:51:12 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:51:12 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:51:12 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:51:12 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:51:12 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:51:12 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:51:12 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:51:12 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:51:12 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:51:12 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:51:12 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:51:14 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:51:15 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:51:15 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:51:15 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:51:15 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:51:15 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.77GB
2025-10-16 09:51:15 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:51:15 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:51:15 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:51:15 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:51:15 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:51:15 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:51:15 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:51:15 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:51:15 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:51:15 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:51:15 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:51:15 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:51:15 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:51:15 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:51:15 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:51:15 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:51:15 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:51:15 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:51:15 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:51:15 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:51:15 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.76GB
2025-10-16 09:51:15 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:51:15 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:51:15 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:51:15 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.76GB
2025-10-16 09:51:15 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:51:15 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:51:15 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:51:15 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.76GB
2025-10-16 09:51:15 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:51:15 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:51:15 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:51:15 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:51:15 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:51:15 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:51:15 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:51:15 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:51:15 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:51:15 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:51:15 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:51:15 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:51:15 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:51:15 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:51:15 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:51:15 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:51:15 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:51:15 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:51:15 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:51:15 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:51:15 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:51:15 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:51:15 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:51:15 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:51:15 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:51:15 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:51:15 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:51:15 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:51:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:52:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:52:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:52:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:52:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:52:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:52:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:52:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:52:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:52:45 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.2MB, CPU 0.0%
2025-10-16 09:52:45 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.2MB, CPU 0.0%
2025-10-16 09:52:45 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.3MB, CPU 0.0%
2025-10-16 09:52:45 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 120.9MB, CPU 0.0%
2025-10-16 09:53:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:53:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:53:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:53:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:53:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:53:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:53:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:53:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:53:46 - INFO - database - [database.py:1046] - check_database_integrity - 数据库完整性检查通过: 5 个 URL 记录, 13 个日志记录
2025-10-16 09:54:12 - INFO - database - [database.py:420] - process_url - UI 提交生成 UID: xkb99fhq50
2025-10-16 09:54:12 - INFO - database - [database.py:426] - process_url - UI 提交 URL https://www.twitch.tv/iamruru,結果將立即顯示
2025-10-16 09:54:12 - INFO - database - [database.py:436] - process_url - URL https://www.twitch.tv/iamruru 已存在,但按照需求視為新提交進行審核
2025-10-16 09:54:12 - INFO - main - [web_routes.py:115] - submit_url - UI 提交,URL ID: 90, Phone: , Email: chengruwu0322@gmail.com
2025-10-16 09:54:12 - INFO - database - [database.py:536] - get_pending_url - 找到待处理的 URL: ID=90, URL=https://www.twitch.tv/iamruru
2025-10-16 09:54:12 - INFO - main - [request_processor.py:690] - process_pending_urls - 已添加 1 個 URL 到處理隊列
2025-10-16 09:54:12 - INFO - main - [url_processor.py:42] - process_url - 工作線程 #1 開始處理 URL ID: 90
2025-10-16 09:54:12 - INFO - main - [url_processor.py:83] - process_url - 分析 URL: https://www.twitch.tv/iamruru
2025-10-16 09:54:12 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 1/3, force_new_driver=False)
2025-10-16 09:54:12 - INFO - WebScraper - [scraper.py:1273] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:54:12 - INFO - WebScraper - [scraper.py:1313] - get_content - 設置頁面加載超時:30 秒(基於網站配置)
2025-10-16 09:54:12 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:54:12 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:12 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:12 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:13 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:13 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:13 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:13 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 90, UID: xkb99fhq50, 進度: 0/1
2025-10-16 09:54:15 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:15 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:15 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:15 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:15 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:15 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:15 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:15 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:15 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.2MB, CPU 0.0%
2025-10-16 09:54:15 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.8MB, CPU 0.0%
2025-10-16 09:54:15 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 1/5, 隊列大小 0, 總處理任務 0, 記憶體 125.8MB, CPU 0.0%
2025-10-16 09:54:15 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 123.0MB, CPU 0.0%
2025-10-16 09:54:16 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:16 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:16 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:54:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:54:18 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:18 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:18 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:18 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:18 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 2 秒後重試...
2025-10-16 09:54:20 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:54:20 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:20 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:20 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:21 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:21 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:21 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:23 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:23 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:23 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:23 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:23 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:23 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:23 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:23 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:23 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 90, UID: xkb99fhq50, 進度: 0/1
2025-10-16 09:54:24 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:24 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:24 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:26 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:26 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:26 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:26 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:26 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 4 秒後重試...
2025-10-16 09:54:30 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:54:30 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:30 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:30 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:31 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:31 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:31 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:33 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:33 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:33 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:33 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:33 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:33 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:33 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:33 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:33 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 90, UID: xkb99fhq50, 進度: 0/1
2025-10-16 09:54:34 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:34 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:34 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:36 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:36 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:36 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:36 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:36 - ERROR - WebScraper - [scraper.py:1791] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1349, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 297, in get_or_create_instance
driver = creator_func()
^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1362, in get_content
self.driver = self.create_driver()
^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:36 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (1/2): WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:39 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 2/3, force_new_driver=False)
2025-10-16 09:54:39 - INFO - WebScraper - [scraper.py:1273] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:54:39 - INFO - WebScraper - [scraper.py:1313] - get_content - 設置頁面加載超時:30 秒(基於網站配置)
2025-10-16 09:54:39 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:54:39 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:39 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:39 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:40 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:40 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:40 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:42 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:42 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:42 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:42 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:42 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:42 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:42 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:42 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:43 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:43 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:43 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:43 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 90, UID: xkb99fhq50, 進度: 0/1
2025-10-16 09:54:45 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:45 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:45 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:45 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:45 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 2 秒後重試...
2025-10-16 09:54:47 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:54:47 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:47 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:47 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:48 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:48 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:48 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:50 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:50 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:50 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:50 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:50 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:50 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:50 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:50 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:51 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:51 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:51 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:54:53 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:53 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:53 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:53 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:53 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 4 秒後重試...
2025-10-16 09:54:53 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 90, UID: xkb99fhq50, 進度: 0/1
2025-10-16 09:54:57 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:54:57 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:57 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:57 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:54:58 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:58 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:54:58 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:00 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:00 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:00 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:00 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:00 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:00 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:00 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:00 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:01 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:01 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:01 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:03 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:03 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:03 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:03 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:03 - ERROR - WebScraper - [scraper.py:1791] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1349, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 297, in get_or_create_instance
driver = creator_func()
^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1362, in get_content
self.driver = self.create_driver()
^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:03 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (2/2): WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:06 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 3/3, force_new_driver=False)
2025-10-16 09:55:06 - INFO - WebScraper - [scraper.py:1273] - get_content - 正在獲取網頁內容: https://www.twitch.tv/iamruru, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:55:06 - INFO - WebScraper - [scraper.py:1313] - get_content - 設置頁面加載超時:30 秒(基於網站配置)
2025-10-16 09:55:06 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 1/3 次請求
2025-10-16 09:55:06 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:06 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:06 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:07 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:07 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:07 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:09 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:09 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:09 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:09 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:09 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:09 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:09 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:09 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:10 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:10 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:10 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:10 - INFO - database - [database.py:420] - process_url - UI 提交生成 UID: 2r5bgrjo69
2025-10-16 09:55:10 - INFO - database - [database.py:426] - process_url - UI 提交 URL https://www.ecpay.com.tw/,結果將立即顯示
2025-10-16 09:55:10 - INFO - database - [database.py:436] - process_url - URL https://www.ecpay.com.tw/ 已存在,但按照需求視為新提交進行審核
2025-10-16 09:55:10 - INFO - main - [web_routes.py:115] - submit_url - UI 提交,URL ID: 91, Phone: 02-2655-1775, Email:
2025-10-16 09:55:10 - INFO - database - [database.py:536] - get_pending_url - 找到待处理的 URL: ID=91, URL=https://www.ecpay.com.tw/
2025-10-16 09:55:10 - INFO - main - [request_processor.py:690] - process_pending_urls - 已添加 1 個 URL 到處理隊列
2025-10-16 09:55:10 - INFO - main - [url_processor.py:42] - process_url - 工作線程 #1 開始處理 URL ID: 91
2025-10-16 09:55:10 - INFO - main - [url_processor.py:83] - process_url - 分析 URL: https://www.ecpay.com.tw/
2025-10-16 09:55:10 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 1/3, force_new_driver=False)
2025-10-16 09:55:10 - INFO - WebScraper - [scraper.py:1273] - get_content - 正在獲取網頁內容: https://www.ecpay.com.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:55:10 - INFO - WebScraper - [scraper.py:1313] - get_content - 設置頁面加載超時:15 秒(基於網站配置)
2025-10-16 09:55:10 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 1/3 次請求
2025-10-16 09:55:10 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:10 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:10 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:11 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:11 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:11 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:12 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:12 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:12 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:12 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:12 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 2 秒後重試...
2025-10-16 09:55:13 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:13 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:13 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:13 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:13 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:13 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:13 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:13 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:14 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 2/3 次請求
2025-10-16 09:55:14 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:14 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:14 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:14 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:14 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:14 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:15 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:15 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:15 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:55:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:55:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:55:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:55:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:55:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:55:16 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:16 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:16 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:16 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:16 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 2 秒後重試...
2025-10-16 09:55:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:55:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:55:17 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:17 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:17 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:17 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:17 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:17 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:17 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:17 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:18 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:18 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:18 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:18 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 90, UID: xkb99fhq50, 進度: 0/1
2025-10-16 09:55:18 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 2/3 次請求
2025-10-16 09:55:18 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:18 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:18 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:19 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:19 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:19 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:20 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:20 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:20 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:20 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:20 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 4 秒後重試...
2025-10-16 09:55:21 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:21 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:21 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:21 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:21 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:21 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:21 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:21 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:22 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:22 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:22 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:24 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.twitch.tv/iamruru 的第 3/3 次請求
2025-10-16 09:55:24 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:24 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:24 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:24 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:24 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:24 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:24 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:24 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 4 秒後重試...
2025-10-16 09:55:25 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 91, UID: 2r5bgrjo69, 進度: 0/1
2025-10-16 09:55:25 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:25 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:25 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:27 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:27 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:27 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:27 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:27 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:27 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:27 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:27 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:28 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:28 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:28 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:28 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 3/3 次請求
2025-10-16 09:55:28 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:28 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:28 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:29 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:29 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:29 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:30 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:30 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:30 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:30 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.twitch.tv/iamruru 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:30 - ERROR - WebScraper - [scraper.py:1791] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1349, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 297, in get_or_create_instance
driver = creator_func()
^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1362, in get_content
self.driver = self.create_driver()
^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:30 - ERROR - main - [url_processor.py:123] - process_url - 達到最大重試次數,放棄獲取 URL: https://www.twitch.tv/iamruru
2025-10-16 09:55:30 - ERROR - main - [url_processor.py:640] - process_url - 處理 URL 時發生未預期錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1349, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 297, in get_or_create_instance
driver = creator_func()
^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/processing/url_processor.py", line 98, in process_url
html_content, title, final_url = web_scraper.get_content(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 1362, in get_content
self.driver = self.create_driver()
^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:30 - INFO - database - [database.py:505] - update_url_status - URL ID 90 状态已更新为 error
2025-10-16 09:55:30 - INFO - main - [url_processor.py:653] - process_url - 工作線程 #1 完成處理 URL ID: 90
2025-10-16 09:55:31 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:31 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:31 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:31 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:31 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:31 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:31 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:31 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:32 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:32 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:32 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:34 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:34 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:34 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:34 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:34 - ERROR - WebScraper - [scraper.py:1791] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1349, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 297, in get_or_create_instance
driver = creator_func()
^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1362, in get_content
self.driver = self.create_driver()
^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:34 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (1/2): WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:37 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 2/3, force_new_driver=False)
2025-10-16 09:55:37 - INFO - WebScraper - [scraper.py:1273] - get_content - 正在獲取網頁內容: https://www.ecpay.com.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:55:37 - INFO - WebScraper - [scraper.py:1313] - get_content - 設置頁面加載超時:15 秒(基於網站配置)
2025-10-16 09:55:37 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 1/3 次請求
2025-10-16 09:55:37 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:37 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:37 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:38 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:38 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:38 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:40 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:40 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:40 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:40 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:40 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:40 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:40 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:40 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:41 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:41 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:41 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:43 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:43 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:43 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:43 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:43 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 2 秒後重試...
2025-10-16 09:55:43 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 90, UID: xkb99fhq50, 進度: 0/1
2025-10-16 09:55:45 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.2MB, CPU 0.0%
2025-10-16 09:55:45 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.8MB, CPU 0.0%
2025-10-16 09:55:45 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 125.8MB, CPU 0.0%
2025-10-16 09:55:45 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 1/5, 隊列大小 0, 總處理任務 0, 記憶體 125.6MB, CPU 0.0%
2025-10-16 09:55:45 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 2/3 次請求
2025-10-16 09:55:45 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:45 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:45 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:46 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:46 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:46 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:48 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:48 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:48 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:48 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:48 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:48 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:48 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:48 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:49 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:49 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:49 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:51 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:51 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:51 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:51 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:51 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 4 秒後重試...
2025-10-16 09:55:55 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 3/3 次請求
2025-10-16 09:55:55 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:55 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:55 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:56 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:56 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:56 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:55:58 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:58 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:58 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:58 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:58 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:58 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:58 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:58 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:55:59 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:59 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:55:59 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:56:01 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 91, UID: 2r5bgrjo69, 進度: 0/1
2025-10-16 09:56:01 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:01 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:01 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:01 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:01 - ERROR - WebScraper - [scraper.py:1791] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1349, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 297, in get_or_create_instance
driver = creator_func()
^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1362, in get_content
self.driver = self.create_driver()
^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:01 - WARNING - main - [url_processor.py:120] - process_url - 獲取內容失敗,等待 3 秒後重試 (2/2): WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:04 - INFO - main - [url_processor.py:97] - process_url - 嘗試獲取網頁內容 (嘗試 3/3, force_new_driver=False)
2025-10-16 09:56:04 - INFO - WebScraper - [scraper.py:1273] - get_content - 正在獲取網頁內容: https://www.ecpay.com.tw/, use_selenium=True, proxy=False, force_new_driver=False
2025-10-16 09:56:04 - INFO - WebScraper - [scraper.py:1313] - get_content - 設置頁面加載超時:15 秒(基於網站配置)
2025-10-16 09:56:04 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 1/3 次請求
2025-10-16 09:56:04 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:04 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:04 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:56:05 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:05 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:05 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:56:07 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:07 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:07 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:07 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:07 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:07 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:07 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:07 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:56:08 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:08 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:08 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:56:10 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:10 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:10 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:10 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:10 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 2 秒後重試...
2025-10-16 09:56:11 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 91, UID: 2r5bgrjo69, 進度: 0/1
2025-10-16 09:56:12 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 2/3 次請求
2025-10-16 09:56:12 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:12 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:12 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:56:13 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:13 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:13 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:56:15 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:15 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:15 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:15 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:15 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:15 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:15 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:15 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.09 秒,結果: 0
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:56:16 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:16 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:16 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.08 秒,結果: 0
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.07 秒,結果: 0
2025-10-16 09:56:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.09 秒,結果: 0
2025-10-16 09:56:18 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:18 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:18 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:18 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:18 - INFO - WebScraper - [scraper.py:1785] - get_content - 等待 4 秒後重試...
2025-10-16 09:56:22 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 91, UID: 2r5bgrjo69, 進度: 0/1
2025-10-16 09:56:22 - INFO - WebScraper - [scraper.py:1331] - get_content - 嘗試獲取 https://www.ecpay.com.tw/ 的第 3/3 次請求
2025-10-16 09:56:22 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:22 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:22 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:56:23 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:23 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:23 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:56:25 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:25 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:25 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:25 - ERROR - WebDriverInstanceManager - [webdriver_instance_manager.py:312] - get_or_create_instance - 創建WebDriver實例失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:25 - ERROR - WebScraper - [scraper.py:1360] - get_content - 通過實例池管理器創建WebDriver失敗: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:25 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:25 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 1/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:25 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 2/3,等待 1.0 秒...
2025-10-16 09:56:26 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:26 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 2/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:26 - INFO - WebScraper - [scraper.py:867] - _create_driver_with_retry - WebDriver 創建重試 3/3,等待 2.0 秒...
2025-10-16 09:56:28 - ERROR - WebScraper - [scraper.py:1254] - _create_driver_internal - 創建 WebDriver 完全失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:28 - ERROR - WebScraper - [scraper.py:889] - _create_driver_with_retry - 未知錯誤類型 (嘗試 3/3): 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:28 - ERROR - WebScraper - [scraper.py:894] - _create_driver_with_retry - WebDriver 創建經過 3 次重試後最終失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:28 - ERROR - WebScraper - [scraper.py:1775] - get_content - 獲取 URL https://www.ecpay.com.tw/ 時出現意外錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:28 - ERROR - WebScraper - [scraper.py:1791] - get_content - 完整錯誤追蹤: Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1349, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 297, in get_or_create_instance
driver = creator_func()
^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1362, in get_content
self.driver = self.create_driver()
^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:28 - ERROR - main - [url_processor.py:123] - process_url - 達到最大重試次數,放棄獲取 URL: https://www.ecpay.com.tw/
2025-10-16 09:56:28 - ERROR - main - [url_processor.py:640] - process_url - 處理 URL 時發生未預期錯誤: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
Traceback (most recent call last):
File "/opt/urlanalyze/scraper.py", line 1349, in get_content
self.driver = webdriver_manager.get_or_create_instance(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/webdriver_instance_manager.py", line 297, in get_or_create_instance
driver = creator_func()
^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/opt/urlanalyze/processing/url_processor.py", line 98, in process_url
html_content, title, final_url = web_scraper.get_content(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 1362, in get_content
self.driver = self.create_driver()
^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 842, in create_driver
return self._create_driver_with_retry()
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/urlanalyze/scraper.py", line 895, in _create_driver_with_retry
raise WebDriverCreationError(f"WebDriver 創建經過 {max_retries} 次重試後仍然失敗: {str(last_error)}")
exceptions.WebDriverCreationError: WebDriver 創建經過 3 次重試後仍然失敗: 所有 WebDriver 創建方法都失敗: cannot access local variable 'time' where it is not associated with a value
2025-10-16 09:56:28 - INFO - database - [database.py:505] - update_url_status - URL ID 91 状态已更新为 error
2025-10-16 09:56:28 - INFO - main - [url_processor.py:653] - process_url - 工作線程 #1 完成處理 URL ID: 91
2025-10-16 09:56:32 - INFO - main - [web_routes.py:186] - result - UI 提交 - URL ID 91, UID: 2r5bgrjo69, 進度: 0/1
2025-10-16 09:57:15 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.2MB, CPU 0.0%
2025-10-16 09:57:15 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.8MB, CPU 0.0%
2025-10-16 09:57:15 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 126.3MB, CPU 0.0%
2025-10-16 09:57:15 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 1, 記憶體 126.2MB, CPU 0.0%
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:57:16 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:57:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:57:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:57:17 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:57:17 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:54 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:57:54 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:57:54 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:57:54 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:57:54 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:57:54 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:57:54 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:57:54 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:57:54 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:57:54 - INFO - root - [logging_config.py:130] - setup_logging - 日誌系統初始化完成,小時日誌檔案: 20251016_09.log,路徑: Log/20251016_09.log
2025-10-16 09:57:54 - INFO - main - [main.py:35] - <module> - 應用啟動:正在初始化...
2025-10-16 09:57:54 - INFO - main - [main.py:46] - <module> - CSRF 防護已啟用
2025-10-16 09:57:57 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:57:57 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:57:57 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:57:57 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:57:57 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:57:57 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:57:57 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:57:57 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:57:57 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:57:57 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:57:57 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:57:57 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.78GB
2025-10-16 09:57:57 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:57:57 - INFO - root - [crypto_utils.py:26] - <module> - 成功載入 pycryptodome 版本: 3.23.0
2025-10-16 09:57:57 - INFO - main - [main.py:130] - <module> - 已註冊 5 個 Blueprint
2025-10-16 09:57:57 - INFO - main - [main.py:229] - initialize_database - 應用啟動:正在初始化數據庫...
2025-10-16 09:57:57 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:57:57 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:57:57 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.78GB
2025-10-16 09:57:57 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:57:57 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:57:57 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:57:57 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.78GB
2025-10-16 09:57:57 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:57:57 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:57:57 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:57:57 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:57:57 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:57:57 - INFO - main - [main.py:233] - initialize_database - 數據庫表結構已創建
2025-10-16 09:57:57 - INFO - database - [database.py:212] - get_engine - 正在連接到資料庫...
2025-10-16 09:57:57 - INFO - database - [database.py:75] - calculate_pool_size - 系統資源:CPU 核心=2, 總記憶體=7.71GB, 可用記憶體=6.78GB
2025-10-16 09:57:57 - INFO - database - [database.py:101] - calculate_pool_size - 動態計算連接池配置:pool_size=6, max_overflow=9
2025-10-16 09:57:57 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:57:57 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:57:57 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:57:57 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:57:57 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:57:57 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:57:57 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:57:57 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:57:57 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:57:57 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:57:57 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:57:57 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:57:57 - INFO - database - [database.py:242] - get_engine - 資料庫連接測試成功
2025-10-16 09:57:57 - INFO - database - [database.py:246] - get_engine - 連接池初始健康狀態:True, 使用率:0.0%
2025-10-16 09:57:57 - INFO - database - [database.py:322] - init_db - 数据库初始化成功
2025-10-16 09:57:57 - INFO - main - [main.py:238] - initialize_database - 數據庫初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:56] - setup_app - 正在初始化应用程序组件...
2025-10-16 09:57:57 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:57:57 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:57:57 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:57:57 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:57:57 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:57:57 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:57:57 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:64] - setup_app - 數據表已確認創建
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:72] - setup_app - 数据库初始化成功
2025-10-16 09:57:57 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:41] - __init__ - 從環境變量獲取的 API 密鑰長度: 32
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:42] - __init__ - 環境變量中的所有變量: ['GPT41_API_KEY']
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:54] - __init__ - 已成功加載 GPT4_API_KEY
2025-10-16 09:57:57 - INFO - ContentAnalyzer - [analyzer.py:73] - __init__ - Successfully imported AzureOpenAI module
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:80] - setup_app - 内容分析器初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:85] - setup_app - 已同步 content_analyzer 到 url_processor 模組
2025-10-16 09:57:57 - INFO - WebDriverInstanceManager - [webdriver_instance_manager.py:58] - __init__ - WebDriver實例管理器初始化完成,最大實例數: 3,隊列大小: 10
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:93] - setup_app - 网页抓取器初始化成功
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:101] - setup_app - 已同步全局變量到 url_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:105] - setup_app - 已同步 web_scraper 到 helpers 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:110] - setup_app - 已同步全局變量到 request_processor 模組
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:112] - setup_app - ✅ 所有處理模組的全局變量同步完成
2025-10-16 09:57:57 - INFO - ThreadPoolManager - [thread_pool.py:67] - start - 啟動線程池,初始化 5 個工作線程
2025-10-16 09:57:57 - INFO - ThreadPoolManager - [thread_pool.py:80] - start - 線程池啟動完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:120] - setup_app - 线程池初始化成功
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:40] - start - 啟動任務調度器
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_requests',間隔 180 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'reset_stalled_urls',間隔 1800 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'clean_old_logs',間隔 7200 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'check_database_integrity',間隔 43200 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'perform_garbage_collection',間隔 14400 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'update_hourly_log_file',間隔 300 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'process_api_requests',間隔 60 秒,已啟用
2025-10-16 09:57:57 - INFO - scheduler - [scheduler.py:181] - add_task - 已添加任務 'daily_audit_quality_check',間隔 21600 秒,已啟用
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:217] - setup_scheduled_tasks - 已設置每6小時審核品質檢查任務
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:222] - setup_scheduled_tasks - 定期任务设置完成
2025-10-16 09:57:57 - INFO - main - [app_initializer.py:129] - setup_app - 应用程序组件初始化完成
2025-10-16 09:57:57 - INFO - main - [main.py:248] - initialize_database - 已更新 admin_routes 的數據庫變量
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_requests
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: reset_stalled_urls
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'reset_stalled_urls' 執行完成,耗時 0.01 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: update_hourly_log_file
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'update_hourly_log_file' 執行完成,耗時 0.00 秒,結果: False
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:57:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:58:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:58:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:58:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:58:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:58:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:58:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:58:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:58:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.03 秒,結果: 0
2025-10-16 09:59:27 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.8MB, CPU 0.0%
2025-10-16 09:59:27 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.6MB, CPU 0.0%
2025-10-16 09:59:27 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 121.5MB, CPU 0.0%
2025-10-16 09:59:27 - INFO - ThreadPoolManager - [thread_pool.py:313] - _perform_health_check - 線程池健康檢查: 活躍線程 0/5, 隊列大小 0, 總處理任務 0, 記憶體 122.0MB, CPU 0.0%
2025-10-16 09:59:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:59:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:59:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:59:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:59:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:59:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0
2025-10-16 09:59:58 - INFO - scheduler - [scheduler.py:116] - _execute_task_thread - 執行任務: process_api_requests
2025-10-16 09:59:58 - INFO - scheduler - [scheduler.py:134] - _execute_task_thread - 任務 'process_api_requests' 執行完成,耗時 0.02 秒,結果: 0