o Gj@svdZddlZddlZddlmZmZddlmZddlm Z ddl Z ddl m Z ddl Z eeZGdddeZdS) zO Base scraper class with shared HTTP logic, retry handling, and rate limiting. N)ABCabstractmethod)date)List)EPGEntryc @seZdZdZddZedefddZedefddZ ed ed ed e de e fd d Z d e de e fddZdedefddZdS) BaseScraperz%Abstract base class for EPG scrapers.cCs0t|_|jjtjddd|_d|_dS)Nzapplication/json)z User-AgentAcceptrg?) requestsSessionsessionheadersupdateconfig USER_AGENT_last_request_time_min_request_intervalselfrE/var/www/addictedbytheproject.nl/epg_general/scrapers/base_scraper.py__init__s  zBaseScraper.__init__returncCdS)z:Return the provider name (e.g., 'rai', 'mediaset', 'sky').Nrrrrrget_provider_namezBaseScraper.get_provider_namecCr)z*Return dict of channel_id -> display_name.Nrrrrr get_channels#rzBaseScraper.get_channels channel_id channel_name target_datecCr)z4Fetch schedule for a single channel on a given date.Nr)rrrrrrrfetch_channel_schedule(sz"BaseScraper.fetch_channel_schedulec Csg}|}|D]G\}}z!||||}||td|d|dt|dWq tyQ}zt d|d|d|WYd}~q d}~ww|S)z1Fetch schedule for all channels of this provider.[z] : z programmi trovatiz ] Errore per N) ritemsrextendloggerinforlen Exceptionerror)rr all_entrieschannelsrrentrieserrrfetch_all_channels.s*  zBaseScraper.fetch_all_channelsurlcCst|j}||jkrt|j|d}tdtjdD]}zt|_|jj|tj d}| | WSt j jyg}z |}td|d|jd|dtjd| WYd}~nUd}~wt j jy}z|}td|d |dtjd|WYd}~n,d}~wty}z|}td|d |dtjd|WYd}~nd}~ww|tjkrttj|qtd|d tjd |d |)zt Make an HTTP GET request with retry logic and rate limiting. Returns parsed JSON response. N)timeoutr z] HTTP z (tentativo /z): z] Errore di rete (tentativo z!] Errore parsing JSON (tentativo z ] Tutti i z tentativi falliti per r!)timerrsleepranger MAX_RETRIESr getREQUEST_TIMEOUTraise_for_statusjsonr exceptions HTTPErrorr$warningr status_codeRequestException ValueError RETRY_DELAYConnectionError)rr.elapsed last_errorattemptresponser,rrr _make_requestEsv     zBaseScraper._make_requestN)__name__ __module__ __qualname____doc__rrstrrdictrrrrrr-rFrrrrrs   r)rJr2loggingabcrrdatetimertypingrr modelsrr getLoggerrGr$rrrrrs